[2025-09-30T17:00:02.037147] [INFO ] [MAIN ] Using last completed trading day: 2025-09-30 [2025-09-30T17:00:02.282377] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-09-30T17:00:02.282538] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-09-30T17:00:02.590550] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-09-30T17:00:02.591172] [WARN ] [STATE ] State set to: RUNNING [2025-09-30T17:00:02.591278] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-09-30T17:00:02.591364] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-30T17:00:02.591544] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-30T17:00:02.591634] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-30T17:00:03.538080] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-30T17:00:03.538277] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-30T17:00:03.538513] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-30T17:00:03.539668] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-30T17:00:03.539738] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-30T17:00:03.539775] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-30T17:00:03.539835] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-30T17:00:03.539868] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-30T17:00:03.539931] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-30T17:00:03.540367] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-30T17:00:03.540421] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-30T17:00:03.540583] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-30T17:00:03.540618] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-30T17:00:03.540695] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-30T17:00:03.540749] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-30T17:00:03.568879] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-30T17:00:03.596279] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-30T17:00:03.596400] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-30T17:00:03.596439] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-30T17:00:03.596469] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-30T17:00:03.596528] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-30T17:00:03.596913] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-30T17:00:03.596967] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-30T17:00:03.597001] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-30T17:00:03.597029] [INFO ] [MAIN ] Running in parallel mode [2025-09-30T17:00:03.597221] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-30T17:00:04.284324] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:04.380926] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-09-30T17:00:04.380775] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:04.414237] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:04.421797] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-09-30T17:00:04.440970] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-30T17:00:04.421707] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-09-30T17:00:04.445274] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-30T17:00:04.444928] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:04.445132] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-09-30T17:00:04.445370] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-30T17:00:04.445711] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-30T17:00:04.445952] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-30T17:00:04.446477] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-30T17:00:04.446624] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-30T17:00:04.446325] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-09-30T17:00:04.446897] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-30T17:00:04.446198] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-30T17:00:04.447000] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-30T17:00:04.447059] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-30T17:00:04.447152] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-30T17:00:04.447335] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-30T17:00:04.465837] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-30T17:00:04.465975] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-30T17:00:04.473987] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-30T17:00:04.474140] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-30T17:00:04.541263] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-30T17:00:04.560917] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-30T17:00:05.825744] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:05.854219] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-30T17:00:05.860868] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:05.898701] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-30T17:00:06.000036] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:06.011696] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-30T17:00:06.090484] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:06.090829] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-30T17:00:06.320571] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:00:06.320928] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-30T17:00:06.321013] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:00:06.321073] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-09-30T17:00:06.321134] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:00:06.321213] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-30T17:00:06.321284] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-30T17:00:06.321327] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-30T17:00:06.321368] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-30T17:00:06.321416] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAMI took 2.7s. Estimated remaining: 1h 47m 37s. Rate: 22.0 symbols/min [2025-09-30T17:00:06.439530] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-30T17:00:06.451242] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-30T17:00:06.522855] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:06.523103] [DEBUG] [LOCAL ] AAP: No existing data file found in primary storage. [2025-09-30T17:00:06.523165] [WARN ] [MAIN ] AAP: No existing data found, performing full refresh instead. [2025-09-30T17:00:06.523253] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-30T17:00:06.523294] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-30T17:00:06.523336] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-30T17:00:06.523369] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-30T17:00:06.834760] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-30T17:00:06.850618] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-30T17:00:06.940310] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:06.940635] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-30T17:00:07.238862] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-30T17:00:07.239991] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-30T17:00:07.587533] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T17:00:07.589113] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-30T17:00:07.804485] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T17:00:07.815273] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-30T17:00:07.942402] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-30T17:00:07.943710] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-30T17:00:08.008047] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-30T17:00:08.019010] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-30T17:00:08.280329] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-30T17:00:08.281213] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-30T17:00:08.859238] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T17:00:08.860567] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-30T17:00:08.954243] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T17:00:08.967481] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-30T17:00:09.225320] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-30T17:00:09.226245] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-30T17:00:09.662612] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T17:00:09.663741] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-30T17:00:09.869858] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T17:00:09.881078] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-30T17:00:10.102077] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-30T17:00:10.102967] [INFO ] [REMOTE ] AAM: Full fetch complete (956 records). [2025-09-30T17:00:10.103047] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-30T17:00:10.309377] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-30T17:00:10.309542] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:00:10.309674] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:00:10.309752] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-30T17:00:10.309818] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-30T17:00:10.309863] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-30T17:00:10.309907] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-30T17:00:10.309979] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAM took 6.7s. Estimated remaining: 2h 12m 31s. Rate: 17.9 symbols/min [2025-09-30T17:00:10.501048] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:10.554770] [DEBUG] [LOCAL ] AAT: Loaded 30539 existing records from primary storage. [2025-09-30T17:00:10.555049] [INFO ] [MAIN ] AAT: Loaded 30539 existing records. [2025-09-30T17:00:10.754611] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:10.754998] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-30T17:00:10.755063] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-30T17:00:10.756411] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-30T17:00:10.756475] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-30T17:00:10.909904] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-30T17:00:10.957055] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-30T17:00:11.183720] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:11.184142] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-30T17:00:11.634217] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (3.82 seconds). [2025-09-30T17:00:11.644761] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-30T17:00:12.400117] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T17:00:12.406772] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-30T17:00:12.445013] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T17:00:12.456306] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-30T17:00:13.316868] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (3.44 seconds). [2025-09-30T17:00:13.329793] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-30T17:00:13.427745] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T17:00:13.438413] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-30T17:00:13.609345] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T17:00:13.615150] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-30T17:00:14.127840] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:00:14.140053] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-30T17:00:15.316856] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T17:00:15.328069] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-30T17:00:15.715948] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-30T17:00:15.727788] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-30T17:00:16.555021] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-09-30T17:00:16.561301] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-30T17:00:17.438613] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-09-30T17:00:17.450880] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-30T17:00:17.848232] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T17:00:17.855307] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-30T17:00:18.336398] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-30T17:00:18.353173] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-30T17:00:18.961783] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (3.63 seconds). [2025-09-30T17:00:18.973077] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-30T17:00:19.302196] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T17:00:19.310267] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-30T17:00:19.350549] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T17:00:19.364185] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-30T17:00:20.306307] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T17:00:20.318899] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-30T17:00:20.363028] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T17:00:20.370255] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-30T17:00:21.747853] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:00:21.756242] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-30T17:00:22.456624] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (3.09 seconds). [2025-09-30T17:00:22.468128] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-30T17:00:22.741621] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (3.77 seconds). [2025-09-30T17:00:22.753157] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-30T17:00:23.188605] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T17:00:23.196147] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-30T17:00:23.995365] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (3.68 seconds). [2025-09-30T17:00:24.008815] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-30T17:00:24.478490] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T17:00:24.485992] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-30T17:00:24.747335] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-30T17:00:24.759715] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-30T17:00:25.208318] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-30T17:00:25.220442] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-30T17:00:25.615718] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T17:00:25.622111] [INFO ] [REMOTE ] AAT: Full fetch complete (42443 records). [2025-09-30T17:00:25.622237] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-30T17:00:25.623018] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:00:25.623130] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:00:25.623176] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:00:25.623219] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-30T17:00:25.623278] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-09-30T17:00:25.623321] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-09-30T17:00:25.623855] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-09-30T17:00:25.624484] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAT took 15.3s. Estimated remaining: 4h 49m 47s. Rate: 8.2 symbols/min [2025-09-30T17:00:25.828567] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:25.828823] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-30T17:00:25.829108] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-30T17:00:25.829247] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-30T17:00:25.829502] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-30T17:00:25.829596] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-30T17:00:25.829686] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-30T17:00:26.261791] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-30T17:00:26.326091] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:26.326979] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-30T17:00:26.329380] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-30T17:00:26.433135] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T17:00:26.447889] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-30T17:00:26.524633] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:00:26.524980] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-30T17:00:26.525082] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:00:26.525187] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-09-30T17:00:26.525276] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:00:26.525374] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-30T17:00:26.525459] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-30T17:00:26.525498] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-30T17:00:26.525539] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-30T17:00:26.525587] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAUC took 0.9s. Estimated remaining: 3h 46m 8s. Rate: 10.5 symbols/min [2025-09-30T17:00:26.725775] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:26.759028] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T17:00:26.775409] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-30T17:00:26.802959] [DEBUG] [LOCAL ] AB: Loaded 27747 existing records from primary storage. [2025-09-30T17:00:26.803252] [INFO ] [MAIN ] AB: Loaded 27747 existing records. [2025-09-30T17:00:27.020229] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:27.020529] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-30T17:00:27.020608] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-30T17:00:27.021905] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-30T17:00:27.021986] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-30T17:00:27.438239] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:27.438726] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-30T17:00:27.861308] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T17:00:27.873823] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-30T17:00:28.398851] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:00:28.412712] [INFO ] [REMOTE ] AAP: Full fetch complete (75049 records). [2025-09-30T17:00:28.412901] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-30T17:00:28.883240] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-30T17:00:28.883508] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-30T17:00:28.884508] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-30T17:00:28.884858] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-30T17:00:28.915960] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-30T17:00:28.927891] [DEBUG] [LOCAL ] AAP: Trimmed 75049 records to 51971 (keeping 200 days of data) [2025-09-30T17:00:28.931951] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-30T17:00:29.070489] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:00:29.082520] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-30T17:00:29.303373] [DEBUG] [LOCAL ] AAP: Primary data saved (51971 records). [2025-09-30T17:00:29.303528] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-30T17:00:29.303995] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAP took 23.0s. Estimated remaining: 3h 22m 45s. Rate: 11.7 symbols/min [2025-09-30T17:00:29.506195] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:29.573496] [DEBUG] [LOCAL ] ABBV: Loaded 53684 existing records from primary storage. [2025-09-30T17:00:29.573891] [INFO ] [MAIN ] ABBV: Loaded 53684 existing records. [2025-09-30T17:00:29.807130] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:29.812495] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-30T17:00:29.825786] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-30T17:00:29.827620] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-30T17:00:29.827752] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-30T17:00:29.827547] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:00:29.916870] [INFO ] [REMOTE ] AA: Full fetch complete (77148 records). [2025-09-30T17:00:29.923931] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-30T17:00:29.943740] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:00:29.956241] [FATAL] [MAIN ] AA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:00:29.962139] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:00:29.967391] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-30T17:00:29.972670] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-09-30T17:00:29.977880] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-09-30T17:00:29.983136] [DEBUG] [LOCAL ] AA: No derivative data file found to delete. [2025-09-30T17:00:29.988396] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AA took 26.4s. Estimated remaining: 2h 53m 23s. Rate: 13.6 symbols/min [2025-09-30T17:00:30.403535] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:30.480460] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:30.482135] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-30T17:00:30.524307] [DEBUG] [LOCAL ] ABCB: Loaded 30510 existing records from primary storage. [2025-09-30T17:00:30.524738] [INFO ] [MAIN ] ABCB: Loaded 30510 existing records. [2025-09-30T17:00:30.728039] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T17:00:30.757367] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-30T17:00:30.781852] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:30.783386] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-30T17:00:30.783454] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-30T17:00:30.784189] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-30T17:00:30.784252] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-30T17:00:30.948465] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T17:00:30.996427] [INFO ] [REMOTE ] A: Full fetch complete (73063 records). [2025-09-30T17:00:31.014697] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-30T17:00:31.432496] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:31.455276] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-30T17:00:31.706763] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-30T17:00:31.706883] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-30T17:00:31.707832] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-30T17:00:31.707984] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-30T17:00:31.709815] [DEBUG] [LOCAL ] A: Trimmed 73063 records to 50719 (keeping 200 days of data) [2025-09-30T17:00:32.069708] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T17:00:32.083229] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-30T17:00:32.093338] [DEBUG] [LOCAL ] A: Primary data saved (50719 records). [2025-09-30T17:00:32.093502] [INFO ] [MAIN ] A: Full history saved. [2025-09-30T17:00:32.094261] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. A took 28.5s. Estimated remaining: 2h 40m 24s. Rate: 14.7 symbols/min [2025-09-30T17:00:32.331263] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:32.430177] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T17:00:32.442809] [DEBUG] [LOCAL ] ABEV: Loaded 53278 existing records from primary storage. [2025-09-30T17:00:32.443838] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-30T17:00:32.444322] [INFO ] [MAIN ] ABEV: Loaded 53278 existing records. [2025-09-30T17:00:32.660202] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:32.660565] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-30T17:00:32.660773] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-30T17:00:32.661081] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-30T17:00:32.661142] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-30T17:00:32.971838] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T17:00:32.997178] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-30T17:00:33.090072] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:33.090514] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-30T17:00:33.710783] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T17:00:33.722444] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-30T17:00:34.156906] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:00:34.186409] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T17:00:34.193413] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-30T17:00:34.194963] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-30T17:00:34.806211] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:00:34.815455] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-30T17:00:35.172565] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:00:35.179883] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-30T17:00:35.264775] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-30T17:00:35.279029] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-30T17:00:35.976946] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T17:00:35.984049] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-30T17:00:36.192937] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T17:00:36.200330] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-30T17:00:36.316363] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-30T17:00:36.326510] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-30T17:00:36.756709] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T17:00:36.762912] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-30T17:00:37.107466] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T17:00:37.118680] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-30T17:00:37.427729] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T17:00:37.440274] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-30T17:00:38.065407] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T17:00:38.074162] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-30T17:00:38.200129] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T17:00:38.212575] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-30T17:00:38.442111] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T17:00:38.453570] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-30T17:00:38.567149] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T17:00:38.573985] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-30T17:00:39.293887] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T17:00:39.299490] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-30T17:00:39.489085] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T17:00:39.495573] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-30T17:00:40.239754] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T17:00:40.252683] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-30T17:00:40.274726] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T17:00:40.280489] [INFO ] [REMOTE ] AB: Full fetch complete (45627 records). [2025-09-30T17:00:40.280678] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-30T17:00:40.637410] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-30T17:00:40.740602] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-30T17:00:40.800485] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-30T17:00:40.800623] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-30T17:00:40.801203] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-30T17:00:40.801288] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-30T17:00:40.825529] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T17:00:40.825751] [DEBUG] [LOCAL ] AB: Trimmed 45627 records to 27540 (keeping 200 days of data) [2025-09-30T17:00:40.834863] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-30T17:00:41.041764] [DEBUG] [LOCAL ] AB: Primary data saved (27540 records). [2025-09-30T17:00:41.041919] [INFO ] [MAIN ] AB: Full history saved. [2025-09-30T17:00:41.042027] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 14.5s. Estimated remaining: 3h 4m 20s. Rate: 12.8 symbols/min [2025-09-30T17:00:41.229338] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:41.229499] [DEBUG] [LOCAL ] ABG: No existing data file found in primary storage. [2025-09-30T17:00:41.229541] [WARN ] [MAIN ] ABG: No existing data found, performing full refresh instead. [2025-09-30T17:00:41.229705] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-30T17:00:41.229763] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-30T17:00:41.229809] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-09-30T17:00:41.229845] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-30T17:00:41.664637] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:41.665170] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-30T17:00:42.250417] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T17:00:42.258159] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-30T17:00:42.360396] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T17:00:42.372275] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-30T17:00:42.471568] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-30T17:00:42.484947] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-30T17:00:42.878679] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:00:42.882008] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-30T17:00:43.765497] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T17:00:43.772199] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-30T17:00:43.964273] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T17:00:43.971893] [INFO ] [REMOTE ] ABCB: Full fetch complete (44464 records). [2025-09-30T17:00:43.972119] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-30T17:00:44.389285] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-30T17:00:44.456268] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-30T17:00:44.469421] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-30T17:00:44.469777] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-30T17:00:44.470479] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-30T17:00:44.470617] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-30T17:00:44.472329] [DEBUG] [LOCAL ] ABCB: Trimmed 44464 records to 30473 (keeping 200 days of data) [2025-09-30T17:00:44.667752] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-30T17:00:44.680543] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-30T17:00:44.782759] [DEBUG] [LOCAL ] ABCB: Primary data saved (30473 records). [2025-09-30T17:00:44.782916] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-30T17:00:44.783081] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 14.8s. Estimated remaining: 3h 0m 9s. Rate: 13.1 symbols/min [2025-09-30T17:00:44.916469] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T17:00:44.941946] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-30T17:00:44.996264] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:45.041147] [DEBUG] [LOCAL ] ABM: Loaded 32159 existing records from primary storage. [2025-09-30T17:00:45.041486] [INFO ] [MAIN ] ABM: Loaded 32159 existing records. [2025-09-30T17:00:45.272547] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:45.272808] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-30T17:00:45.272860] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-30T17:00:45.273202] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-30T17:00:45.273288] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-30T17:00:45.697772] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:45.698118] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-30T17:00:46.039014] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T17:00:46.044505] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-30T17:00:46.596984] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-30T17:00:46.612480] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-30T17:00:46.859271] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T17:00:46.880710] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-30T17:00:47.046943] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T17:00:47.058484] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-30T17:00:47.088181] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T17:00:47.098032] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-30T17:00:47.744021] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T17:00:47.747799] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-30T17:00:48.187698] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T17:00:48.194919] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-30T17:00:48.232038] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T17:00:48.246243] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-30T17:00:48.619968] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T17:00:48.632099] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-30T17:00:48.761226] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T17:00:48.765279] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-30T17:00:49.087260] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T17:00:49.093914] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-30T17:00:49.832294] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:00:49.845639] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-30T17:00:49.974426] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T17:00:49.979380] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-30T17:00:50.252059] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T17:00:50.260849] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-30T17:00:50.769257] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-30T17:00:50.780851] [INFO ] [REMOTE ] ABBV: Full fetch complete (77330 records). [2025-09-30T17:00:50.781063] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-30T17:00:50.786147] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:00:50.786276] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:00:50.786320] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:00:50.786386] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-30T17:00:50.786508] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-09-30T17:00:50.786585] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-09-30T17:00:50.787082] [DEBUG] [LOCAL ] ABBV: Deleted derivative data file. [2025-09-30T17:00:50.787278] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABBV took 21.5s. Estimated remaining: 3h 5m 42s. Rate: 12.7 symbols/min [2025-09-30T17:00:50.991964] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:51.056386] [DEBUG] [LOCAL ] ABR: Loaded 52026 existing records from primary storage. [2025-09-30T17:00:51.056813] [INFO ] [MAIN ] ABR: Loaded 52026 existing records. [2025-09-30T17:00:51.219026] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T17:00:51.276131] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-30T17:00:51.295573] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:51.296431] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-30T17:00:51.296604] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-30T17:00:51.297478] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-30T17:00:51.297558] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-30T17:00:51.739317] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T17:00:51.786967] [INFO ] [REMOTE ] ABEV: Full fetch complete (77208 records). [2025-09-30T17:00:51.787402] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-30T17:00:51.986059] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:51.977533] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T17:00:52.013801] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-30T17:00:52.045155] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-30T17:00:52.368102] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-30T17:00:52.368276] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-30T17:00:52.379022] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-30T17:00:52.379165] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-30T17:00:52.380635] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T17:00:52.384776] [INFO ] [REMOTE ] ABG: Full fetch complete (26470 records). [2025-09-30T17:00:52.385002] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-30T17:00:52.385246] [DEBUG] [LOCAL ] ABEV: Trimmed 77208 records to 53278 (keeping 200 days of data) [2025-09-30T17:00:52.910745] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-30T17:00:52.911067] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-30T17:00:52.911412] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-30T17:00:52.911781] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-30T17:00:52.914341] [DEBUG] [LOCAL ] ABG: Trimmed 26470 records to 18677 (keeping 200 days of data) [2025-09-30T17:00:53.148702] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T17:00:53.162218] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-30T17:00:53.199949] [DEBUG] [LOCAL ] ABG: Primary data saved (18677 records). [2025-09-30T17:00:53.203685] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-30T17:00:53.205056] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABG took 12.2s. Estimated remaining: 2h 57m 23s. Rate: 13.3 symbols/min [2025-09-30T17:00:53.413133] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:53.515064] [DEBUG] [LOCAL ] ABEV: Primary data saved (53278 records). [2025-09-30T17:00:53.515265] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-30T17:00:53.517538] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABEV took 21.4s. Estimated remaining: 2h 43m 34s. Rate: 14.4 symbols/min [2025-09-30T17:00:53.753223] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-09-30T17:00:53.792097] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:00:53.793185] [INFO ] [MAIN ] ABT: Loaded 53620 existing records. [2025-09-30T17:00:53.979990] [DEBUG] [LOCAL ] ACA: Loaded 23441 existing records from primary storage. [2025-09-30T17:00:53.991247] [INFO ] [MAIN ] ACA: Loaded 23441 existing records. [2025-09-30T17:00:54.130389] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:54.142256] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-30T17:00:54.150351] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-30T17:00:54.187291] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-30T17:00:54.194959] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-30T17:00:54.284429] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-30T17:00:54.388845] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:00:54.401675] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-30T17:00:54.407095] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-30T17:00:54.421699] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-30T17:00:54.477117] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-30T17:00:54.477503] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-30T17:00:55.080775] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:55.086464] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-30T17:00:55.152197] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-30T17:00:55.214186] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-30T17:00:55.257679] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:00:55.258499] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-30T17:00:55.950817] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:00:55.961947] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-30T17:00:56.453731] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T17:00:56.458993] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-30T17:00:56.562002] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T17:00:56.571996] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-30T17:00:57.077547] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T17:00:57.088899] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-30T17:00:57.435901] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T17:00:57.441204] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-30T17:00:57.740022] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T17:00:57.750086] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-30T17:00:58.211984] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T17:00:58.217383] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-30T17:00:58.255423] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T17:00:58.264034] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-30T17:00:58.625762] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T17:00:58.637377] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-30T17:00:59.625136] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T17:00:59.633522] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-30T17:00:59.739072] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T17:00:59.750931] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-30T17:00:59.842440] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T17:00:59.850588] [INFO ] [REMOTE ] ABM: Full fetch complete (44700 records). [2025-09-30T17:00:59.850753] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-30T17:01:00.256570] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-30T17:01:00.256779] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-30T17:01:00.257353] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-30T17:01:00.257443] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-30T17:01:00.258890] [DEBUG] [LOCAL ] ABM: Trimmed 44700 records to 32024 (keeping 200 days of data) [2025-09-30T17:01:00.468284] [DEBUG] [LOCAL ] ABM: Primary data saved (32024 records). [2025-09-30T17:01:00.468498] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-30T17:01:00.468608] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 15.7s. Estimated remaining: 2h 51m 56s. Rate: 13.7 symbols/min [2025-09-30T17:01:00.603924] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T17:01:00.672600] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-30T17:01:00.695621] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:00.757620] [DEBUG] [LOCAL ] ACCO: Loaded 37516 existing records from primary storage. [2025-09-30T17:01:00.758031] [INFO ] [MAIN ] ACCO: Loaded 37516 existing records. [2025-09-30T17:01:00.957266] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T17:01:00.962912] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:00.963232] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-30T17:01:00.968756] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-30T17:01:00.969590] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-30T17:01:00.969555] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-30T17:01:00.969736] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-30T17:01:01.407447] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:01.407930] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-30T17:01:02.039155] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T17:01:02.051128] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-30T17:01:02.480763] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T17:01:02.487108] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-30T17:01:02.857895] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-30T17:01:02.870900] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-30T17:01:03.040137] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:01:03.048863] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-30T17:01:03.358747] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T17:01:03.365380] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-30T17:01:03.751474] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:01:03.763847] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-30T17:01:04.545602] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T17:01:04.557042] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-30T17:01:04.609940] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T17:01:04.622745] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-30T17:01:04.754950] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:01:04.762905] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-30T17:01:05.680003] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T17:01:05.707278] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-30T17:01:05.708495] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T17:01:05.715987] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-30T17:01:06.022356] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T17:01:06.031025] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-30T17:01:06.218571] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T17:01:06.230213] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-30T17:01:06.451537] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T17:01:06.456209] [INFO ] [REMOTE ] ACA: Full fetch complete (34265 records). [2025-09-30T17:01:06.456324] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-30T17:01:06.889968] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-30T17:01:06.890062] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-30T17:01:06.890452] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-30T17:01:06.890526] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-30T17:01:06.891448] [DEBUG] [LOCAL ] ACA: Trimmed 34265 records to 23379 (keeping 200 days of data) [2025-09-30T17:01:07.047853] [DEBUG] [LOCAL ] ACA: Primary data saved (23379 records). [2025-09-30T17:01:07.048008] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-30T17:01:07.048118] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ACA took 13.5s. Estimated remaining: 2h 58m 2s. Rate: 13.2 symbols/min [2025-09-30T17:01:07.252236] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:07.252492] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-09-30T17:01:07.252550] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-09-30T17:01:07.252738] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-30T17:01:07.252785] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-30T17:01:07.252834] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-30T17:01:07.252875] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-30T17:01:07.675584] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:07.676605] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-30T17:01:07.705449] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:01:07.716544] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-30T17:01:07.756096] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-30T17:01:07.769220] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-30T17:01:08.255379] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T17:01:08.266922] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-30T17:01:08.856999] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T17:01:08.866464] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-30T17:01:08.956547] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T17:01:08.962813] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-30T17:01:09.621807] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T17:01:09.633802] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-30T17:01:09.777523] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T17:01:09.783070] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-30T17:01:10.086536] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:01:10.099365] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-30T17:01:10.576107] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T17:01:10.585910] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-30T17:01:10.987547] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T17:01:10.994074] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-30T17:01:11.275853] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T17:01:11.288013] [INFO ] [REMOTE ] ABR: Full fetch complete (75191 records). [2025-09-30T17:01:11.288199] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-30T17:01:11.735750] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-30T17:01:11.736222] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-30T17:01:11.737154] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-30T17:01:11.737389] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-30T17:01:11.739212] [DEBUG] [LOCAL ] ABR: Trimmed 75191 records to 52005 (keeping 200 days of data) [2025-09-30T17:01:11.868090] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T17:01:11.880412] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-30T17:01:12.144829] [DEBUG] [LOCAL ] ABR: Primary data saved (52005 records). [2025-09-30T17:01:12.145261] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-30T17:01:12.147794] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABR took 21.4s. Estimated remaining: 2h 59m 27s. Rate: 13.1 symbols/min [2025-09-30T17:01:12.300910] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T17:01:12.390841] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:12.391447] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-30T17:01:12.428557] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-30T17:01:12.442498] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-30T17:01:12.500303] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-09-30T17:01:12.500738] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-09-30T17:01:12.710766] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:12.710987] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-30T17:01:12.711034] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-30T17:01:12.711908] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-30T17:01:12.712150] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-30T17:01:13.111568] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:13.112001] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-30T17:01:13.498507] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T17:01:13.506927] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-30T17:01:13.913949] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T17:01:13.922212] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-30T17:01:14.452957] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-30T17:01:14.464992] [INFO ] [REMOTE ] ABT: Full fetch complete (77592 records). [2025-09-30T17:01:14.465150] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-30T17:01:14.904082] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-30T17:01:14.904336] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-30T17:01:14.905348] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-30T17:01:14.905685] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-30T17:01:14.932412] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T17:01:14.940556] [DEBUG] [LOCAL ] ABT: Trimmed 77592 records to 53620 (keeping 200 days of data) [2025-09-30T17:01:14.942372] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-30T17:01:15.216096] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T17:01:15.223929] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-30T17:01:15.332761] [DEBUG] [LOCAL ] ABT: Primary data saved (53620 records). [2025-09-30T17:01:15.332949] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-30T17:01:15.335048] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ABT took 22.1s. Estimated remaining: 2h 55m 59s. Rate: 13.4 symbols/min [2025-09-30T17:01:15.568720] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:15.634060] [DEBUG] [LOCAL ] ACI: Loaded 53256 existing records from primary storage. [2025-09-30T17:01:15.634490] [INFO ] [MAIN ] ACI: Loaded 53256 existing records. [2025-09-30T17:01:15.838112] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:15.838462] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-30T17:01:15.838666] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-30T17:01:15.839282] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-30T17:01:15.839404] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-30T17:01:15.999666] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-30T17:01:16.037490] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-30T17:01:16.272637] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T17:01:16.352190] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:16.353546] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-30T17:01:16.352882] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-30T17:01:16.378974] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T17:01:16.387542] [INFO ] [REMOTE ] ACCO: Full fetch complete (54119 records). [2025-09-30T17:01:16.387777] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-30T17:01:16.844962] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-30T17:01:16.845065] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-30T17:01:16.845629] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-30T17:01:16.845725] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-30T17:01:16.847467] [DEBUG] [LOCAL ] ACCO: Trimmed 54119 records to 37420 (keeping 200 days of data) [2025-09-30T17:01:17.083259] [DEBUG] [LOCAL ] ACCO: Primary data saved (37420 records). [2025-09-30T17:01:17.083425] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-30T17:01:17.083515] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 16.6s. Estimated remaining: 2h 49m 36s. Rate: 13.9 symbols/min [2025-09-30T17:01:17.270395] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:17.323270] [DEBUG] [LOCAL ] ACM: Loaded 43033 existing records from primary storage. [2025-09-30T17:01:17.323741] [INFO ] [MAIN ] ACM: Loaded 43033 existing records. [2025-09-30T17:01:17.541263] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:17.541511] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-30T17:01:17.541563] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-30T17:01:17.541987] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-30T17:01:17.542054] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-30T17:01:17.687523] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T17:01:17.732835] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-30T17:01:18.002683] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:18.003171] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-30T17:01:18.041661] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T17:01:18.654369] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-30T17:01:18.705511] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-30T17:01:18.826125] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:01:19.454335] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-30T17:01:19.557862] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T17:01:20.254368] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-30T17:01:20.345118] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T17:01:21.054393] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-30T17:01:21.535754] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T17:01:21.541284] [INFO ] [REMOTE ] ACEL: Full fetch complete (38722 records). [2025-09-30T17:01:21.541388] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-30T17:01:21.859068] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-30T17:01:22.003393] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-30T17:01:22.003502] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-30T17:01:22.004064] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-30T17:01:22.004199] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-30T17:01:22.037229] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-09-30T17:01:22.048169] [DEBUG] [LOCAL ] ACEL: Trimmed 38722 records to 26829 (keeping 200 days of data) [2025-09-30T17:01:22.230326] [DEBUG] [LOCAL ] ACEL: Primary data saved (26829 records). [2025-09-30T17:01:22.230476] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-30T17:01:22.230554] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 15.2s. Estimated remaining: 2h 51m 19s. Rate: 13.7 symbols/min [2025-09-30T17:01:22.411730] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:22.471872] [DEBUG] [LOCAL ] ACN: Loaded 53425 existing records from primary storage. [2025-09-30T17:01:22.472228] [INFO ] [MAIN ] ACN: Loaded 53425 existing records. [2025-09-30T17:01:22.662989] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-30T17:01:22.669474] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:22.670898] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-30T17:01:22.671055] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-30T17:01:22.671713] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-30T17:01:22.671777] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-30T17:01:23.090936] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-30T17:01:23.127067] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:23.239051] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:01:23.454371] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-30T17:01:24.254397] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-30T17:01:25.054373] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-30T17:01:25.356077] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-30T17:01:25.503497] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-30T17:01:25.566047] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T17:01:25.854590] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-30T17:01:26.654377] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-30T17:01:26.802765] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T17:01:27.308715] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T17:01:27.454396] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-30T17:01:28.254606] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-30T17:01:29.054393] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-30T17:01:29.387942] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-30T17:01:29.432769] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T17:01:29.854383] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-30T17:01:30.250868] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T17:01:30.654360] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-30T17:01:31.189982] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T17:01:31.414582] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T17:01:31.454373] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-30T17:01:32.181036] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T17:01:32.254382] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-30T17:01:33.054390] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-30T17:01:33.825394] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T17:01:33.854315] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-30T17:01:33.931043] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-30T17:01:34.630117] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T17:01:34.654313] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-30T17:01:35.454376] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-30T17:01:35.542446] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T17:01:36.254375] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-30T17:01:36.445663] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T17:01:37.054365] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-30T17:01:37.391441] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T17:01:37.833185] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:01:37.854333] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-30T17:01:38.654423] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-30T17:01:39.454440] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-30T17:01:39.553096] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T17:01:39.677886] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-30T17:01:40.221921] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T17:01:40.254414] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-30T17:01:41.054436] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-30T17:01:41.439711] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T17:01:41.854364] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-30T17:01:42.472875] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T17:01:42.483429] [INFO ] [REMOTE ] ACM: Full fetch complete (62741 records). [2025-09-30T17:01:42.483671] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-30T17:01:42.659466] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-30T17:01:42.949845] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-30T17:01:42.949957] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-30T17:01:42.950636] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-30T17:01:42.950727] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-30T17:01:42.952114] [DEBUG] [LOCAL ] ACM: Trimmed 62741 records to 42987 (keeping 200 days of data) [2025-09-30T17:01:43.252962] [DEBUG] [LOCAL ] ACM: Primary data saved (42987 records). [2025-09-30T17:01:43.253155] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-30T17:01:43.255295] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACM took 26.2s. Estimated remaining: 3h 25m 37s. Rate: 11.4 symbols/min [2025-09-30T17:01:43.446412] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:43.446587] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-09-30T17:01:43.446628] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-09-30T17:01:43.446956] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-30T17:01:43.446998] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-30T17:01:43.447040] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-09-30T17:01:43.447072] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-30T17:01:43.878229] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:43.878909] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-30T17:01:43.928875] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-30T17:01:43.985072] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-30T17:01:44.254374] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-30T17:01:44.587416] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T17:01:44.599480] [INFO ] [REMOTE ] ACI: Full fetch complete (76668 records). [2025-09-30T17:01:44.599747] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-30T17:01:44.600854] [FATAL] [VALIDATOR ] ACI: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:01:44.600954] [FATAL] [MAIN ] ACI: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:01:44.601000] [WARN ] [MAIN ] ACI: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:01:44.601077] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-30T17:01:44.601161] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-09-30T17:01:44.601210] [INFO ] [LOCAL ] ACI: Starting deletion of derivative data. [2025-09-30T17:01:44.601500] [DEBUG] [LOCAL ] ACI: Deleted derivative data file. [2025-09-30T17:01:44.601605] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACI took 29.3s. Estimated remaining: 3h 17m 53s. Rate: 11.9 symbols/min [2025-09-30T17:01:44.801607] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:44.810127] [DEBUG] [LOCAL ] ACR: Loaded 6054 existing records from primary storage. [2025-09-30T17:01:44.810363] [INFO ] [MAIN ] ACR: Loaded 6054 existing records. [2025-09-30T17:01:45.022030] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:45.022277] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-30T17:01:45.022333] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-30T17:01:45.022551] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-30T17:01:45.022631] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-30T17:01:45.059533] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-30T17:01:45.440889] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:45.591531] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T17:01:45.854407] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-30T17:01:46.643393] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-30T17:01:46.654334] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-30T17:01:47.073345] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-30T17:01:47.092020] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-09-30T17:01:47.167055] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-30T17:01:47.454423] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-30T17:01:48.099450] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-30T17:01:48.254368] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-30T17:01:49.054382] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-30T17:01:49.854405] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-30T17:01:50.628094] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T17:01:50.654347] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-30T17:01:51.269168] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-09-30T17:01:51.298961] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-30T17:01:51.299273] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-30T17:01:51.311442] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-30T17:01:51.447717] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T17:01:51.455423] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-30T17:01:51.787226] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-30T17:01:51.787334] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-30T17:01:51.788188] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-30T17:01:51.788315] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-30T17:01:51.790011] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-09-30T17:01:52.134382] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-09-30T17:01:52.134547] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-30T17:01:52.134678] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 40.0s. Estimated remaining: 3h 22m 26s. Rate: 11.6 symbols/min [2025-09-30T17:01:52.256845] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-30T17:01:52.293178] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T17:01:52.353934] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:52.388815] [DEBUG] [LOCAL ] ACRE: Loaded 33528 existing records from primary storage. [2025-09-30T17:01:52.389192] [INFO ] [MAIN ] ACRE: Loaded 33528 existing records. [2025-09-30T17:01:52.636701] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:52.636989] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-30T17:01:52.637073] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-30T17:01:52.637421] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-30T17:01:52.637503] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-30T17:01:53.028762] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:53.054371] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-30T17:01:53.854390] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-30T17:01:54.265372] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T17:01:54.303220] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T17:01:54.645432] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T17:01:54.654303] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-30T17:01:55.454409] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-30T17:01:55.733201] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T17:01:56.254372] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-30T17:01:57.043879] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T17:01:57.054344] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-30T17:01:57.407311] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:01:57.420190] [INFO ] [REMOTE ] ACN: Full fetch complete (77116 records). [2025-09-30T17:01:57.420365] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-30T17:01:57.732186] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T17:01:57.855271] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-30T17:01:57.874967] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-30T17:01:57.875999] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-30T17:01:57.876863] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-30T17:01:57.876975] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-30T17:01:57.879025] [DEBUG] [LOCAL ] ACN: Trimmed 77116 records to 53425 (keeping 200 days of data) [2025-09-30T17:01:58.268716] [DEBUG] [LOCAL ] ACN: Primary data saved (53425 records). [2025-09-30T17:01:58.268874] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-30T17:01:58.270571] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 36.0s. Estimated remaining: 3h 24m 4s. Rate: 11.5 symbols/min [2025-09-30T17:01:58.494679] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:58.506581] [DEBUG] [LOCAL ] ACV: Loaded 7105 existing records from primary storage. [2025-09-30T17:01:58.506861] [INFO ] [MAIN ] ACV: Loaded 7105 existing records. [2025-09-30T17:01:58.573122] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-30T17:01:58.609127] [INFO ] [REMOTE ] ACR: Full fetch complete (8546 records). [2025-09-30T17:01:58.630043] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-30T17:01:58.650231] [FATAL] [VALIDATOR ] ACR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:01:58.650500] [FATAL] [MAIN ] ACR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:01:58.656473] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-30T17:01:58.656605] [WARN ] [MAIN ] ACR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:01:58.673007] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-30T17:01:58.697857] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-09-30T17:01:58.754881] [INFO ] [LOCAL ] ACR: Starting deletion of derivative data. [2025-09-30T17:01:58.754252] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:58.755552] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-30T17:01:58.755627] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-30T17:01:58.755718] [DEBUG] [LOCAL ] ACR: Deleted derivative data file. [2025-09-30T17:01:58.755905] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACR took 14.2s. Estimated remaining: 3h 15m 56s. Rate: 12.0 symbols/min [2025-09-30T17:01:58.761671] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-30T17:01:58.807741] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-30T17:01:59.207639] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:01:59.421944] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:01:59.456868] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-30T17:01:59.459160] [DEBUG] [LOCAL ] ACVA: Loaded 49259 existing records from primary storage. [2025-09-30T17:01:59.459633] [INFO ] [MAIN ] ACVA: Loaded 49259 existing records. [2025-09-30T17:01:59.701943] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:01:59.702363] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-30T17:01:59.702426] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-30T17:01:59.702874] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-30T17:01:59.702936] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-30T17:02:00.146160] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:00.233706] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T17:02:00.254340] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-30T17:02:00.773038] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T17:02:00.922853] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-30T17:02:01.054420] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-30T17:02:01.667916] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T17:02:01.854373] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-30T17:02:02.654448] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-30T17:02:03.124613] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T17:02:03.287531] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T17:02:03.454375] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-30T17:02:04.206895] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T17:02:04.254418] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-30T17:02:05.054396] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-30T17:02:05.889945] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-30T17:02:05.907484] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:02:05.926680] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T17:02:06.654357] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-30T17:02:07.459479] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-30T17:02:07.477327] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T17:02:07.668963] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T17:02:08.254927] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-30T17:02:08.256212] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T17:02:09.054390] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-30T17:02:09.511824] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T17:02:09.854379] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-30T17:02:10.451221] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T17:02:10.522377] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T17:02:10.654391] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-30T17:02:11.454410] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-30T17:02:11.896117] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T17:02:12.254422] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-30T17:02:12.899419] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T17:02:13.054363] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-30T17:02:13.589686] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T17:02:13.603847] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T17:02:13.854394] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-30T17:02:14.654366] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-30T17:02:15.217755] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-30T17:02:15.454386] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-30T17:02:15.928521] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T17:02:16.254397] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-30T17:02:16.979946] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T17:02:16.987217] [INFO ] [REMOTE ] ACRE: Full fetch complete (50677 records). [2025-09-30T17:02:16.987323] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-30T17:02:17.060096] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-30T17:02:17.445118] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-30T17:02:17.445239] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-30T17:02:17.445830] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-30T17:02:17.445900] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-30T17:02:17.447164] [DEBUG] [LOCAL ] ACRE: Trimmed 50677 records to 33553 (keeping 200 days of data) [2025-09-30T17:02:17.668690] [DEBUG] [LOCAL ] ACRE: Primary data saved (33553 records). [2025-09-30T17:02:17.668972] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-30T17:02:17.669406] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACRE took 25.5s. Estimated remaining: 3h 38m 31s. Rate: 10.7 symbols/min [2025-09-30T17:02:17.809531] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:02:17.860754] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-30T17:02:17.885437] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:02:17.887487] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-30T17:02:17.887595] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-30T17:02:17.887786] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-30T17:02:17.887858] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-30T17:02:17.887936] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-30T17:02:17.888008] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-30T17:02:18.282635] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:18.314543] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T17:02:18.654373] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-30T17:02:18.844482] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T17:02:18.847782] [INFO ] [REMOTE ] ACV: Full fetch complete (9918 records). [2025-09-30T17:02:18.847889] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-30T17:02:18.876588] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:02:18.920215] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-30T17:02:18.942485] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:02:18.954922] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-09-30T17:02:18.969969] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:02:18.973341] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-30T17:02:18.973448] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-30T17:02:18.973516] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-30T17:02:18.973964] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-30T17:02:18.979498] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. AD took 1.3s. Estimated remaining: 3h 31m 44s. Rate: 11.1 symbols/min [2025-09-30T17:02:19.411215] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:02:19.457344] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-30T17:02:19.492338] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-30T17:02:19.492504] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-30T17:02:19.492797] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-30T17:02:19.492978] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-30T17:02:19.493848] [DEBUG] [LOCAL ] ACV: Trimmed 9918 records to 7194 (keeping 200 days of data) [2025-09-30T17:02:19.568681] [DEBUG] [LOCAL ] ACV: Primary data saved (7194 records). [2025-09-30T17:02:19.568977] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-30T17:02:19.569107] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACV took 21.3s. Estimated remaining: 3h 24m 24s. Rate: 11.5 symbols/min [2025-09-30T17:02:19.734612] [DEBUG] [LOCAL ] ADC: Loaded 46182 existing records from primary storage. [2025-09-30T17:02:19.759091] [INFO ] [MAIN ] ADC: Loaded 46182 existing records. [2025-09-30T17:02:19.840757] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:02:20.012334] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:02:20.012668] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-30T17:02:20.012735] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-30T17:02:20.013099] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-30T17:02:20.013164] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-30T17:02:20.190460] [DEBUG] [LOCAL ] ADCT: Loaded 34320 existing records from primary storage. [2025-09-30T17:02:20.216061] [INFO ] [MAIN ] ADCT: Loaded 34320 existing records. [2025-09-30T17:02:20.255248] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-30T17:02:20.708581] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:20.715409] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:02:20.716015] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-30T17:02:20.716414] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-30T17:02:20.716990] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-30T17:02:20.717069] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-30T17:02:21.054867] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-30T17:02:21.156589] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:21.183391] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:02:21.854333] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-30T17:02:22.215674] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T17:02:22.654380] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-30T17:02:22.771508] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T17:02:23.331867] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:02:23.454366] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-30T17:02:23.745391] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T17:02:24.254413] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-30T17:02:24.571156] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T17:02:25.054368] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-30T17:02:25.552281] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:02:25.854377] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-30T17:02:26.654376] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-30T17:02:26.824385] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T17:02:27.233743] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:02:27.454364] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-30T17:02:28.141305] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:02:28.254413] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-30T17:02:28.720367] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T17:02:29.054377] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-30T17:02:29.854340] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-30T17:02:29.885132] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T17:02:30.376117] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T17:02:30.654373] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-30T17:02:31.094496] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T17:02:31.454360] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-30T17:02:32.037865] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T17:02:32.254366] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-30T17:02:33.054373] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-30T17:02:33.164719] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T17:02:33.612005] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T17:02:33.854424] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-30T17:02:34.447151] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T17:02:34.455567] [INFO ] [REMOTE ] ACP: Full fetch complete (47495 records). [2025-09-30T17:02:34.455779] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-30T17:02:34.654762] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-30T17:02:34.905030] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-30T17:02:34.905150] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-30T17:02:34.905699] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-30T17:02:34.905778] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-30T17:02:34.907037] [DEBUG] [LOCAL ] ACP: Trimmed 47495 records to 30970 (keeping 200 days of data) [2025-09-30T17:02:35.125768] [DEBUG] [LOCAL ] ACP: Primary data saved (30970 records). [2025-09-30T17:02:35.125921] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-30T17:02:35.126001] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACP took 51.9s. Estimated remaining: 3h 39m 15s. Rate: 10.7 symbols/min [2025-09-30T17:02:35.355209] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T17:02:35.353796] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:02:35.362872] [DEBUG] [LOCAL ] ADM: No existing data file found in primary storage. [2025-09-30T17:02:35.363094] [WARN ] [MAIN ] ADM: No existing data found, performing full refresh instead. [2025-09-30T17:02:35.363673] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-30T17:02:35.363795] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-30T17:02:35.363850] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-09-30T17:02:35.363886] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-30T17:02:35.459529] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-30T17:02:35.795791] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:36.254407] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-30T17:02:36.335577] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T17:02:37.054341] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-30T17:02:37.120689] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T17:02:37.716408] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T17:02:37.854424] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-30T17:02:38.654442] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-30T17:02:39.182527] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T17:02:39.193979] [INFO ] [REMOTE ] ACVA: Full fetch complete (70322 records). [2025-09-30T17:02:39.194157] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-30T17:02:39.460535] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-30T17:02:39.671207] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-30T17:02:39.671406] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-30T17:02:39.672184] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-30T17:02:39.672323] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-30T17:02:39.674898] [DEBUG] [LOCAL ] ACVA: Trimmed 70322 records to 49249 (keeping 200 days of data) [2025-09-30T17:02:39.838743] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T17:02:40.030880] [DEBUG] [LOCAL ] ACVA: Primary data saved (49249 records). [2025-09-30T17:02:40.031029] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-30T17:02:40.031128] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ACVA took 41.3s. Estimated remaining: 3h 38m 10s. Rate: 10.7 symbols/min [2025-09-30T17:02:40.237306] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:02:40.237691] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-09-30T17:02:40.237818] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-09-30T17:02:40.238131] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-30T17:02:40.238220] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-30T17:02:40.238398] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-09-30T17:02:40.238457] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-30T17:02:40.277854] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-30T17:02:40.600465] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T17:02:40.702676] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:40.990099] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T17:02:41.054335] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-30T17:02:41.854395] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-30T17:02:42.252600] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-30T17:02:42.304073] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-30T17:02:42.654414] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-30T17:02:43.306806] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T17:02:43.454456] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-30T17:02:44.202527] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T17:02:44.254353] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-30T17:02:44.631927] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T17:02:44.640909] [INFO ] [REMOTE ] ADCT: Full fetch complete (51592 records). [2025-09-30T17:02:44.641066] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-30T17:02:45.056806] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-30T17:02:45.099813] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-30T17:02:45.099916] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-30T17:02:45.100524] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-30T17:02:45.100669] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-30T17:02:45.102629] [DEBUG] [LOCAL ] ADCT: Trimmed 51592 records to 34480 (keeping 200 days of data) [2025-09-30T17:02:45.318674] [DEBUG] [LOCAL ] ADCT: Primary data saved (34480 records). [2025-09-30T17:02:45.318839] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-30T17:02:45.320206] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADCT took 25.8s. Estimated remaining: 3h 37m 41s. Rate: 10.8 symbols/min [2025-09-30T17:02:45.510860] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:02:45.569563] [DEBUG] [LOCAL ] ADT: Loaded 53469 existing records from primary storage. [2025-09-30T17:02:45.569992] [INFO ] [MAIN ] ADT: Loaded 53469 existing records. [2025-09-30T17:02:45.759967] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:02:45.760331] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-30T17:02:45.760407] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-30T17:02:45.761158] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-30T17:02:45.761221] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-30T17:02:45.855717] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-30T17:02:46.195676] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:02:46.239570] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T17:02:46.654383] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-30T17:02:46.921533] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T17:02:47.186941] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T17:02:47.454403] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-30T17:02:48.254353] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-30T17:02:48.326863] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T17:02:48.592709] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T17:02:49.054417] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-30T17:02:49.794068] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T17:02:49.854417] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-30T17:02:50.654414] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-30T17:02:50.940707] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T17:02:51.171829] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T17:02:51.454385] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-30T17:02:52.254349] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-30T17:02:52.371969] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T17:02:52.955891] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T17:02:53.054423] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-30T17:02:53.854399] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-30T17:02:54.239497] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-30T17:02:54.484477] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T17:02:54.654370] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-30T17:02:55.243834] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T17:02:55.454412] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-30T17:02:56.254410] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-30T17:02:56.344393] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T17:02:57.054401] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-30T17:02:57.379449] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T17:02:57.854435] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-30T17:02:57.906104] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T17:02:58.278859] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T17:02:58.654388] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-30T17:02:59.454622] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-30T17:02:59.614065] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:03:00.254369] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-30T17:03:00.371129] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T17:03:00.756492] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T17:03:01.054400] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-30T17:03:01.854395] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-30T17:03:02.200138] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T17:03:02.364104] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T17:03:02.654416] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-30T17:03:03.454419] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-30T17:03:03.927739] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-30T17:03:04.254418] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-30T17:03:04.382762] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T17:03:04.392732] [INFO ] [REMOTE ] ADNT: Full fetch complete (67995 records). [2025-09-30T17:03:04.392895] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-30T17:03:04.900370] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-30T17:03:04.900540] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-30T17:03:04.901734] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-30T17:03:04.901913] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-30T17:03:04.904082] [DEBUG] [LOCAL ] ADNT: Trimmed 67995 records to 47238 (keeping 200 days of data) [2025-09-30T17:03:04.944099] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T17:03:05.055901] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-30T17:03:05.254751] [DEBUG] [LOCAL ] ADNT: Primary data saved (47238 records). [2025-09-30T17:03:05.254906] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-30T17:03:05.254986] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADNT took 25.2s. Estimated remaining: 3h 56m 15s. Rate: 9.9 symbols/min [2025-09-30T17:03:05.447263] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:05.478232] [DEBUG] [LOCAL ] ADX: Loaded 27588 existing records from primary storage. [2025-09-30T17:03:05.478805] [INFO ] [MAIN ] ADX: Loaded 27588 existing records. [2025-09-30T17:03:05.743958] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:05.744259] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-30T17:03:05.744322] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-30T17:03:05.744818] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-30T17:03:05.744881] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-30T17:03:05.859472] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-30T17:03:06.186978] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:06.213690] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T17:03:06.223770] [INFO ] [REMOTE ] ADC: Full fetch complete (66125 records). [2025-09-30T17:03:06.223952] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-30T17:03:06.649093] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-30T17:03:06.649219] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-30T17:03:06.649937] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-30T17:03:06.650004] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-30T17:03:06.651585] [DEBUG] [LOCAL ] ADC: Trimmed 66125 records to 46153 (keeping 200 days of data) [2025-09-30T17:03:06.654423] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-30T17:03:06.955905] [DEBUG] [LOCAL ] ADC: Primary data saved (46153 records). [2025-09-30T17:03:06.956045] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-30T17:03:06.956130] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADC took 48.0s. Estimated remaining: 3h 50m 41s. Rate: 10.1 symbols/min [2025-09-30T17:03:07.139238] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:07.173631] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-30T17:03:07.230904] [DEBUG] [LOCAL ] AEE: Loaded 50084 existing records from primary storage. [2025-09-30T17:03:07.231239] [INFO ] [MAIN ] AEE: Loaded 50084 existing records. [2025-09-30T17:03:07.444183] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:07.444418] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-30T17:03:07.444471] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-30T17:03:07.444932] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-30T17:03:07.444993] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-30T17:03:07.460549] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-30T17:03:07.883579] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:07.912701] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T17:03:07.941004] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-30T17:03:08.254419] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-30T17:03:09.054347] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-30T17:03:09.485615] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T17:03:09.501022] [INFO ] [REMOTE ] ADM: Full fetch complete (76848 records). [2025-09-30T17:03:09.501276] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-30T17:03:09.502610] [FATAL] [VALIDATOR ] ADM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:03:09.502798] [FATAL] [MAIN ] ADM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:03:09.502845] [WARN ] [MAIN ] ADM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:03:09.502889] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-30T17:03:09.502950] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-09-30T17:03:09.502985] [INFO ] [LOCAL ] ADM: Starting deletion of derivative data. [2025-09-30T17:03:09.503043] [DEBUG] [LOCAL ] ADM: No derivative data file found to delete. [2025-09-30T17:03:09.503130] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADM took 34.4s. Estimated remaining: 3h 46m 29s. Rate: 10.3 symbols/min [2025-09-30T17:03:09.694272] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:09.705666] [DEBUG] [LOCAL ] AEFC: Loaded 8491 existing records from primary storage. [2025-09-30T17:03:09.705942] [INFO ] [MAIN ] AEFC: Loaded 8491 existing records. [2025-09-30T17:03:09.861502] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-30T17:03:09.910279] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:09.911705] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-30T17:03:09.911862] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-30T17:03:09.912253] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-30T17:03:09.912356] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-30T17:03:10.160406] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T17:03:10.377483] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:10.399812] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T17:03:10.654409] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-30T17:03:11.454335] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-30T17:03:11.726572] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T17:03:12.254421] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-30T17:03:12.747910] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T17:03:12.760065] [INFO ] [REMOTE ] ADT: Full fetch complete (77200 records). [2025-09-30T17:03:12.760224] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-30T17:03:12.927789] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T17:03:13.067010] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-30T17:03:13.259122] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-30T17:03:13.259209] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-30T17:03:13.260027] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-30T17:03:13.260095] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-30T17:03:13.262092] [DEBUG] [LOCAL ] ADT: Trimmed 77200 records to 53463 (keeping 200 days of data) [2025-09-30T17:03:13.620443] [DEBUG] [LOCAL ] ADT: Primary data saved (53463 records). [2025-09-30T17:03:13.620607] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-30T17:03:13.621674] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADT took 28.3s. Estimated remaining: 3h 44m 23s. Rate: 10.4 symbols/min [2025-09-30T17:03:13.825240] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:13.856226] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T17:03:13.854514] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-30T17:03:13.909501] [DEBUG] [LOCAL ] AEG: Loaded 49547 existing records from primary storage. [2025-09-30T17:03:13.909889] [INFO ] [MAIN ] AEG: Loaded 49547 existing records. [2025-09-30T17:03:14.104117] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T17:03:14.135221] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:14.135941] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-30T17:03:14.135991] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-30T17:03:14.136490] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-30T17:03:14.136551] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-30T17:03:14.597259] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:14.654417] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-30T17:03:15.278192] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T17:03:15.454371] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-30T17:03:16.254355] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-30T17:03:16.330620] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T17:03:16.847095] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T17:03:16.990167] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T17:03:17.054360] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-30T17:03:17.755830] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-30T17:03:17.854371] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-30T17:03:18.654360] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-30T17:03:19.022072] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T17:03:19.094378] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-30T17:03:19.454378] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-30T17:03:20.254358] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-30T17:03:21.054338] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-30T17:03:21.131177] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T17:03:21.219367] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T17:03:21.854358] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-30T17:03:22.654387] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-30T17:03:23.101791] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T17:03:23.172348] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-30T17:03:23.454365] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-30T17:03:24.073319] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T17:03:24.254366] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-30T17:03:24.749532] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T17:03:25.054367] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-30T17:03:25.839106] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T17:03:25.854315] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-30T17:03:26.654386] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-30T17:03:26.797737] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T17:03:27.454382] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-30T17:03:27.735194] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T17:03:27.758109] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T17:03:28.254405] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-30T17:03:28.971152] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T17:03:29.054390] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-30T17:03:29.854392] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-30T17:03:30.005417] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T17:03:30.611584] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T17:03:30.654406] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-30T17:03:31.337710] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T17:03:31.345415] [INFO ] [REMOTE ] ADX: Full fetch complete (42034 records). [2025-09-30T17:03:31.345612] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-30T17:03:31.459505] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-30T17:03:31.749777] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-30T17:03:31.749918] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-30T17:03:31.750498] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-30T17:03:31.750542] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-30T17:03:31.751768] [DEBUG] [LOCAL ] ADX: Trimmed 42034 records to 27514 (keeping 200 days of data) [2025-09-30T17:03:31.928517] [DEBUG] [LOCAL ] ADX: Primary data saved (27514 records). [2025-09-30T17:03:31.928752] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-30T17:03:31.928872] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADX took 26.7s. Estimated remaining: 3h 58m 40s. Rate: 9.8 symbols/min [2025-09-30T17:03:32.139809] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:32.207298] [DEBUG] [LOCAL ] AEM: Loaded 53465 existing records from primary storage. [2025-09-30T17:03:32.207926] [INFO ] [MAIN ] AEM: Loaded 53465 existing records. [2025-09-30T17:03:32.263520] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-30T17:03:32.385669] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T17:03:32.438723] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:32.440503] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-30T17:03:32.457822] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-30T17:03:32.473480] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-30T17:03:32.474114] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-30T17:03:32.476231] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:03:32.938974] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:33.054378] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-30T17:03:33.854424] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-30T17:03:33.931563] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T17:03:34.654444] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-30T17:03:34.857970] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T17:03:35.454372] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-30T17:03:35.811413] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T17:03:36.254432] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-30T17:03:36.271124] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T17:03:36.381544] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T17:03:37.054569] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-30T17:03:37.854466] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-30T17:03:37.996152] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T17:03:38.007480] [INFO ] [REMOTE ] AEE: Full fetch complete (72586 records). [2025-09-30T17:03:38.007694] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-30T17:03:38.437361] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-30T17:03:38.437470] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-30T17:03:38.438246] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-30T17:03:38.438349] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-30T17:03:38.440015] [DEBUG] [LOCAL ] AEE: Trimmed 72586 records to 50091 (keeping 200 days of data) [2025-09-30T17:03:38.673617] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-30T17:03:38.682679] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T17:03:38.790157] [DEBUG] [LOCAL ] AEE: Primary data saved (50091 records). [2025-09-30T17:03:38.790290] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-30T17:03:38.790377] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEE took 31.8s. Estimated remaining: 3h 59m 23s. Rate: 9.8 symbols/min [2025-09-30T17:03:38.977390] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:39.016507] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-30T17:03:39.080203] [DEBUG] [LOCAL ] AEO: Loaded 53558 existing records from primary storage. [2025-09-30T17:03:39.080594] [INFO ] [MAIN ] AEO: Loaded 53558 existing records. [2025-09-30T17:03:39.277611] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:39.277882] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-30T17:03:39.277956] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-30T17:03:39.278597] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-30T17:03:39.278706] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-30T17:03:39.464622] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-30T17:03:39.660248] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:40.251319] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T17:03:40.254302] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-30T17:03:40.390130] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T17:03:41.054349] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-30T17:03:41.116850] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T17:03:41.854459] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-30T17:03:42.591109] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T17:03:42.593037] [INFO ] [REMOTE ] AEFC: Full fetch complete (12264 records). [2025-09-30T17:03:42.593112] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-30T17:03:42.661086] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-30T17:03:43.030807] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-30T17:03:43.030998] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-30T17:03:43.031245] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-30T17:03:43.031322] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-30T17:03:43.032175] [DEBUG] [LOCAL ] AEFC: Trimmed 12264 records to 8535 (keeping 200 days of data) [2025-09-30T17:03:43.101085] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-30T17:03:43.124907] [DEBUG] [LOCAL ] AEFC: Primary data saved (8535 records). [2025-09-30T17:03:43.125060] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-30T17:03:43.125145] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEFC took 33.6s. Estimated remaining: 3h 57m 19s. Rate: 9.8 symbols/min [2025-09-30T17:03:43.319545] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:03:43.383692] [DEBUG] [LOCAL ] AER: Loaded 48447 existing records from primary storage. [2025-09-30T17:03:43.384228] [INFO ] [MAIN ] AER: Loaded 48447 existing records. [2025-09-30T17:03:43.459470] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-30T17:03:43.640573] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:03:43.640864] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-30T17:03:43.640920] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-30T17:03:43.641232] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-30T17:03:43.641292] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-30T17:03:44.033214] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:03:44.254415] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-30T17:03:44.514120] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T17:03:45.054398] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-30T17:03:45.450217] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T17:03:45.854435] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-30T17:03:46.020257] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T17:03:46.516046] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T17:03:46.526956] [INFO ] [REMOTE ] AEG: Full fetch complete (70367 records). [2025-09-30T17:03:46.527166] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-30T17:03:46.659545] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-30T17:03:46.949068] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-30T17:03:46.949154] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-30T17:03:46.949955] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-30T17:03:46.950023] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-30T17:03:46.951818] [DEBUG] [LOCAL ] AEG: Trimmed 70367 records to 49547 (keeping 200 days of data) [2025-09-30T17:03:47.261305] [DEBUG] [LOCAL ] AEG: Primary data saved (49547 records). [2025-09-30T17:03:47.261496] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-30T17:03:47.262270] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 33.6s. Estimated remaining: 3h 55m 9s. Rate: 9.9 symbols/min [2025-09-30T17:03:47.454406] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-30T17:03:48.148062] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T17:03:48.259993] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-30T17:03:48.272167] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T17:03:49.054369] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-30T17:03:49.229422] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T17:03:49.854430] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-30T17:03:50.314182] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-30T17:03:50.654407] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-30T17:03:50.707182] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T17:03:51.241107] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T17:03:51.454371] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-30T17:03:52.254328] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-30T17:03:52.521870] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T17:03:53.054320] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-30T17:03:53.135486] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T17:03:53.612015] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:03:53.854374] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-30T17:03:54.654412] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-30T17:03:55.113200] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-30T17:03:55.454327] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-30T17:03:55.668156] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T17:03:56.254363] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-30T17:03:56.333135] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T17:03:57.056193] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T17:03:57.056355] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-30T17:03:57.854403] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-30T17:03:58.159958] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T17:03:58.475382] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T17:03:58.654393] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-30T17:03:59.454434] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-30T17:04:00.022198] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:04:00.118475] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-30T17:04:00.130495] [INFO ] [REMOTE ] AEM: Full fetch complete (77151 records). [2025-09-30T17:04:00.130670] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-30T17:04:00.259541] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-30T17:04:00.560404] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-30T17:04:00.560498] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-30T17:04:00.561225] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-30T17:04:00.561292] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-30T17:04:00.562928] [DEBUG] [LOCAL ] AEM: Trimmed 77151 records to 53464 (keeping 200 days of data) [2025-09-30T17:04:00.926044] [DEBUG] [LOCAL ] AEM: Primary data saved (53464 records). [2025-09-30T17:04:00.926196] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-30T17:04:00.926297] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 29.0s. Estimated remaining: 4h 2m 51s. Rate: 9.6 symbols/min [2025-09-30T17:04:01.457992] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-30T17:04:01.470391] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-30T17:04:02.030295] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T17:04:02.041832] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-30T17:04:03.564127] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-30T17:04:03.581065] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-30T17:04:03.703589] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T17:04:03.714562] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-30T17:04:05.358231] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T17:04:05.369184] [INFO ] [REMOTE ] AER: Full fetch complete (69552 records). [2025-09-30T17:04:05.369352] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-30T17:04:05.830961] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-30T17:04:05.831330] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-30T17:04:05.832233] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-30T17:04:05.832326] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-30T17:04:05.837077] [DEBUG] [LOCAL ] AER: Trimmed 69552 records to 48382 (keeping 200 days of data) [2025-09-30T17:04:05.972154] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-30T17:04:05.986346] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-30T17:04:06.220149] [DEBUG] [LOCAL ] AER: Primary data saved (48382 records). [2025-09-30T17:04:06.220372] [INFO ] [MAIN ] AER: Full history saved. [2025-09-30T17:04:06.222370] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AER took 23.1s. Estimated remaining: 4h 1m 48s. Rate: 9.6 symbols/min [2025-09-30T17:04:08.192763] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-30T17:04:08.204529] [INFO ] [REMOTE ] AEO: Full fetch complete (77443 records). [2025-09-30T17:04:08.204737] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-30T17:04:08.636239] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-30T17:04:08.636321] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-30T17:04:08.637115] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-30T17:04:08.637186] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-30T17:04:08.638838] [DEBUG] [LOCAL ] AEO: Trimmed 77443 records to 53557 (keeping 200 days of data) [2025-09-30T17:04:08.968115] [DEBUG] [LOCAL ] AEO: Primary data saved (53557 records). [2025-09-30T17:04:08.968297] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-30T17:04:08.968414] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AEO took 30.2s. Estimated remaining: 3h 58m 19s. Rate: 9.8 symbols/min [2025-09-30T17:04:09.607293] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:09.683111] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-09-30T17:04:09.768043] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-09-30T17:04:09.786968] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:09.796449] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:09.784869] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-09-30T17:04:09.814722] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-30T17:04:09.847638] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-30T17:04:09.852257] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:09.852480] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-09-30T17:04:09.939329] [DEBUG] [LOCAL ] AFB: Loaded 11281 existing records from primary storage. [2025-09-30T17:04:09.956769] [INFO ] [MAIN ] AFB: Loaded 11281 existing records. [2025-09-30T17:04:10.367877] [DEBUG] [LOCAL ] AES: Loaded 53670 existing records from primary storage. [2025-09-30T17:04:10.431226] [INFO ] [MAIN ] AES: Loaded 53670 existing records. [2025-09-30T17:04:10.442444] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:10.533706] [DEBUG] [LOCAL ] AESI: Loaded 49449 existing records from primary storage. [2025-09-30T17:04:10.575625] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-30T17:04:10.575835] [INFO ] [MAIN ] AESI: Loaded 49449 existing records. [2025-09-30T17:04:10.605167] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:10.583446] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-30T17:04:10.633089] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-30T17:04:10.627795] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-09-30T17:04:10.649963] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-30T17:04:11.042488] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:11.054321] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-30T17:04:11.038890] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:04:11.054511] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-30T17:04:11.077660] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:11.086899] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-30T17:04:11.078081] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-09-30T17:04:11.092416] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-30T17:04:11.092511] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:04:11.092828] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-30T17:04:11.092748] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-09-30T17:04:11.113579] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-30T17:04:11.125199] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:04:11.155423] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-30T17:04:11.175443] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-30T17:04:11.221337] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-30T17:04:11.322863] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-30T17:04:11.350393] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-09-30T17:04:11.448447] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-09-30T17:04:11.501113] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 2.5s. Estimated remaining: 3h 54m 48s. Rate: 9.9 symbols/min [2025-09-30T17:04:12.041112] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:12.067852] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-30T17:04:12.363520] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:12.359527] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:12.380159] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-30T17:04:12.451241] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:12.452034] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-30T17:04:12.488181] [DEBUG] [LOCAL ] AFG: Loaded 32404 existing records from primary storage. [2025-09-30T17:04:12.488618] [INFO ] [MAIN ] AFG: Loaded 32404 existing records. [2025-09-30T17:04:12.684768] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:12.685009] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-30T17:04:12.685058] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-30T17:04:12.685313] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-30T17:04:12.685372] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-30T17:04:13.006290] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T17:04:13.025667] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-30T17:04:13.096426] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:13.096993] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-30T17:04:13.801823] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T17:04:13.805030] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-30T17:04:14.375703] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-30T17:04:14.387140] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-30T17:04:14.415414] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T17:04:14.418383] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-30T17:04:14.476750] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T17:04:14.483576] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-30T17:04:14.808486] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-30T17:04:14.819875] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-30T17:04:14.945759] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-30T17:04:14.949385] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-30T17:04:15.656808] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T17:04:15.664065] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-30T17:04:15.689873] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T17:04:15.694179] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-30T17:04:15.865246] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T17:04:16.254394] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-30T17:04:16.339891] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T17:04:16.496957] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T17:04:17.054379] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-30T17:04:17.134223] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T17:04:17.836486] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T17:04:17.859856] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-30T17:04:17.864277] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T17:04:18.654364] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-30T17:04:19.403913] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T17:04:19.454356] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-30T17:04:20.255586] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-30T17:04:20.261600] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T17:04:20.788048] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T17:04:21.033436] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T17:04:21.054318] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-30T17:04:21.806539] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:04:21.854354] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-30T17:04:22.654327] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-30T17:04:22.694216] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T17:04:22.697352] [INFO ] [REMOTE ] AFB: Full fetch complete (16568 records). [2025-09-30T17:04:22.697503] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-30T17:04:23.110448] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-30T17:04:23.110676] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-30T17:04:23.110991] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-30T17:04:23.111049] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-30T17:04:23.111674] [DEBUG] [LOCAL ] AFB: Trimmed 16568 records to 11253 (keeping 200 days of data) [2025-09-30T17:04:23.184635] [DEBUG] [LOCAL ] AFB: Primary data saved (11253 records). [2025-09-30T17:04:23.184808] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-30T17:04:23.184941] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFB took 14.2s. Estimated remaining: 3h 59m 55s. Rate: 9.7 symbols/min [2025-09-30T17:04:23.364218] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:23.370105] [DEBUG] [LOCAL ] AFGB: Loaded 2333 existing records from primary storage. [2025-09-30T17:04:23.370325] [INFO ] [MAIN ] AFGB: Loaded 2333 existing records. [2025-09-30T17:04:23.462313] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-30T17:04:23.576540] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:23.576985] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-30T17:04:23.577088] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-30T17:04:23.577430] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-30T17:04:23.577510] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-30T17:04:23.969993] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:24.254406] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-30T17:04:24.651429] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-30T17:04:25.054379] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-30T17:04:25.366311] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T17:04:25.851847] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T17:04:25.858793] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-30T17:04:26.654383] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-30T17:04:27.129774] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T17:04:27.174530] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-30T17:04:27.221584] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T17:04:27.454376] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-30T17:04:28.254424] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-30T17:04:28.726493] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-30T17:04:29.055391] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-30T17:04:29.058307] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T17:04:29.854368] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-30T17:04:30.654331] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-30T17:04:31.161342] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T17:04:31.454409] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-30T17:04:31.528519] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T17:04:31.654808] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T17:04:32.254425] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-30T17:04:33.054371] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-30T17:04:33.421605] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T17:04:33.437174] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-30T17:04:33.854337] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-30T17:04:33.963443] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T17:04:34.238314] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-30T17:04:34.654408] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-30T17:04:35.455281] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-30T17:04:36.231466] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:04:36.254321] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-30T17:04:37.054326] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-30T17:04:37.330077] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T17:04:37.341015] [INFO ] [REMOTE ] AESI: Full fetch complete (70377 records). [2025-09-30T17:04:37.341153] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-30T17:04:37.847774] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-30T17:04:37.849188] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:04:37.849334] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-30T17:04:37.850198] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-30T17:04:37.857064] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-30T17:04:37.856967] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-30T17:04:37.860859] [DEBUG] [LOCAL ] AESI: Trimmed 70377 records to 49451 (keeping 200 days of data) [2025-09-30T17:04:38.171600] [DEBUG] [LOCAL ] AESI: Primary data saved (49451 records). [2025-09-30T17:04:38.171762] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-30T17:04:38.171856] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AESI took 29.2s. Estimated remaining: 4h 7m 45s. Rate: 9.4 symbols/min [2025-09-30T17:04:38.362027] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:38.367197] [DEBUG] [LOCAL ] AFGC: Loaded 2542 existing records from primary storage. [2025-09-30T17:04:38.367367] [INFO ] [MAIN ] AFGC: Loaded 2542 existing records. [2025-09-30T17:04:38.483731] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-30T17:04:38.574341] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:38.574544] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-30T17:04:38.574593] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-30T17:04:38.574825] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-30T17:04:38.574886] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-30T17:04:38.659774] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-30T17:04:38.987698] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:39.028984] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-30T17:04:39.061079] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T17:04:39.454398] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-30T17:04:39.912739] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-30T17:04:40.254347] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-30T17:04:40.570971] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-30T17:04:41.054383] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-30T17:04:41.854389] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-30T17:04:42.524116] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T17:04:42.654331] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-30T17:04:43.166482] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-30T17:04:43.249442] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-30T17:04:43.250581] [INFO ] [REMOTE ] AFGB: Full fetch complete (3644 records). [2025-09-30T17:04:43.250756] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-30T17:04:43.251531] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:04:43.251681] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:04:43.251759] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:04:43.251818] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-30T17:04:43.251920] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-09-30T17:04:43.252008] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-09-30T17:04:43.252626] [DEBUG] [LOCAL ] AFGB: Deleted derivative data file. [2025-09-30T17:04:43.252850] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFGB took 20.1s. Estimated remaining: 4h 6m 30s. Rate: 9.4 symbols/min [2025-09-30T17:04:43.452444] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:43.454340] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-30T17:04:43.459359] [DEBUG] [LOCAL ] AFGD: Loaded 1812 existing records from primary storage. [2025-09-30T17:04:43.459815] [INFO ] [MAIN ] AFGD: Loaded 1812 existing records. [2025-09-30T17:04:43.659759] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:43.659989] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-30T17:04:43.660037] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-30T17:04:43.660199] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-30T17:04:43.660268] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-30T17:04:44.072192] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:44.254379] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-30T17:04:44.858071] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-30T17:04:45.054601] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-30T17:04:45.060807] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T17:04:45.854344] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-30T17:04:45.911694] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T17:04:46.654378] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-30T17:04:46.984544] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-30T17:04:47.454338] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-30T17:04:47.479472] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T17:04:47.487142] [INFO ] [REMOTE ] AFG: Full fetch complete (45861 records). [2025-09-30T17:04:47.487325] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-30T17:04:47.923147] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-30T17:04:47.923272] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-30T17:04:47.923815] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-30T17:04:47.923882] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-30T17:04:47.925000] [DEBUG] [LOCAL ] AFG: Trimmed 45861 records to 32433 (keeping 200 days of data) [2025-09-30T17:04:48.149252] [DEBUG] [LOCAL ] AFG: Primary data saved (32433 records). [2025-09-30T17:04:48.149402] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-30T17:04:48.151030] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AFG took 36.5s. Estimated remaining: 4h 5m 8s. Rate: 9.5 symbols/min [2025-09-30T17:04:48.262351] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-30T17:04:48.354226] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:48.360762] [DEBUG] [LOCAL ] AFGE: Loaded 2470 existing records from primary storage. [2025-09-30T17:04:48.361006] [INFO ] [MAIN ] AFGE: Loaded 2470 existing records. [2025-09-30T17:04:48.561178] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:04:48.562189] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-30T17:04:48.562252] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-30T17:04:48.562441] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-30T17:04:48.562503] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-30T17:04:48.676477] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-30T17:04:48.949125] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:49.054330] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-30T17:04:49.346273] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-30T17:04:49.563334] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T17:04:49.576210] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-09-30T17:04:49.576389] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-30T17:04:49.864150] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-30T17:04:50.019238] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-30T17:04:50.019340] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-30T17:04:50.020202] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-30T17:04:50.020287] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-30T17:04:50.022049] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 53670 (keeping 200 days of data) [2025-09-30T17:04:50.370227] [DEBUG] [LOCAL ] AES: Primary data saved (53670 records). [2025-09-30T17:04:50.370384] [INFO ] [MAIN ] AES: Full history saved. [2025-09-30T17:04:50.370535] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AES took 41.4s. Estimated remaining: 4h 1m 35s. Rate: 9.6 symbols/min [2025-09-30T17:04:50.489899] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T17:04:50.568623] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:04:50.568848] [DEBUG] [LOCAL ] AFL: No existing data file found in primary storage. [2025-09-30T17:04:50.568891] [WARN ] [MAIN ] AFL: No existing data found, performing full refresh instead. [2025-09-30T17:04:50.569038] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-30T17:04:50.569105] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-30T17:04:50.569176] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-09-30T17:04:50.569212] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-30T17:04:50.659515] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-30T17:04:50.967917] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:04:51.174199] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T17:04:51.454375] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-30T17:04:52.254348] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-30T17:04:52.537267] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-30T17:04:52.903328] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T17:04:53.054367] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-30T17:04:53.538422] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T17:04:53.854370] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-30T17:04:54.180328] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T17:04:54.654414] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-30T17:04:55.080754] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T17:04:55.454423] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-30T17:04:56.008084] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T17:04:56.254346] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-30T17:04:56.816430] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-30T17:04:57.054361] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-30T17:04:57.648472] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T17:04:57.854415] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-30T17:04:58.654406] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-30T17:04:58.964057] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-30T17:04:59.454376] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-30T17:04:59.683422] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T17:04:59.983618] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-30T17:05:00.254378] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-30T17:05:00.869103] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-30T17:05:01.054407] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-30T17:05:01.545321] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-30T17:05:01.854439] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-30T17:05:02.318013] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-30T17:05:02.654404] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-30T17:05:03.454418] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-30T17:05:03.970499] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-30T17:05:04.254362] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-30T17:05:04.319293] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T17:05:04.539493] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-30T17:05:05.054380] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-30T17:05:05.854329] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-30T17:05:05.989579] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T17:05:05.990779] [INFO ] [REMOTE ] AFGD: Full fetch complete (3178 records). [2025-09-30T17:05:05.990850] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-30T17:05:06.379659] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-30T17:05:06.379751] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-30T17:05:06.379865] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-30T17:05:06.379928] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-30T17:05:06.380303] [DEBUG] [LOCAL ] AFGD: Trimmed 3178 records to 1830 (keeping 200 days of data) [2025-09-30T17:05:06.391982] [DEBUG] [LOCAL ] AFGD: Primary data saved (1830 records). [2025-09-30T17:05:06.392105] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-30T17:05:06.392201] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGD took 23.1s. Estimated remaining: 4h 9m 32s. Rate: 9.3 symbols/min [2025-09-30T17:05:06.576454] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:06.576665] [DEBUG] [LOCAL ] AG: No existing data file found in primary storage. [2025-09-30T17:05:06.576724] [WARN ] [MAIN ] AG: No existing data found, performing full refresh instead. [2025-09-30T17:05:06.576854] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-30T17:05:06.576896] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-30T17:05:06.576939] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-09-30T17:05:06.576972] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-30T17:05:06.662326] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-30T17:05:07.030006] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:07.350808] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T17:05:07.454365] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-30T17:05:07.751909] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T17:05:07.949855] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-30T17:05:08.254351] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-30T17:05:08.835675] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-30T17:05:09.054357] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-30T17:05:09.854386] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-30T17:05:10.311696] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-30T17:05:10.654347] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-30T17:05:10.850317] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T17:05:11.118185] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-30T17:05:11.454362] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-30T17:05:12.254368] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-30T17:05:13.054363] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-30T17:05:13.291353] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T17:05:13.528781] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T17:05:13.775235] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T17:05:13.854371] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-30T17:05:14.654365] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-30T17:05:15.230890] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T17:05:15.232133] [INFO ] [REMOTE ] AFGC: Full fetch complete (3724 records). [2025-09-30T17:05:15.232237] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-30T17:05:15.232730] [FATAL] [VALIDATOR ] AFGC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:05:15.232825] [FATAL] [MAIN ] AFGC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:05:15.232871] [WARN ] [MAIN ] AFGC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:05:15.232943] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-30T17:05:15.233027] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-09-30T17:05:15.233074] [INFO ] [LOCAL ] AFGC: Starting deletion of derivative data. [2025-09-30T17:05:15.233439] [DEBUG] [LOCAL ] AFGC: Deleted derivative data file. [2025-09-30T17:05:15.233546] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGC took 37.1s. Estimated remaining: 4h 11m 22s. Rate: 9.2 symbols/min [2025-09-30T17:05:15.441030] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:15.454373] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-30T17:05:15.504633] [DEBUG] [LOCAL ] AGCO: Loaded 42413 existing records from primary storage. [2025-09-30T17:05:15.505054] [INFO ] [MAIN ] AGCO: Loaded 42413 existing records. [2025-09-30T17:05:15.717027] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:05:15.717442] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-30T17:05:15.717509] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-30T17:05:15.718095] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-30T17:05:15.718171] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-30T17:05:15.855512] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-30T17:05:16.176290] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:16.254363] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-30T17:05:17.054341] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-30T17:05:17.538450] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-30T17:05:17.840889] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T17:05:17.841975] [INFO ] [REMOTE ] AFGE: Full fetch complete (3462 records). [2025-09-30T17:05:17.842138] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-30T17:05:17.842706] [FATAL] [VALIDATOR ] AFGE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:05:17.842799] [FATAL] [MAIN ] AFGE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:05:17.842885] [WARN ] [MAIN ] AFGE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:05:17.842981] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-30T17:05:17.843065] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-09-30T17:05:17.843105] [INFO ] [LOCAL ] AFGE: Starting deletion of derivative data. [2025-09-30T17:05:17.843343] [DEBUG] [LOCAL ] AFGE: Deleted derivative data file. [2025-09-30T17:05:17.843449] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 29.7s. Estimated remaining: 4h 8m 11s. Rate: 9.4 symbols/min [2025-09-30T17:05:17.859451] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-30T17:05:18.040998] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:18.072625] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T17:05:18.099305] [DEBUG] [LOCAL ] AGD: Loaded 17846 existing records from primary storage. [2025-09-30T17:05:18.099555] [INFO ] [MAIN ] AGD: Loaded 17846 existing records. [2025-09-30T17:05:18.288846] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:05:18.289084] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-30T17:05:18.289154] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-30T17:05:18.289524] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-30T17:05:18.289585] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-30T17:05:18.661061] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:18.657279] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-30T17:05:19.454389] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-30T17:05:20.047720] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-30T17:05:20.254364] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-30T17:05:20.344399] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T17:05:20.369140] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T17:05:21.054419] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-30T17:05:21.650013] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T17:05:21.854407] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-30T17:05:22.654418] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-30T17:05:23.165205] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T17:05:23.466220] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-30T17:05:23.473068] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T17:05:24.192040] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T17:05:24.254353] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-30T17:05:24.699294] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T17:05:25.054380] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-30T17:05:25.859206] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-30T17:05:25.861286] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T17:05:26.119274] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T17:05:26.654424] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-30T17:05:27.403677] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T17:05:27.442187] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-30T17:05:27.454362] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-30T17:05:28.254443] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-30T17:05:29.054417] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-30T17:05:29.436224] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-30T17:05:29.854420] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-30T17:05:29.994745] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-30T17:05:30.091119] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T17:05:30.103153] [INFO ] [REMOTE ] AFL: Full fetch complete (76917 records). [2025-09-30T17:05:30.103319] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-30T17:05:30.571204] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-30T17:05:30.571327] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-30T17:05:30.572237] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-30T17:05:30.572313] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-30T17:05:30.578605] [DEBUG] [LOCAL ] AFL: Trimmed 76917 records to 53145 (keeping 200 days of data) [2025-09-30T17:05:30.674017] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-30T17:05:30.933892] [DEBUG] [LOCAL ] AFL: Primary data saved (53145 records). [2025-09-30T17:05:30.934047] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-30T17:05:30.934148] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 40.6s. Estimated remaining: 4h 13m 15s. Rate: 9.2 symbols/min [2025-09-30T17:05:31.124116] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:31.182444] [DEBUG] [LOCAL ] AGI: Loaded 53415 existing records from primary storage. [2025-09-30T17:05:31.182825] [INFO ] [MAIN ] AGI: Loaded 53415 existing records. [2025-09-30T17:05:31.419412] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:05:31.419858] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-30T17:05:31.419964] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-30T17:05:31.420591] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-30T17:05:31.420688] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-30T17:05:31.462124] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-30T17:05:31.600365] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T17:05:31.783769] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T17:05:31.891316] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:32.254351] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-30T17:05:33.054403] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-30T17:05:33.515568] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T17:05:33.598456] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-30T17:05:33.827920] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T17:05:33.854312] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-30T17:05:34.654331] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-30T17:05:34.682841] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T17:05:35.454407] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-30T17:05:36.106066] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T17:05:36.254400] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-30T17:05:37.054377] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-30T17:05:37.292567] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T17:05:37.673763] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T17:05:37.854372] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-30T17:05:38.432512] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T17:05:38.654367] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-30T17:05:39.043810] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:05:39.050757] [INFO ] [REMOTE ] AGD: Full fetch complete (25513 records). [2025-09-30T17:05:39.050860] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-30T17:05:39.456297] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-30T17:05:39.467581] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-30T17:05:39.468404] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-30T17:05:39.468859] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-30T17:05:39.468926] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-30T17:05:39.469776] [DEBUG] [LOCAL ] AGD: Trimmed 25513 records to 17925 (keeping 200 days of data) [2025-09-30T17:05:39.582486] [DEBUG] [LOCAL ] AGD: Primary data saved (17925 records). [2025-09-30T17:05:39.582632] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-30T17:05:39.582760] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AGD took 21.7s. Estimated remaining: 4h 14m 44s. Rate: 9.1 symbols/min [2025-09-30T17:05:39.762849] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:39.822728] [DEBUG] [LOCAL ] AGL: Loaded 52425 existing records from primary storage. [2025-09-30T17:05:39.823074] [INFO ] [MAIN ] AGL: Loaded 52425 existing records. [2025-09-30T17:05:40.020830] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:05:40.021103] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-30T17:05:40.021154] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-30T17:05:40.021621] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-30T17:05:40.021720] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-30T17:05:40.258772] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-30T17:05:40.418984] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:40.587708] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T17:05:41.054383] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-30T17:05:41.202994] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T17:05:41.854336] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-30T17:05:41.890765] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T17:05:42.656147] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-30T17:05:42.662455] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T17:05:43.454391] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-30T17:05:43.982993] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T17:05:43.995532] [INFO ] [REMOTE ] AG: Full fetch complete (77214 records). [2025-09-30T17:05:43.995733] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-30T17:05:43.996528] [FATAL] [VALIDATOR ] AG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:05:43.996626] [FATAL] [MAIN ] AG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:05:43.996714] [WARN ] [MAIN ] AG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:05:43.996767] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-30T17:05:43.996887] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-09-30T17:05:43.996947] [INFO ] [LOCAL ] AG: Starting deletion of derivative data. [2025-09-30T17:05:43.997028] [DEBUG] [LOCAL ] AG: No derivative data file found to delete. [2025-09-30T17:05:43.997113] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AG took 37.6s. Estimated remaining: 4h 13m 1s. Rate: 9.2 symbols/min [2025-09-30T17:05:44.213748] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:44.228732] [DEBUG] [LOCAL ] AGM: Loaded 10075 existing records from primary storage. [2025-09-30T17:05:44.228982] [INFO ] [MAIN ] AGM: Loaded 10075 existing records. [2025-09-30T17:05:44.263344] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-30T17:05:44.469536] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T17:05:44.475922] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:05:44.485609] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-30T17:05:44.485899] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-30T17:05:44.486342] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-30T17:05:44.486404] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-30T17:05:44.923929] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:45.054356] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-30T17:05:45.180479] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T17:05:45.574733] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-30T17:05:45.813469] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:05:45.854349] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-30T17:05:46.654385] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-30T17:05:47.454339] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-30T17:05:47.556584] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T17:05:48.254361] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-30T17:05:48.445776] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T17:05:48.792381] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T17:05:48.802685] [INFO ] [REMOTE ] AGCO: Full fetch complete (61915 records). [2025-09-30T17:05:48.802831] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-30T17:05:49.059490] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-30T17:05:49.224807] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-30T17:05:49.224900] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-30T17:05:49.225513] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-30T17:05:49.225560] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-30T17:05:49.226931] [DEBUG] [LOCAL ] AGCO: Trimmed 61915 records to 42360 (keeping 200 days of data) [2025-09-30T17:05:49.522762] [DEBUG] [LOCAL ] AGCO: Primary data saved (42360 records). [2025-09-30T17:05:49.522902] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-30T17:05:49.522988] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGCO took 34.3s. Estimated remaining: 4h 12m 9s. Rate: 9.2 symbols/min [2025-09-30T17:05:49.716527] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:05:49.751361] [DEBUG] [LOCAL ] AGO: Loaded 27898 existing records from primary storage. [2025-09-30T17:05:49.751717] [INFO ] [MAIN ] AGO: Loaded 27898 existing records. [2025-09-30T17:05:49.865734] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-30T17:05:49.966154] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:05:49.966629] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-30T17:05:49.966740] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-30T17:05:49.967168] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-30T17:05:49.967229] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-30T17:05:50.252097] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-30T17:05:50.431528] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:05:50.654339] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-30T17:05:50.718008] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T17:05:50.841434] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T17:05:51.454407] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-30T17:05:52.158118] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T17:05:52.215126] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T17:05:52.254349] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-30T17:05:53.054367] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-30T17:05:53.854371] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-30T17:05:54.055401] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T17:05:54.654440] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-30T17:05:55.086133] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-30T17:05:55.087350] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T17:05:55.162380] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T17:05:55.454396] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-30T17:05:56.254353] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-30T17:05:57.054356] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-30T17:05:57.151322] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:05:57.553615] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:05:57.757061] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-30T17:05:57.854384] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-30T17:05:58.654390] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-30T17:05:59.454347] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-30T17:05:59.498783] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T17:06:00.124000] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T17:06:00.261963] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-30T17:06:00.291698] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T17:06:01.054382] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-30T17:06:01.387116] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T17:06:01.854380] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-30T17:06:02.654371] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-30T17:06:02.753912] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:06:03.300886] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:06:03.454360] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-30T17:06:04.016278] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:06:04.254361] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-30T17:06:05.054347] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-30T17:06:05.114771] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T17:06:05.126464] [INFO ] [REMOTE ] AGI: Full fetch complete (76790 records). [2025-09-30T17:06:05.126635] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-30T17:06:05.584487] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-30T17:06:05.584682] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-30T17:06:05.585580] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-30T17:06:05.585709] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-30T17:06:05.597710] [DEBUG] [LOCAL ] AGI: Trimmed 76790 records to 53414 (keeping 200 days of data) [2025-09-30T17:06:05.618773] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T17:06:05.863052] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-30T17:06:05.997481] [DEBUG] [LOCAL ] AGI: Primary data saved (53414 records). [2025-09-30T17:06:05.997636] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-30T17:06:05.998685] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGI took 35.1s. Estimated remaining: 4h 19m 10s. Rate: 8.9 symbols/min [2025-09-30T17:06:06.135021] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T17:06:06.205416] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:06.246484] [DEBUG] [LOCAL ] AGRO: Loaded 33601 existing records from primary storage. [2025-09-30T17:06:06.246835] [INFO ] [MAIN ] AGRO: Loaded 33601 existing records. [2025-09-30T17:06:06.438440] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:06.438721] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-30T17:06:06.438792] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-30T17:06:06.439113] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-30T17:06:06.439190] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-30T17:06:06.664050] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-30T17:06:06.847885] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:07.454375] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-30T17:06:07.971004] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T17:06:08.123742] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-30T17:06:08.254353] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-30T17:06:08.576534] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T17:06:09.054373] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-30T17:06:09.821961] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T17:06:09.833222] [INFO ] [REMOTE ] AGL: Full fetch complete (75119 records). [2025-09-30T17:06:09.833389] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-30T17:06:09.834343] [FATAL] [VALIDATOR ] AGL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:06:09.834458] [FATAL] [MAIN ] AGL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:06:09.834504] [WARN ] [MAIN ] AGL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:06:09.834569] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-30T17:06:09.834635] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-09-30T17:06:09.834713] [INFO ] [LOCAL ] AGL: Starting deletion of derivative data. [2025-09-30T17:06:09.835029] [DEBUG] [LOCAL ] AGL: Deleted derivative data file. [2025-09-30T17:06:09.835128] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGL took 30.3s. Estimated remaining: 4h 17m 2s. Rate: 9.0 symbols/min [2025-09-30T17:06:09.859514] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-30T17:06:10.043398] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:10.089519] [DEBUG] [LOCAL ] AGX: Loaded 33224 existing records from primary storage. [2025-09-30T17:06:10.089888] [INFO ] [MAIN ] AGX: Loaded 33224 existing records. [2025-09-30T17:06:10.303762] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:10.304089] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-30T17:06:10.304147] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-30T17:06:10.304419] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-30T17:06:10.304478] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-30T17:06:10.656515] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-30T17:06:10.719503] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:10.740845] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T17:06:10.765789] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T17:06:11.454392] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-30T17:06:11.523073] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T17:06:12.254344] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-30T17:06:13.025430] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T17:06:13.054328] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-30T17:06:13.139015] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T17:06:13.854375] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-30T17:06:14.511768] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T17:06:14.654444] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-30T17:06:15.211755] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T17:06:15.454404] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-30T17:06:16.120897] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T17:06:16.254375] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-30T17:06:16.887954] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T17:06:17.054413] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-30T17:06:17.155699] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T17:06:17.158487] [INFO ] [REMOTE ] AGM: Full fetch complete (12708 records). [2025-09-30T17:06:17.158584] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-30T17:06:17.567362] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-30T17:06:17.567502] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-30T17:06:17.567853] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-30T17:06:17.567926] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-30T17:06:17.568766] [DEBUG] [LOCAL ] AGM: Trimmed 12708 records to 10121 (keeping 200 days of data) [2025-09-30T17:06:17.639760] [DEBUG] [LOCAL ] AGM: Primary data saved (10121 records). [2025-09-30T17:06:17.639914] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-30T17:06:17.640000] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGM took 33.6s. Estimated remaining: 4h 17m 43s. Rate: 9.0 symbols/min [2025-09-30T17:06:17.832067] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:17.858362] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-30T17:06:17.877892] [DEBUG] [LOCAL ] AHH: Loaded 41228 existing records from primary storage. [2025-09-30T17:06:17.878229] [INFO ] [MAIN ] AHH: Loaded 41228 existing records. [2025-09-30T17:06:18.079947] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:18.080276] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-30T17:06:18.080338] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-30T17:06:18.080698] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-30T17:06:18.080759] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-30T17:06:18.465352] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:18.484093] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T17:06:18.654318] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-30T17:06:19.454373] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-30T17:06:19.527866] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T17:06:19.592070] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:06:20.254392] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-30T17:06:21.054330] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-30T17:06:21.156225] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T17:06:21.771090] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T17:06:21.854360] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-30T17:06:22.188074] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T17:06:22.654359] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-30T17:06:23.454374] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-30T17:06:23.553979] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T17:06:23.589063] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T17:06:23.595216] [INFO ] [REMOTE ] AGO: Full fetch complete (39276 records). [2025-09-30T17:06:23.595422] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-30T17:06:24.000002] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-30T17:06:24.000089] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-30T17:06:24.000526] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-30T17:06:24.000571] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-30T17:06:24.001630] [DEBUG] [LOCAL ] AGO: Trimmed 39276 records to 27896 (keeping 200 days of data) [2025-09-30T17:06:24.184195] [DEBUG] [LOCAL ] AGO: Primary data saved (27896 records). [2025-09-30T17:06:24.184361] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-30T17:06:24.184464] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGO took 34.7s. Estimated remaining: 4h 17m 31s. Rate: 9.0 symbols/min [2025-09-30T17:06:24.263737] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-30T17:06:24.374560] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:24.375021] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-30T17:06:24.375105] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-30T17:06:24.375292] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-30T17:06:24.375341] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-30T17:06:24.375396] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-30T17:06:24.375437] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-30T17:06:24.634502] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T17:06:24.818906] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:25.054417] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-30T17:06:25.565957] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T17:06:25.854360] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-30T17:06:26.506415] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:06:26.654330] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-30T17:06:27.331682] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T17:06:27.454381] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-30T17:06:27.589070] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T17:06:28.254355] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-30T17:06:28.965978] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T17:06:29.054426] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-30T17:06:29.794575] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T17:06:29.854326] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-30T17:06:30.062723] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T17:06:30.654396] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-30T17:06:31.454413] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-30T17:06:31.658869] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T17:06:31.689544] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:06:31.689908] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-30T17:06:31.689999] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:06:31.690048] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-09-30T17:06:31.690081] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:06:31.690119] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-30T17:06:31.690195] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-30T17:06:31.690251] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-30T17:06:31.690309] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-30T17:06:31.690394] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AHL took 7.5s. Estimated remaining: 4h 17m 57s. Rate: 9.0 symbols/min [2025-09-30T17:06:31.884135] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:31.933912] [DEBUG] [LOCAL ] AHR: Loaded 49171 existing records from primary storage. [2025-09-30T17:06:31.934290] [INFO ] [MAIN ] AHR: Loaded 49171 existing records. [2025-09-30T17:06:32.145772] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:32.146437] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-30T17:06:32.146630] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-30T17:06:32.147448] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-30T17:06:32.147609] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-30T17:06:32.263709] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-30T17:06:32.282137] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T17:06:32.315756] [INFO ] [REMOTE ] AGX: Full fetch complete (48782 records). [2025-09-30T17:06:32.326178] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-30T17:06:32.848253] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:33.058684] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-30T17:06:33.076909] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-30T17:06:33.076991] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-30T17:06:33.077550] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-30T17:06:33.077596] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-30T17:06:33.078874] [DEBUG] [LOCAL ] AGX: Trimmed 48782 records to 33204 (keeping 200 days of data) [2025-09-30T17:06:33.302602] [DEBUG] [LOCAL ] AGX: Primary data saved (33204 records). [2025-09-30T17:06:33.302785] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-30T17:06:33.306702] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGX took 23.5s. Estimated remaining: 4h 14m 31s. Rate: 9.1 symbols/min [2025-09-30T17:06:33.504851] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:33.514455] [DEBUG] [LOCAL ] AHT: Loaded 6127 existing records from primary storage. [2025-09-30T17:06:33.514705] [INFO ] [MAIN ] AHT: Loaded 6127 existing records. [2025-09-30T17:06:33.710551] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:33.710945] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-30T17:06:33.711117] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-30T17:06:33.711363] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-30T17:06:33.711453] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-30T17:06:33.859346] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-30T17:06:34.041932] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T17:06:34.149180] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:34.654363] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-30T17:06:34.725349] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T17:06:35.454421] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-30T17:06:35.591788] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T17:06:35.958216] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:06:36.254317] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-30T17:06:36.405507] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T17:06:37.054390] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-30T17:06:37.501831] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T17:06:37.854455] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-30T17:06:38.074810] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T17:06:38.654378] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-30T17:06:38.910146] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T17:06:39.454373] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-30T17:06:40.058004] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T17:06:40.066234] [INFO ] [REMOTE ] AGRO: Full fetch complete (49831 records). [2025-09-30T17:06:40.066370] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-30T17:06:40.262230] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-30T17:06:40.484676] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-30T17:06:40.484771] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-30T17:06:40.485296] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-30T17:06:40.485340] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-30T17:06:40.486574] [DEBUG] [LOCAL ] AGRO: Trimmed 49831 records to 33600 (keeping 200 days of data) [2025-09-30T17:06:40.700452] [DEBUG] [LOCAL ] AGRO: Primary data saved (33600 records). [2025-09-30T17:06:40.700605] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-30T17:06:40.700744] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AGRO took 34.7s. Estimated remaining: 4h 14m 55s. Rate: 9.1 symbols/min [2025-09-30T17:06:40.900921] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:40.961849] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T17:06:40.978672] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T17:06:40.999626] [DEBUG] [LOCAL ] AI: Loaded 53750 existing records from primary storage. [2025-09-30T17:06:41.000031] [INFO ] [MAIN ] AI: Loaded 53750 existing records. [2025-09-30T17:06:41.059551] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-30T17:06:41.210614] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:41.210948] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-30T17:06:41.211046] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-30T17:06:41.211464] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-30T17:06:41.211523] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-30T17:06:41.587924] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:41.854402] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-30T17:06:42.654386] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-30T17:06:42.740633] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T17:06:42.751268] [INFO ] [REMOTE ] AHH: Full fetch complete (60245 records). [2025-09-30T17:06:42.751474] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-30T17:06:43.178764] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-30T17:06:43.178863] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-30T17:06:43.179534] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-30T17:06:43.179666] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-30T17:06:43.183410] [DEBUG] [LOCAL ] AHH: Trimmed 60245 records to 41175 (keeping 200 days of data) [2025-09-30T17:06:43.409961] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T17:06:43.445492] [DEBUG] [LOCAL ] AHH: Primary data saved (41175 records). [2025-09-30T17:06:43.445630] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-30T17:06:43.445799] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHH took 25.8s. Estimated remaining: 4h 12m 22s. Rate: 9.2 symbols/min [2025-09-30T17:06:43.459517] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-30T17:06:43.653796] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:43.717561] [DEBUG] [LOCAL ] AIG: Loaded 53471 existing records from primary storage. [2025-09-30T17:06:43.717966] [INFO ] [MAIN ] AIG: Loaded 53471 existing records. [2025-09-30T17:06:43.914135] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:06:43.914393] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-30T17:06:43.914459] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-30T17:06:43.914853] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-30T17:06:43.914933] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-30T17:06:44.270267] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-30T17:06:44.309779] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:44.438677] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-30T17:06:44.910694] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T17:06:45.054348] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-30T17:06:45.105624] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T17:06:45.764176] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T17:06:45.854380] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-30T17:06:46.654325] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-30T17:06:46.725365] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T17:06:47.454349] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-30T17:06:48.221915] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T17:06:48.254337] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-30T17:06:48.514134] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T17:06:48.950517] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T17:06:49.054367] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-30T17:06:49.854375] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-30T17:06:50.654363] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-30T17:06:50.808682] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T17:06:51.454440] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-30T17:06:52.254341] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-30T17:06:52.346347] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-30T17:06:52.556959] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T17:06:52.900170] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T17:06:53.054383] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-30T17:06:53.802477] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-30T17:06:53.854379] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-30T17:06:54.654375] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-30T17:06:54.842944] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T17:06:54.845250] [INFO ] [REMOTE ] AHT: Full fetch complete (9345 records). [2025-09-30T17:06:54.845323] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-30T17:06:55.231395] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-30T17:06:55.231598] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-30T17:06:55.231949] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-30T17:06:55.232051] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-30T17:06:55.232673] [DEBUG] [LOCAL ] AHT: Trimmed 9345 records to 6106 (keeping 200 days of data) [2025-09-30T17:06:55.290313] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-30T17:06:55.310311] [DEBUG] [LOCAL ] AHT: Primary data saved (6106 records). [2025-09-30T17:06:55.310434] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-30T17:06:55.310594] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHT took 22.0s. Estimated remaining: 4h 15m 33s. Rate: 9.0 symbols/min [2025-09-30T17:06:55.459541] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-30T17:06:55.494691] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:55.494874] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-30T17:06:55.494913] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-30T17:06:55.495028] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-30T17:06:55.495071] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-30T17:06:55.495114] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-30T17:06:55.495148] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-30T17:06:55.879369] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:06:56.254327] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-30T17:06:56.306279] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T17:06:57.054399] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-30T17:06:57.152118] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T17:06:57.854373] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-30T17:06:58.639453] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-30T17:06:58.654312] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-30T17:06:58.907886] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T17:06:59.454336] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-30T17:06:59.650526] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:06:59.665731] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:06:59.666072] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-30T17:06:59.666176] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:06:59.666241] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-09-30T17:06:59.666305] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:06:59.666425] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-30T17:06:59.666523] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-30T17:06:59.666602] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-30T17:06:59.666727] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-30T17:06:59.666801] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AII took 4.4s. Estimated remaining: 4h 14m 3s. Rate: 9.1 symbols/min [2025-09-30T17:06:59.860156] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:06:59.890880] [DEBUG] [LOCAL ] AIN: Loaded 24535 existing records from primary storage. [2025-09-30T17:06:59.891192] [INFO ] [MAIN ] AIN: Loaded 24535 existing records. [2025-09-30T17:07:00.124179] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:00.124421] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-30T17:07:00.124469] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-30T17:07:00.124742] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-30T17:07:00.124801] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-30T17:07:00.259494] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-30T17:07:00.510735] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:01.060191] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-30T17:07:01.066141] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-30T17:07:01.854395] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-30T17:07:01.992592] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T17:07:02.053484] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T17:07:02.654357] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-30T17:07:03.454356] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-30T17:07:03.781637] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T17:07:04.138224] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T17:07:04.254374] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-30T17:07:05.064614] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-30T17:07:05.071695] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T17:07:05.122808] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T17:07:05.854363] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-30T17:07:06.654367] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-30T17:07:06.839115] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:07:07.454339] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-30T17:07:07.529143] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-30T17:07:08.024540] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:07:08.254371] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-30T17:07:08.570498] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T17:07:09.054387] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-30T17:07:09.829403] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:07:09.854314] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-30T17:07:10.341457] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T17:07:10.654397] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-30T17:07:11.454324] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-30T17:07:11.526061] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T17:07:11.576393] [DEBUG] [REMOTE ] AIN: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-30T17:07:11.576713] [WARN ] [REMOTE ] AIN: No data returned for month 2025-05 [2025-09-30T17:07:11.576800] [FATAL] [REMOTE ] AIN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:07:11.576869] [FATAL] [MAIN ] AIN: Failed to fetch primary data. [2025-09-30T17:07:11.576931] [WARN ] [MAIN ] AIN: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:07:11.577002] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-30T17:07:11.577067] [DEBUG] [LOCAL ] AIN: No primary data file found to delete. [2025-09-30T17:07:11.577105] [INFO ] [LOCAL ] AIN: Starting deletion of derivative data. [2025-09-30T17:07:11.577342] [DEBUG] [LOCAL ] AIN: Deleted derivative data file. [2025-09-30T17:07:11.577428] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AIN took 11.9s. Estimated remaining: 4h 17m 7s. Rate: 9.0 symbols/min [2025-09-30T17:07:11.766171] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:11.782453] [DEBUG] [LOCAL ] AIO: Loaded 13223 existing records from primary storage. [2025-09-30T17:07:11.782711] [INFO ] [MAIN ] AIO: Loaded 13223 existing records. [2025-09-30T17:07:11.978082] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:11.978473] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-30T17:07:11.978668] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-30T17:07:11.978898] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-30T17:07:11.978959] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-30T17:07:12.257016] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-30T17:07:12.393422] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:12.426756] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T17:07:13.054376] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-30T17:07:13.854403] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-30T17:07:14.086459] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T17:07:14.654333] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-30T17:07:14.839589] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-30T17:07:15.449826] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T17:07:15.454824] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-30T17:07:16.051511] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T17:07:16.063565] [INFO ] [REMOTE ] AIG: Full fetch complete (77376 records). [2025-09-30T17:07:16.063820] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-30T17:07:16.259487] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-30T17:07:16.495909] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-30T17:07:16.495999] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-30T17:07:16.496833] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-30T17:07:16.496907] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-30T17:07:16.498628] [DEBUG] [LOCAL ] AIG: Trimmed 77376 records to 53471 (keeping 200 days of data) [2025-09-30T17:07:16.848753] [DEBUG] [LOCAL ] AIG: Primary data saved (53471 records). [2025-09-30T17:07:16.848895] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-30T17:07:16.848991] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIG took 33.4s. Estimated remaining: 4h 16m 10s. Rate: 9.0 symbols/min [2025-09-30T17:07:17.026374] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:17.054989] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-30T17:07:17.056459] [DEBUG] [LOCAL ] AIR: Loaded 27816 existing records from primary storage. [2025-09-30T17:07:17.056717] [INFO ] [MAIN ] AIR: Loaded 27816 existing records. [2025-09-30T17:07:17.254846] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:17.255057] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-30T17:07:17.255118] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-30T17:07:17.255417] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-30T17:07:17.255477] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-30T17:07:17.670499] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:17.854383] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-30T17:07:17.914258] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-30T17:07:18.014495] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T17:07:18.014886] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T17:07:18.030389] [INFO ] [REMOTE ] AHR: Full fetch complete (70856 records). [2025-09-30T17:07:18.030540] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-30T17:07:18.453620] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-30T17:07:18.453747] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-30T17:07:18.454525] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-30T17:07:18.454588] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-30T17:07:18.456209] [DEBUG] [LOCAL ] AHR: Trimmed 70856 records to 49168 (keeping 200 days of data) [2025-09-30T17:07:18.683313] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-30T17:07:18.778723] [DEBUG] [LOCAL ] AHR: Primary data saved (49168 records). [2025-09-30T17:07:18.778872] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-30T17:07:18.779021] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AHR took 47.1s. Estimated remaining: 4h 13m 18s. Rate: 9.1 symbols/min [2025-09-30T17:07:18.966231] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:18.966449] [DEBUG] [LOCAL ] AIT: No existing data file found in primary storage. [2025-09-30T17:07:18.966509] [WARN ] [MAIN ] AIT: No existing data found, performing full refresh instead. [2025-09-30T17:07:18.966707] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-30T17:07:18.966769] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-30T17:07:18.966827] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-09-30T17:07:18.966863] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-30T17:07:19.210801] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T17:07:19.463823] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-30T17:07:19.476837] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:19.490129] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-30T17:07:20.254411] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-30T17:07:20.731897] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T17:07:21.054412] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-30T17:07:21.854373] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-30T17:07:21.979443] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T17:07:22.054788] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T17:07:22.654373] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-30T17:07:23.294162] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T17:07:23.454381] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-30T17:07:24.254327] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-30T17:07:24.312622] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T17:07:24.690992] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-09-30T17:07:24.703028] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-30T17:07:24.703185] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-30T17:07:25.067332] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-30T17:07:25.133932] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-30T17:07:25.134064] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-30T17:07:25.134912] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-30T17:07:25.134984] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-30T17:07:25.137311] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53750 (keeping 200 days of data) [2025-09-30T17:07:25.478461] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T17:07:25.508387] [DEBUG] [LOCAL ] AI: Primary data saved (53750 records). [2025-09-30T17:07:25.508570] [INFO ] [MAIN ] AI: Full history saved. [2025-09-30T17:07:25.509842] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AI took 44.8s. Estimated remaining: 4h 13m 17s. Rate: 9.1 symbols/min [2025-09-30T17:07:25.757080] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:25.803426] [DEBUG] [LOCAL ] AIV: Loaded 40298 existing records from primary storage. [2025-09-30T17:07:25.803767] [INFO ] [MAIN ] AIV: Loaded 40298 existing records. [2025-09-30T17:07:25.859716] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-30T17:07:25.995921] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:25.996860] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-30T17:07:25.997132] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-30T17:07:25.997635] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-30T17:07:25.997734] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-30T17:07:26.403091] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:26.500338] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T17:07:26.654336] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-30T17:07:26.679940] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T17:07:27.454371] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-30T17:07:27.889003] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T17:07:28.254376] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-30T17:07:28.601847] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T17:07:29.054375] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-30T17:07:29.473207] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T17:07:29.854396] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-30T17:07:30.215660] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T17:07:30.656952] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-30T17:07:30.677455] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T17:07:31.454447] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-30T17:07:32.213564] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T17:07:32.254319] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-30T17:07:32.528684] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T17:07:33.054437] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-30T17:07:33.595696] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T17:07:33.854413] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-30T17:07:34.202473] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T17:07:34.654368] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-30T17:07:35.355257] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T17:07:35.454361] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-30T17:07:35.470224] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T17:07:35.473949] [INFO ] [REMOTE ] AIO: Full fetch complete (20003 records). [2025-09-30T17:07:35.474059] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-30T17:07:35.474502] [FATAL] [VALIDATOR ] AIO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:07:35.474589] [FATAL] [MAIN ] AIO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:07:35.474684] [WARN ] [MAIN ] AIO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:07:35.474765] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-30T17:07:35.474834] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-09-30T17:07:35.474878] [INFO ] [LOCAL ] AIO: Starting deletion of derivative data. [2025-09-30T17:07:35.475155] [DEBUG] [LOCAL ] AIO: Deleted derivative data file. [2025-09-30T17:07:35.475249] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIO took 23.9s. Estimated remaining: 4h 15m 4s. Rate: 9.0 symbols/min [2025-09-30T17:07:35.694303] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:35.740903] [DEBUG] [LOCAL ] AIZ: Loaded 29952 existing records from primary storage. [2025-09-30T17:07:35.741225] [INFO ] [MAIN ] AIZ: Loaded 29952 existing records. [2025-09-30T17:07:35.938846] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:35.939077] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-30T17:07:35.939126] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-30T17:07:35.939434] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-30T17:07:35.939493] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-30T17:07:36.257826] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-30T17:07:36.360700] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:36.386205] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T17:07:37.054401] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-30T17:07:37.825158] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T17:07:37.854310] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-30T17:07:38.133109] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T17:07:38.654370] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-30T17:07:38.997127] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-30T17:07:39.454407] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-30T17:07:39.860230] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T17:07:40.254361] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-30T17:07:40.793103] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T17:07:41.054398] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-30T17:07:41.632152] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T17:07:41.854400] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-30T17:07:42.474945] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T17:07:42.654371] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-30T17:07:43.157636] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T17:07:43.454373] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-30T17:07:43.675142] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T17:07:44.254369] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-30T17:07:44.545081] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T17:07:45.054368] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-30T17:07:45.698525] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T17:07:45.854419] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-30T17:07:46.116747] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T17:07:46.654376] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-30T17:07:47.229788] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T17:07:47.237470] [INFO ] [REMOTE ] AIR: Full fetch complete (38675 records). [2025-09-30T17:07:47.237686] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-30T17:07:47.459492] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-30T17:07:47.656552] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-30T17:07:47.656664] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-30T17:07:47.657111] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-30T17:07:47.657156] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-30T17:07:47.658192] [DEBUG] [LOCAL ] AIR: Trimmed 38675 records to 27931 (keeping 200 days of data) [2025-09-30T17:07:47.825912] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T17:07:47.870164] [DEBUG] [LOCAL ] AIR: Primary data saved (27931 records). [2025-09-30T17:07:47.870447] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-30T17:07:47.870566] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIR took 31.0s. Estimated remaining: 4h 18m 9s. Rate: 8.9 symbols/min [2025-09-30T17:07:48.053147] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:48.059975] [DEBUG] [LOCAL ] AIZN: Loaded 3911 existing records from primary storage. [2025-09-30T17:07:48.060183] [INFO ] [MAIN ] AIZN: Loaded 3911 existing records. [2025-09-30T17:07:48.256057] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:48.256675] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-30T17:07:48.256171] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-30T17:07:48.256797] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-30T17:07:48.258102] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-30T17:07:48.258163] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-30T17:07:48.665247] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:48.686703] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-30T17:07:49.054410] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-30T17:07:49.414916] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T17:07:49.854380] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-30T17:07:50.078014] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T17:07:50.349748] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-30T17:07:50.654414] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-30T17:07:51.454411] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-30T17:07:51.817487] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T17:07:51.822031] [INFO ] [REMOTE ] AIT: Full fetch complete (39457 records). [2025-09-30T17:07:51.822136] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-30T17:07:52.148409] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T17:07:52.262909] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-30T17:07:52.263029] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-30T17:07:52.260380] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-30T17:07:52.263491] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-30T17:07:52.263914] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-30T17:07:52.265738] [DEBUG] [LOCAL ] AIT: Trimmed 39457 records to 27638 (keeping 200 days of data) [2025-09-30T17:07:52.456478] [DEBUG] [LOCAL ] AIT: Primary data saved (27638 records). [2025-09-30T17:07:52.456633] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-30T17:07:52.456760] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIT took 33.7s. Estimated remaining: 4h 16m 52s. Rate: 9.0 symbols/min [2025-09-30T17:07:52.662417] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:07:52.708947] [DEBUG] [LOCAL ] AJG: Loaded 46911 existing records from primary storage. [2025-09-30T17:07:52.709280] [INFO ] [MAIN ] AJG: Loaded 46911 existing records. [2025-09-30T17:07:52.846505] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T17:07:52.921044] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:07:52.921298] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-30T17:07:52.921388] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-30T17:07:52.921762] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-30T17:07:52.921823] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-30T17:07:53.068738] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-30T17:07:53.305940] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:07:53.854403] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-30T17:07:54.654399] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-30T17:07:54.746113] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T17:07:55.397232] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T17:07:55.454349] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-30T17:07:55.816512] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-30T17:07:56.108042] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T17:07:56.254357] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-30T17:07:57.054399] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-30T17:07:57.618889] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T17:07:57.854335] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-30T17:07:57.943673] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T17:07:58.654387] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-30T17:07:59.459453] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-30T17:07:59.471508] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T17:07:59.482109] [INFO ] [REMOTE ] AIV: Full fetch complete (59596 records). [2025-09-30T17:07:59.482272] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-30T17:07:59.886570] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-30T17:07:59.886746] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-30T17:07:59.887477] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-30T17:07:59.887563] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-30T17:07:59.906799] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T17:07:59.906917] [DEBUG] [LOCAL ] AIV: Trimmed 59596 records to 40347 (keeping 200 days of data) [2025-09-30T17:08:00.147318] [DEBUG] [LOCAL ] AIV: Primary data saved (40347 records). [2025-09-30T17:08:00.147490] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-30T17:08:00.148323] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 34.6s. Estimated remaining: 4h 17m 18s. Rate: 8.9 symbols/min [2025-09-30T17:08:00.256955] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-30T17:08:00.331349] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:08:00.331559] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-30T17:08:00.331618] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-30T17:08:00.331791] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-30T17:08:00.331850] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-30T17:08:00.331900] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-30T17:08:00.331940] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-30T17:08:00.713881] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:08:00.869735] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T17:08:00.980905] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T17:08:01.054352] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-30T17:08:01.854357] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-30T17:08:02.367552] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-30T17:08:02.484699] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T17:08:02.654361] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-30T17:08:03.454354] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-30T17:08:04.254324] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-30T17:08:04.449436] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T17:08:04.686805] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-30T17:08:05.054345] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-30T17:08:05.076475] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T17:08:05.640755] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T17:08:05.854374] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-30T17:08:06.170441] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-30T17:08:06.654368] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-30T17:08:07.454387] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-30T17:08:07.981065] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T17:08:07.987504] [INFO ] [REMOTE ] AIZ: Full fetch complete (42891 records). [2025-09-30T17:08:07.987620] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-30T17:08:08.103134] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T17:08:08.260411] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-30T17:08:08.416543] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-30T17:08:08.416622] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-30T17:08:08.417168] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-30T17:08:08.417230] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-30T17:08:08.418454] [DEBUG] [LOCAL ] AIZ: Trimmed 42891 records to 29883 (keeping 200 days of data) [2025-09-30T17:08:08.632517] [DEBUG] [LOCAL ] AIZ: Primary data saved (29883 records). [2025-09-30T17:08:08.632715] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-30T17:08:08.633936] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZ took 33.2s. Estimated remaining: 4h 18m 7s. Rate: 8.9 symbols/min [2025-09-30T17:08:08.809693] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-30T17:08:08.832454] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:08:08.898845] [DEBUG] [LOCAL ] AKR: Loaded 45716 existing records from primary storage. [2025-09-30T17:08:08.899245] [INFO ] [MAIN ] AKR: Loaded 45716 existing records. [2025-09-30T17:08:09.059479] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-30T17:08:09.104920] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:08:09.105130] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-30T17:08:09.105182] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-30T17:08:09.105512] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-30T17:08:09.105573] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-30T17:08:09.496206] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:08:09.804404] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T17:08:09.805987] [INFO ] [REMOTE ] AIZN: Full fetch complete (5891 records). [2025-09-30T17:08:09.806062] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-30T17:08:09.859497] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-30T17:08:10.214223] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-30T17:08:10.214307] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-30T17:08:10.214494] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-30T17:08:10.214535] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-30T17:08:10.215107] [DEBUG] [LOCAL ] AIZN: Trimmed 5891 records to 4008 (keeping 200 days of data) [2025-09-30T17:08:10.242459] [DEBUG] [LOCAL ] AIZN: Primary data saved (4008 records). [2025-09-30T17:08:10.242608] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-30T17:08:10.242730] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZN took 22.4s. Estimated remaining: 4h 15m 19s. Rate: 9.0 symbols/min [2025-09-30T17:08:10.450210] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:08:10.494569] [DEBUG] [LOCAL ] AL: Loaded 44176 existing records from primary storage. [2025-09-30T17:08:10.494958] [INFO ] [MAIN ] AL: Loaded 44176 existing records. [2025-09-30T17:08:10.660454] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-30T17:08:10.694794] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:08:10.695173] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-30T17:08:10.695222] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-30T17:08:10.695473] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-30T17:08:10.695531] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-30T17:08:11.091018] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:08:11.454412] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-30T17:08:11.603289] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T17:08:11.804487] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T17:08:12.254379] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-30T17:08:12.525761] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T17:08:12.675708] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-30T17:08:13.054426] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-30T17:08:13.854373] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-30T17:08:14.490588] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T17:08:14.654399] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-30T17:08:15.156665] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T17:08:15.156930] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T17:08:15.454367] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-30T17:08:15.903938] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T17:08:16.254375] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-30T17:08:16.568260] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-30T17:08:17.054408] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-30T17:08:17.854366] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-30T17:08:18.407000] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T17:08:18.654422] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-30T17:08:19.454403] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-30T17:08:19.584400] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T17:08:19.788074] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-30T17:08:20.147906] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:08:20.254356] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-30T17:08:20.667627] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-30T17:08:20.668510] [INFO ] [REMOTE ] AKA: Full fetch complete (2426 records). [2025-09-30T17:08:20.668586] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-30T17:08:20.909142] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T17:08:20.909397] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:08:20.909474] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:08:20.909547] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-30T17:08:20.909629] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-30T17:08:20.909741] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-30T17:08:20.909819] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-30T17:08:20.909913] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AKA took 20.8s. Estimated remaining: 4h 17m 17s. Rate: 8.9 symbols/min [2025-09-30T17:08:21.059521] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-30T17:08:21.187258] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:08:21.249176] [DEBUG] [LOCAL ] ALB: Loaded 53226 existing records from primary storage. [2025-09-30T17:08:21.249575] [INFO ] [MAIN ] ALB: Loaded 53226 existing records. [2025-09-30T17:08:21.439089] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:08:21.439315] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-30T17:08:21.439400] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-30T17:08:21.439749] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-30T17:08:21.439809] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-30T17:08:21.859500] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-30T17:08:21.935950] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:08:22.337253] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-30T17:08:22.654419] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-30T17:08:23.270920] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T17:08:23.454400] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-30T17:08:24.095706] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T17:08:24.254380] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-30T17:08:25.033224] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T17:08:25.054353] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-30T17:08:25.854382] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-30T17:08:26.183637] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T17:08:26.654345] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-30T17:08:26.687402] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T17:08:27.381034] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T17:08:27.454402] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-30T17:08:28.254400] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-30T17:08:28.570278] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-30T17:08:29.054369] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-30T17:08:29.170533] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T17:08:29.694762] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T17:08:29.705591] [INFO ] [REMOTE ] AJG: Full fetch complete (69667 records). [2025-09-30T17:08:29.705789] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-30T17:08:29.864394] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-30T17:08:30.141361] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-30T17:08:30.141462] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-30T17:08:30.142182] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-30T17:08:30.142258] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-30T17:08:30.143821] [DEBUG] [LOCAL ] AJG: Trimmed 69667 records to 46898 (keeping 200 days of data) [2025-09-30T17:08:30.461874] [DEBUG] [LOCAL ] AJG: Primary data saved (46898 records). [2025-09-30T17:08:30.462057] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-30T17:08:30.462160] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AJG took 38.0s. Estimated remaining: 4h 18m 37s. Rate: 8.9 symbols/min [2025-09-30T17:08:30.681765] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-30T17:08:30.684581] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:08:30.734436] [DEBUG] [LOCAL ] ALC: Loaded 50776 existing records from primary storage. [2025-09-30T17:08:30.734959] [INFO ] [MAIN ] ALC: Loaded 50776 existing records. [2025-09-30T17:08:30.883423] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T17:08:30.992530] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:08:30.992815] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-30T17:08:30.992870] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-30T17:08:30.993268] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-30T17:08:30.993330] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-30T17:08:31.424541] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:08:31.450639] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T17:08:31.459193] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-30T17:08:32.254411] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-30T17:08:32.333570] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:08:32.830811] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T17:08:33.054400] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-30T17:08:33.854367] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-30T17:08:33.936827] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T17:08:34.534942] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T17:08:34.654375] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-30T17:08:35.454327] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-30T17:08:35.492150] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T17:08:36.177109] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T17:08:36.254425] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-30T17:08:37.007940] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:08:37.054370] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-30T17:08:37.854338] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-30T17:08:38.005563] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T17:08:38.020414] [INFO ] [REMOTE ] AL: Full fetch complete (62519 records). [2025-09-30T17:08:38.020599] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-30T17:08:38.462001] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-30T17:08:38.462161] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-30T17:08:38.462932] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-30T17:08:38.463001] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-30T17:08:38.464398] [DEBUG] [LOCAL ] AL: Trimmed 62519 records to 44215 (keeping 200 days of data) [2025-09-30T17:08:38.662170] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-30T17:08:38.730011] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T17:08:38.800581] [DEBUG] [LOCAL ] AL: Primary data saved (44215 records). [2025-09-30T17:08:38.800759] [INFO ] [MAIN ] AL: Full history saved. [2025-09-30T17:08:38.800858] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AL took 28.6s. Estimated remaining: 4h 19m 18s. Rate: 8.9 symbols/min [2025-09-30T17:08:38.987172] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:08:39.016607] [DEBUG] [LOCAL ] ALE: Loaded 30436 existing records from primary storage. [2025-09-30T17:08:39.017065] [INFO ] [MAIN ] ALE: Loaded 30436 existing records. [2025-09-30T17:08:39.208182] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:08:39.208438] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-30T17:08:39.208488] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-30T17:08:39.208755] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-30T17:08:39.208813] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-30T17:08:39.464131] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-30T17:08:39.592948] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:08:39.841170] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T17:08:40.217379] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T17:08:40.254363] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-30T17:08:41.054342] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-30T17:08:41.228387] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T17:08:41.854361] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-30T17:08:41.910229] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T17:08:42.654393] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-30T17:08:43.077213] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T17:08:43.114805] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T17:08:43.454363] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-30T17:08:44.254359] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-30T17:08:44.412204] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:08:45.008245] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T17:08:45.054313] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-30T17:08:45.854342] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-30T17:08:45.963288] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T17:08:46.654379] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-30T17:08:46.872747] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-30T17:08:47.262419] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T17:08:47.454367] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-30T17:08:48.052379] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T17:08:48.062939] [INFO ] [REMOTE ] AKR: Full fetch complete (65480 records). [2025-09-30T17:08:48.063143] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-30T17:08:48.259622] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-30T17:08:48.487322] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-30T17:08:48.487495] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-30T17:08:48.488366] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-30T17:08:48.488431] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-30T17:08:48.489815] [DEBUG] [LOCAL ] AKR: Trimmed 65480 records to 45732 (keeping 200 days of data) [2025-09-30T17:08:48.791302] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T17:08:48.804476] [DEBUG] [LOCAL ] AKR: Primary data saved (45732 records). [2025-09-30T17:08:48.804570] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-30T17:08:48.805600] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AKR took 40.2s. Estimated remaining: 4h 20m 47s. Rate: 8.8 symbols/min [2025-09-30T17:08:49.054381] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-30T17:08:49.854353] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-30T17:08:50.039203] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T17:08:50.654438] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-30T17:08:51.082226] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T17:08:51.267491] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-30T17:08:51.454375] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-30T17:08:52.254386] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-30T17:08:52.317080] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T17:08:52.655844] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T17:08:53.054363] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-30T17:08:53.854374] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-30T17:08:54.473232] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-30T17:08:54.535387] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T17:08:54.654365] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-30T17:08:55.454377] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-30T17:08:55.692119] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T17:08:56.254369] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-30T17:08:56.619263] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T17:08:56.770170] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T17:08:56.782039] [INFO ] [REMOTE ] ALB: Full fetch complete (76812 records). [2025-09-30T17:08:56.782205] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-30T17:08:57.060784] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-30T17:08:57.217743] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-30T17:08:57.217840] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-30T17:08:57.218699] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-30T17:08:57.218771] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-30T17:08:57.220758] [DEBUG] [LOCAL ] ALB: Trimmed 76812 records to 53236 (keeping 200 days of data) [2025-09-30T17:08:57.555877] [DEBUG] [LOCAL ] ALB: Primary data saved (53236 records). [2025-09-30T17:08:57.556036] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-30T17:08:57.556808] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALB took 36.6s. Estimated remaining: 4h 21m 37s. Rate: 8.8 symbols/min [2025-09-30T17:08:57.920236] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T17:08:57.931728] [INFO ] [REMOTE ] ALC: Full fetch complete (72862 records). [2025-09-30T17:08:57.931900] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-30T17:08:58.294198] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T17:08:58.339571] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-30T17:08:58.403478] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-30T17:08:58.403567] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-30T17:08:58.404328] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-30T17:08:58.404401] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-30T17:08:58.406239] [DEBUG] [LOCAL ] ALC: Trimmed 72862 records to 50789 (keeping 200 days of data) [2025-09-30T17:08:58.726528] [DEBUG] [LOCAL ] ALC: Primary data saved (50789 records). [2025-09-30T17:08:58.726705] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-30T17:08:58.726805] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALC took 28.3s. Estimated remaining: 4h 18m 46s. Rate: 8.9 symbols/min [2025-09-30T17:08:59.735925] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T17:08:59.744301] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-30T17:09:00.880891] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T17:09:00.889100] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-30T17:09:02.110257] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T17:09:02.117996] [INFO ] [REMOTE ] ALE: Full fetch complete (42425 records). [2025-09-30T17:09:02.118113] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-30T17:09:02.118784] [FATAL] [VALIDATOR ] ALE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:09:02.118869] [FATAL] [MAIN ] ALE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:09:02.118913] [WARN ] [MAIN ] ALE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:09:02.118986] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-30T17:09:02.119054] [DEBUG] [LOCAL ] ALE: No primary data file found to delete. [2025-09-30T17:09:02.119090] [INFO ] [LOCAL ] ALE: Starting deletion of derivative data. [2025-09-30T17:09:02.119412] [DEBUG] [LOCAL ] ALE: Deleted derivative data file. [2025-09-30T17:09:02.119542] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALE took 23.3s. Estimated remaining: 4h 17m 2s. Rate: 8.9 symbols/min [2025-09-30T17:09:02.843671] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:02.895489] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:02.934489] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:02.940333] [DEBUG] [LOCAL ] ALK: No existing data file found in primary storage. [2025-09-30T17:09:02.939200] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:02.940493] [WARN ] [MAIN ] ALK: No existing data found, performing full refresh instead. [2025-09-30T17:09:02.942147] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-30T17:09:02.942238] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-30T17:09:02.942313] [DEBUG] [LOCAL ] ALK: No primary data file found to delete. [2025-09-30T17:09:02.942352] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-30T17:09:03.084600] [DEBUG] [LOCAL ] ALG: Loaded 10273 existing records from primary storage. [2025-09-30T17:09:03.085966] [INFO ] [MAIN ] ALG: Loaded 10273 existing records. [2025-09-30T17:09:03.219768] [DEBUG] [LOCAL ] ALEX: Loaded 31165 existing records from primary storage. [2025-09-30T17:09:03.282106] [INFO ] [MAIN ] ALEX: Loaded 31165 existing records. [2025-09-30T17:09:03.651764] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:03.704697] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-30T17:09:03.716365] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-30T17:09:03.695783] [DEBUG] [LOCAL ] ALIT: Loaded 52760 existing records from primary storage. [2025-09-30T17:09:03.747611] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-30T17:09:03.777142] [INFO ] [MAIN ] ALIT: Loaded 52760 existing records. [2025-09-30T17:09:03.777329] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-30T17:09:03.967398] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:03.978995] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:04.016189] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-30T17:09:04.045761] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-30T17:09:04.027046] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-30T17:09:04.067610] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-30T17:09:04.125610] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-30T17:09:04.368900] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:04.486736] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-30T17:09:04.545078] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-30T17:09:04.573285] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-30T17:09:04.573410] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-30T17:09:04.900971] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:04.934879] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-30T17:09:05.226534] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:05.240189] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-30T17:09:05.344965] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:05.345354] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-30T17:09:05.883368] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T17:09:05.895915] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-30T17:09:05.905530] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T17:09:05.909031] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-30T17:09:06.721722] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:09:06.732099] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-30T17:09:06.757084] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T17:09:06.760603] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-30T17:09:06.791299] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T17:09:06.803334] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-30T17:09:07.386143] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:09:07.454386] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-30T17:09:07.632789] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T17:09:07.944308] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T17:09:08.254405] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-30T17:09:08.485378] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T17:09:09.054380] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-30T17:09:09.276036] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T17:09:09.340422] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T17:09:09.854386] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-30T17:09:10.491355] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T17:09:10.654372] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-30T17:09:11.454370] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-30T17:09:11.529175] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:09:12.254458] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-30T17:09:12.316462] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T17:09:12.890634] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T17:09:13.054369] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-30T17:09:13.165242] [DEBUG] [REMOTE ] ALIT: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-30T17:09:13.165603] [WARN ] [REMOTE ] ALIT: No data returned for month 2025-04 [2025-09-30T17:09:13.165706] [FATAL] [REMOTE ] ALIT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:09:13.165793] [FATAL] [MAIN ] ALIT: Failed to fetch primary data. [2025-09-30T17:09:13.165833] [WARN ] [MAIN ] ALIT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:09:13.165902] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-30T17:09:13.165969] [DEBUG] [LOCAL ] ALIT: No primary data file found to delete. [2025-09-30T17:09:13.166006] [INFO ] [LOCAL ] ALIT: Starting deletion of derivative data. [2025-09-30T17:09:13.166465] [DEBUG] [LOCAL ] ALIT: Deleted derivative data file. [2025-09-30T17:09:13.166568] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALIT took 11.0s. Estimated remaining: 4h 18m 57s. Rate: 8.8 symbols/min [2025-09-30T17:09:13.299894] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T17:09:13.377788] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:13.378026] [DEBUG] [LOCAL ] ALL: No existing data file found in primary storage. [2025-09-30T17:09:13.378073] [WARN ] [MAIN ] ALL: No existing data found, performing full refresh instead. [2025-09-30T17:09:13.378189] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-30T17:09:13.378234] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-30T17:09:13.378283] [DEBUG] [LOCAL ] ALL: No primary data file found to delete. [2025-09-30T17:09:13.378356] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-30T17:09:13.764778] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:13.854377] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-30T17:09:14.654404] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-30T17:09:15.454383] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-30T17:09:15.535251] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T17:09:16.253048] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T17:09:16.262883] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-30T17:09:16.594294] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T17:09:17.054436] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-30T17:09:17.854416] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-30T17:09:18.202802] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-30T17:09:18.254589] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T17:09:18.654356] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-30T17:09:19.454365] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-30T17:09:19.569915] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T17:09:19.831686] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T17:09:20.224730] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T17:09:20.254324] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-30T17:09:21.054376] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-30T17:09:21.694183] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T17:09:21.854379] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-30T17:09:22.457080] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T17:09:22.654426] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-30T17:09:22.768175] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T17:09:23.454385] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-30T17:09:24.239241] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T17:09:24.254352] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-30T17:09:24.278159] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T17:09:25.054601] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-30T17:09:25.850113] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T17:09:25.860912] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-30T17:09:26.164740] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T17:09:26.654419] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-30T17:09:26.741541] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T17:09:27.454400] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-30T17:09:27.829967] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T17:09:27.837232] [INFO ] [REMOTE ] ALEX: Full fetch complete (44587 records). [2025-09-30T17:09:27.837352] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-30T17:09:28.260127] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-30T17:09:28.259572] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-30T17:09:28.260260] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-30T17:09:28.263191] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-30T17:09:28.263284] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-30T17:09:28.264713] [DEBUG] [LOCAL ] ALEX: Trimmed 44587 records to 31102 (keeping 200 days of data) [2025-09-30T17:09:28.484405] [DEBUG] [LOCAL ] ALEX: Primary data saved (31102 records). [2025-09-30T17:09:28.484573] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-30T17:09:28.484779] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALEX took 26.4s. Estimated remaining: 4h 22m 49s. Rate: 8.7 symbols/min [2025-09-30T17:09:28.678248] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:28.737499] [DEBUG] [LOCAL ] ALLE: Loaded 44821 existing records from primary storage. [2025-09-30T17:09:28.737915] [INFO ] [MAIN ] ALLE: Loaded 44821 existing records. [2025-09-30T17:09:28.929916] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:28.930234] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-30T17:09:28.930297] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-30T17:09:28.930613] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-30T17:09:28.930720] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-30T17:09:29.054963] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-30T17:09:29.346923] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:29.375847] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T17:09:29.817258] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T17:09:29.854358] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-30T17:09:30.052487] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T17:09:30.056235] [INFO ] [REMOTE ] ALG: Full fetch complete (15867 records). [2025-09-30T17:09:30.056355] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-30T17:09:30.460166] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-30T17:09:30.460307] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-30T17:09:30.460558] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-30T17:09:30.460599] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-30T17:09:30.462004] [DEBUG] [LOCAL ] ALG: Trimmed 15867 records to 10240 (keeping 200 days of data) [2025-09-30T17:09:30.536558] [DEBUG] [LOCAL ] ALG: Primary data saved (10240 records). [2025-09-30T17:09:30.536728] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-30T17:09:30.536840] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALG took 28.4s. Estimated remaining: 4h 20m 28s. Rate: 8.8 symbols/min [2025-09-30T17:09:30.659572] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-30T17:09:30.723521] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:30.797670] [DEBUG] [LOCAL ] ALLY: Loaded 53217 existing records from primary storage. [2025-09-30T17:09:30.798047] [INFO ] [MAIN ] ALLY: Loaded 53217 existing records. [2025-09-30T17:09:30.995566] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:30.995872] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-30T17:09:30.995930] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-30T17:09:30.996533] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-30T17:09:30.996631] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-30T17:09:31.394777] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:31.454410] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-30T17:09:31.620500] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T17:09:31.632758] [INFO ] [REMOTE ] ALK: Full fetch complete (76835 records). [2025-09-30T17:09:31.632967] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-30T17:09:32.073206] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-30T17:09:32.073381] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-30T17:09:32.074228] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-30T17:09:32.074325] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-30T17:09:32.077955] [DEBUG] [LOCAL ] ALK: Trimmed 76835 records to 53053 (keeping 200 days of data) [2025-09-30T17:09:32.277489] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-30T17:09:32.438580] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T17:09:32.473688] [DEBUG] [LOCAL ] ALK: Primary data saved (53053 records). [2025-09-30T17:09:32.473865] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-30T17:09:32.473976] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALK took 30.4s. Estimated remaining: 4h 18m 8s. Rate: 8.9 symbols/min [2025-09-30T17:09:32.654241] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:32.697676] [DEBUG] [LOCAL ] ALSN: Loaded 43263 existing records from primary storage. [2025-09-30T17:09:32.698071] [INFO ] [MAIN ] ALSN: Loaded 43263 existing records. [2025-09-30T17:09:32.895703] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:32.895912] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-30T17:09:32.895960] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-30T17:09:32.896302] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-30T17:09:32.896367] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-30T17:09:33.060551] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-30T17:09:33.301616] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:33.337380] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T17:09:33.854374] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-30T17:09:34.180276] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T17:09:34.654358] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-30T17:09:34.704953] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T17:09:35.454340] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-30T17:09:35.692441] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T17:09:36.254385] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-30T17:09:36.396600] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T17:09:37.058215] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-30T17:09:37.063216] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T17:09:37.621598] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T17:09:37.854368] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-30T17:09:38.654352] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-30T17:09:38.758802] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:09:39.454340] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-30T17:09:39.490125] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T17:09:40.024434] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:09:40.254374] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-30T17:09:41.054408] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-30T17:09:41.200378] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T17:09:41.655528] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T17:09:41.854363] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-30T17:09:42.593423] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T17:09:42.654353] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-30T17:09:43.433387] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T17:09:43.454442] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-30T17:09:44.209266] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T17:09:44.254345] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-30T17:09:44.779156] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T17:09:45.054375] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-30T17:09:45.854386] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-30T17:09:46.180062] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T17:09:46.654365] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-30T17:09:46.745390] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T17:09:47.347197] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T17:09:47.454364] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-30T17:09:48.254334] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-30T17:09:48.440391] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T17:09:48.980691] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T17:09:49.054377] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-30T17:09:49.763907] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T17:09:49.854350] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-30T17:09:50.659507] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-30T17:09:50.677300] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T17:09:51.454341] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-30T17:09:51.701749] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T17:09:52.228985] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T17:09:52.254311] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-30T17:09:52.842370] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T17:09:52.852276] [INFO ] [REMOTE ] ALLE: Full fetch complete (64737 records). [2025-09-30T17:09:52.852470] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-30T17:09:53.055699] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-30T17:09:53.315794] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-30T17:09:53.315903] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-30T17:09:53.316668] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-30T17:09:53.316745] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-30T17:09:53.318320] [DEBUG] [LOCAL ] ALLE: Trimmed 64737 records to 44763 (keeping 200 days of data) [2025-09-30T17:09:53.477714] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T17:09:53.662485] [DEBUG] [LOCAL ] ALLE: Primary data saved (44763 records). [2025-09-30T17:09:53.662685] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-30T17:09:53.664165] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALLE took 25.2s. Estimated remaining: 4h 24m 29s. Rate: 8.6 symbols/min [2025-09-30T17:09:53.862831] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-30T17:09:53.868460] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:09:53.904996] [DEBUG] [LOCAL ] ALTG: Loaded 23671 existing records from primary storage. [2025-09-30T17:09:53.905325] [INFO ] [MAIN ] ALTG: Loaded 23671 existing records. [2025-09-30T17:09:54.112137] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:09:54.112384] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-30T17:09:54.112478] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-30T17:09:54.112869] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-30T17:09:54.112934] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-30T17:09:54.514173] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:09:54.654376] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-30T17:09:55.026781] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T17:09:55.454361] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-30T17:09:55.633476] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T17:09:55.814701] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T17:09:56.254371] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-30T17:09:57.054366] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-30T17:09:57.101822] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T17:09:57.208261] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T17:09:57.854409] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-30T17:09:58.654347] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-30T17:09:58.841737] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T17:09:59.061133] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T17:09:59.454380] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-30T17:10:00.254340] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-30T17:10:00.458497] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T17:10:00.472153] [INFO ] [REMOTE ] ALL: Full fetch complete (72485 records). [2025-09-30T17:10:00.472289] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-30T17:10:00.924693] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-30T17:10:00.924815] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-30T17:10:00.925733] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-30T17:10:00.925911] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-30T17:10:00.927717] [DEBUG] [LOCAL ] ALL: Trimmed 72485 records to 50072 (keeping 200 days of data) [2025-09-30T17:10:01.054374] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-30T17:10:01.215859] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T17:10:01.241995] [INFO ] [REMOTE ] ALLY: Full fetch complete (76906 records). [2025-09-30T17:10:01.247278] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-30T17:10:01.840893] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-30T17:10:01.844861] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-30T17:10:01.846876] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-30T17:10:01.851140] [DEBUG] [LOCAL ] ALL: Primary data saved (50072 records). [2025-09-30T17:10:01.848435] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-30T17:10:01.851347] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-30T17:10:01.851971] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALL took 48.7s. Estimated remaining: 4h 24m 55s. Rate: 8.6 symbols/min [2025-09-30T17:10:01.927865] [DEBUG] [LOCAL ] ALLY: Trimmed 76906 records to 53219 (keeping 200 days of data) [2025-09-30T17:10:02.198006] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:02.213260] [DEBUG] [LOCAL ] ALUR: No existing data file found in primary storage. [2025-09-30T17:10:02.217165] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T17:10:02.213527] [WARN ] [MAIN ] ALUR: No existing data found, performing full refresh instead. [2025-09-30T17:10:02.236269] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-30T17:10:02.245709] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-30T17:10:02.249734] [DEBUG] [LOCAL ] ALUR: No primary data file found to delete. [2025-09-30T17:10:02.249574] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T17:10:02.252126] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-30T17:10:02.258753] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-30T17:10:02.655285] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-30T17:10:02.815500] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:02.918352] [DEBUG] [LOCAL ] ALLY: Primary data saved (53219 records). [2025-09-30T17:10:02.918523] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-30T17:10:02.919400] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLY took 32.4s. Estimated remaining: 4h 22m 14s. Rate: 8.7 symbols/min [2025-09-30T17:10:03.104194] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:03.155972] [DEBUG] [LOCAL ] ALV: Loaded 42485 existing records from primary storage. [2025-09-30T17:10:03.156280] [INFO ] [MAIN ] ALV: Loaded 42485 existing records. [2025-09-30T17:10:03.358545] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:03.358764] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-30T17:10:03.358817] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-30T17:10:03.359258] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-30T17:10:03.359318] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-30T17:10:03.454697] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-30T17:10:03.782787] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:03.811690] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T17:10:03.836797] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T17:10:04.254357] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-30T17:10:05.054360] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-30T17:10:05.217857] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T17:10:05.854377] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-30T17:10:05.930838] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T17:10:06.520946] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T17:10:06.654369] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-30T17:10:07.223263] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:10:07.454327] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-30T17:10:07.472176] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T17:10:08.254385] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-30T17:10:08.600268] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T17:10:09.054411] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-30T17:10:09.841535] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T17:10:09.851771] [INFO ] [REMOTE ] ALSN: Full fetch complete (62153 records). [2025-09-30T17:10:09.851940] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-30T17:10:09.864770] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-30T17:10:10.304959] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-30T17:10:10.305062] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-30T17:10:10.305830] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-30T17:10:10.305897] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-30T17:10:10.307382] [DEBUG] [LOCAL ] ALSN: Trimmed 62153 records to 43237 (keeping 200 days of data) [2025-09-30T17:10:10.593336] [DEBUG] [LOCAL ] ALSN: Primary data saved (43237 records). [2025-09-30T17:10:10.593481] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-30T17:10:10.593584] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALSN took 38.1s. Estimated remaining: 4h 22m 27s. Rate: 8.7 symbols/min [2025-09-30T17:10:10.660956] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-30T17:10:10.792198] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:10.818363] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T17:10:10.834013] [DEBUG] [LOCAL ] ALX: Loaded 6134 existing records from primary storage. [2025-09-30T17:10:10.834278] [INFO ] [MAIN ] ALX: Loaded 6134 existing records. [2025-09-30T17:10:11.037694] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:11.038062] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-30T17:10:11.038214] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-30T17:10:11.049680] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-30T17:10:11.050180] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-30T17:10:11.050607] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T17:10:11.472512] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-30T17:10:11.489713] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:11.607929] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T17:10:12.254401] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-30T17:10:12.834852] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T17:10:12.889690] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-30T17:10:13.054385] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-30T17:10:13.594133] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T17:10:13.854365] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-30T17:10:14.346213] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-30T17:10:14.654422] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-30T17:10:15.454340] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-30T17:10:15.514716] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T17:10:15.960419] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T17:10:16.254399] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-30T17:10:17.054416] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-30T17:10:17.830614] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T17:10:17.854396] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-30T17:10:18.373858] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T17:10:18.379421] [INFO ] [REMOTE ] ALTG: Full fetch complete (33640 records). [2025-09-30T17:10:18.379552] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-30T17:10:18.659478] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-30T17:10:18.786349] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-30T17:10:18.786432] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-30T17:10:18.786857] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-30T17:10:18.786961] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-30T17:10:18.787968] [DEBUG] [LOCAL ] ALTG: Trimmed 33640 records to 23519 (keeping 200 days of data) [2025-09-30T17:10:18.925583] [DEBUG] [LOCAL ] ALTG: Primary data saved (23519 records). [2025-09-30T17:10:18.925751] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-30T17:10:18.925846] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALTG took 25.3s. Estimated remaining: 4h 22m 57s. Rate: 8.7 symbols/min [2025-09-30T17:10:19.113918] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:19.179531] [DEBUG] [LOCAL ] AM: Loaded 52096 existing records from primary storage. [2025-09-30T17:10:19.180148] [INFO ] [MAIN ] AM: Loaded 52096 existing records. [2025-09-30T17:10:19.274359] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T17:10:19.408009] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:19.408373] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-30T17:10:19.408580] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-30T17:10:19.409125] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-30T17:10:19.409188] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-30T17:10:19.458987] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-30T17:10:19.635669] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T17:10:19.899829] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:20.149798] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T17:10:20.254384] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-30T17:10:21.054389] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-30T17:10:21.854421] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-30T17:10:21.956932] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-30T17:10:22.152589] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T17:10:22.654373] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-30T17:10:23.454363] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-30T17:10:23.472724] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T17:10:23.666801] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T17:10:24.254443] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-30T17:10:24.950941] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T17:10:25.054424] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-30T17:10:25.854436] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-30T17:10:25.955339] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T17:10:25.983019] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T17:10:26.654388] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-30T17:10:26.697087] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T17:10:27.454393] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-30T17:10:28.254331] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-30T17:10:28.498881] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T17:10:28.535104] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T17:10:29.054391] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-30T17:10:29.854356] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-30T17:10:30.017612] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T17:10:30.654362] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-30T17:10:30.784688] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T17:10:30.968276] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T17:10:31.406256] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:10:31.454389] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-30T17:10:32.254418] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-30T17:10:32.971692] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T17:10:32.986820] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T17:10:32.986531] [INFO ] [REMOTE ] ALV: Full fetch complete (61865 records). [2025-09-30T17:10:32.989329] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-30T17:10:33.059612] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-30T17:10:33.422748] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-30T17:10:33.422842] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-30T17:10:33.423487] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-30T17:10:33.423537] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-30T17:10:33.425022] [DEBUG] [LOCAL ] ALV: Trimmed 61865 records to 42426 (keeping 200 days of data) [2025-09-30T17:10:33.725404] [DEBUG] [LOCAL ] ALV: Primary data saved (42426 records). [2025-09-30T17:10:33.725562] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-30T17:10:33.726263] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALV took 30.8s. Estimated remaining: 4h 26m 10s. Rate: 8.6 symbols/min [2025-09-30T17:10:33.859463] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-30T17:10:33.917785] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:33.958453] [DEBUG] [LOCAL ] AMBC: Loaded 36595 existing records from primary storage. [2025-09-30T17:10:33.958812] [INFO ] [MAIN ] AMBC: Loaded 36595 existing records. [2025-09-30T17:10:34.230204] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:34.231474] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-30T17:10:34.231524] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-30T17:10:34.231818] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-30T17:10:34.231878] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-30T17:10:34.630398] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:34.654341] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-30T17:10:34.986723] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T17:10:35.047012] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:10:35.050441] [INFO ] [REMOTE ] ALX: Full fetch complete (7057 records). [2025-09-30T17:10:35.050564] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-30T17:10:35.454376] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-30T17:10:35.460980] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-30T17:10:35.462001] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-30T17:10:35.462223] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-30T17:10:35.462267] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-30T17:10:35.462914] [DEBUG] [LOCAL ] ALX: Trimmed 7057 records to 6175 (keeping 200 days of data) [2025-09-30T17:10:35.499392] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T17:10:35.503289] [INFO ] [REMOTE ] ALUR: Full fetch complete (20428 records). [2025-09-30T17:10:35.505851] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-30T17:10:35.625257] [DEBUG] [LOCAL ] ALX: Primary data saved (6175 records). [2025-09-30T17:10:35.640803] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-30T17:10:35.644854] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALX took 25.1s. Estimated remaining: 4h 23m 56s. Rate: 8.6 symbols/min [2025-09-30T17:10:36.017280] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:36.154192] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-30T17:10:36.154306] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-30T17:10:36.154601] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-30T17:10:36.154681] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-30T17:10:36.155374] [DEBUG] [LOCAL ] ALUR: Trimmed 20428 records to 10769 (keeping 200 days of data) [2025-09-30T17:10:36.231111] [DEBUG] [LOCAL ] ALUR: Primary data saved (10769 records). [2025-09-30T17:10:36.243109] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-30T17:10:36.244527] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALUR took 34.4s. Estimated remaining: 4h 21m 12s. Rate: 8.7 symbols/min [2025-09-30T17:10:36.259610] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-30T17:10:36.295455] [DEBUG] [LOCAL ] AMBP: Loaded 45121 existing records from primary storage. [2025-09-30T17:10:36.310750] [INFO ] [MAIN ] AMBP: Loaded 45121 existing records. [2025-09-30T17:10:36.601714] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:36.613254] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-30T17:10:36.624854] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-30T17:10:36.646610] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:36.646926] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-30T17:10:36.647074] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-30T17:10:36.647201] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-30T17:10:36.647012] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-30T17:10:36.647380] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-30T17:10:36.647445] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-30T17:10:36.652681] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-30T17:10:36.652763] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-30T17:10:37.423232] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:37.451401] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-30T17:10:37.501590] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:37.557826] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T17:10:37.559886] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T17:10:37.779114] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:10:37.779423] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-30T17:10:37.779520] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:10:37.779594] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-09-30T17:10:37.779683] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:10:37.779806] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-30T17:10:37.779914] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-30T17:10:37.779993] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-30T17:10:37.780087] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-30T17:10:37.780142] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AMBQ took 1.5s. Estimated remaining: 4h 18m 54s. Rate: 8.8 symbols/min [2025-09-30T17:10:37.859499] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-30T17:10:37.970275] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:38.023203] [DEBUG] [LOCAL ] AMC: Loaded 53760 existing records from primary storage. [2025-09-30T17:10:38.023576] [INFO ] [MAIN ] AMC: Loaded 53760 existing records. [2025-09-30T17:10:38.223849] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:38.224087] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-30T17:10:38.224134] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-30T17:10:38.224480] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-30T17:10:38.224539] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-30T17:10:38.611391] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:38.654350] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-30T17:10:39.145089] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T17:10:39.454374] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-30T17:10:40.254397] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-30T17:10:40.391302] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T17:10:41.054356] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-30T17:10:41.107315] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:10:41.461173] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T17:10:41.854406] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-30T17:10:42.654359] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-30T17:10:43.400543] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T17:10:43.454383] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-30T17:10:43.493889] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-30T17:10:43.803198] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T17:10:44.254389] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-30T17:10:44.959070] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T17:10:45.054380] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-30T17:10:45.854411] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-30T17:10:46.373305] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-30T17:10:46.555304] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T17:10:46.654433] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-30T17:10:47.444106] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T17:10:47.454304] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-30T17:10:48.254397] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-30T17:10:48.580817] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T17:10:48.942820] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-30T17:10:49.054404] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-30T17:10:49.854373] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-30T17:10:50.034225] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T17:10:50.108839] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T17:10:50.654401] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-30T17:10:51.454410] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-30T17:10:51.919705] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-30T17:10:52.254356] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-30T17:10:52.313239] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T17:10:52.823218] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T17:10:53.054360] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-30T17:10:53.854386] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-30T17:10:54.078336] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:10:54.521807] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T17:10:54.530424] [INFO ] [REMOTE ] AMBC: Full fetch complete (51220 records). [2025-09-30T17:10:54.530576] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-30T17:10:54.657101] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-30T17:10:54.967091] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-30T17:10:54.967176] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-30T17:10:54.967710] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-30T17:10:54.967774] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-30T17:10:54.969201] [DEBUG] [LOCAL ] AMBC: Trimmed 51220 records to 36609 (keeping 200 days of data) [2025-09-30T17:10:55.178217] [DEBUG] [LOCAL ] AMBC: Primary data saved (36609 records). [2025-09-30T17:10:55.178406] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-30T17:10:55.179231] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBC took 21.5s. Estimated remaining: 4h 23m 4s. Rate: 8.7 symbols/min [2025-09-30T17:10:55.362571] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:10:55.423489] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-09-30T17:10:55.423846] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-09-30T17:10:55.459517] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-30T17:10:55.644811] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:10:55.645115] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-30T17:10:55.645169] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-30T17:10:55.645515] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-30T17:10:55.645574] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-30T17:10:56.078433] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:10:56.257606] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-30T17:10:56.261295] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-30T17:10:56.438773] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T17:10:57.067418] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-30T17:10:57.070337] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T17:10:57.854373] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-30T17:10:57.972083] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T17:10:58.654373] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-30T17:10:59.454400] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-30T17:10:59.503280] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:10:59.613352] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-30T17:11:00.254366] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-30T17:11:00.624673] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T17:11:00.636062] [INFO ] [REMOTE ] AM: Full fetch complete (75600 records). [2025-09-30T17:11:00.636237] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-30T17:11:01.054795] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-30T17:11:01.098277] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-30T17:11:01.098515] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-30T17:11:01.099427] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-30T17:11:01.099704] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-30T17:11:01.132395] [DEBUG] [LOCAL ] AM: Trimmed 75600 records to 52080 (keeping 200 days of data) [2025-09-30T17:11:01.134743] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T17:11:01.503447] [DEBUG] [LOCAL ] AM: Primary data saved (52080 records). [2025-09-30T17:11:01.503845] [INFO ] [MAIN ] AM: Full history saved. [2025-09-30T17:11:01.505503] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AM took 42.6s. Estimated remaining: 4h 22m 42s. Rate: 8.7 symbols/min [2025-09-30T17:11:01.628202] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:11:01.773970] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:01.838097] [DEBUG] [LOCAL ] AME: Loaded 48537 existing records from primary storage. [2025-09-30T17:11:01.838475] [INFO ] [MAIN ] AME: Loaded 48537 existing records. [2025-09-30T17:11:01.860145] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-30T17:11:02.044372] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:02.044631] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-30T17:11:02.044729] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-30T17:11:02.045391] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-30T17:11:02.045454] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-30T17:11:02.472284] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:02.654374] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-30T17:11:03.467296] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-30T17:11:03.473884] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-30T17:11:03.590466] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T17:11:04.254334] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-30T17:11:04.356211] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T17:11:05.054344] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-30T17:11:05.411020] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-30T17:11:05.721007] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T17:11:05.854355] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-30T17:11:06.654460] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-30T17:11:07.288780] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-30T17:11:07.459731] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-30T17:11:07.473903] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T17:11:08.254379] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-30T17:11:08.318424] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T17:11:09.054413] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-30T17:11:09.789286] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-30T17:11:09.804376] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T17:11:09.814805] [INFO ] [REMOTE ] AMBP: Full fetch complete (65809 records). [2025-09-30T17:11:09.814946] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-30T17:11:09.859497] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-30T17:11:10.233632] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-30T17:11:10.233760] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-30T17:11:10.234543] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-30T17:11:10.234635] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-30T17:11:10.236406] [DEBUG] [LOCAL ] AMBP: Trimmed 65809 records to 45060 (keeping 200 days of data) [2025-09-30T17:11:10.570057] [DEBUG] [LOCAL ] AMBP: Primary data saved (45060 records). [2025-09-30T17:11:10.570209] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-30T17:11:10.570309] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMBP took 34.9s. Estimated remaining: 4h 23m 26s. Rate: 8.6 symbols/min [2025-09-30T17:11:10.656480] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-30T17:11:10.774461] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:10.820898] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T17:11:10.841165] [DEBUG] [LOCAL ] AMG: Loaded 20495 existing records from primary storage. [2025-09-30T17:11:10.841497] [INFO ] [MAIN ] AMG: Loaded 20495 existing records. [2025-09-30T17:11:11.033979] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:11.034231] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-30T17:11:11.034281] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-30T17:11:11.034518] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-30T17:11:11.034578] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-30T17:11:11.418978] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:11.454320] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-30T17:11:12.177313] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T17:11:12.254412] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-30T17:11:12.436732] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-30T17:11:12.449753] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-30T17:11:12.449932] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-30T17:11:12.922797] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-30T17:11:12.924529] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-30T17:11:12.924403] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T17:11:12.925873] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-30T17:11:12.933883] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-30T17:11:12.936025] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53760 (keeping 200 days of data) [2025-09-30T17:11:13.056185] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-30T17:11:13.283760] [DEBUG] [LOCAL ] AMC: Primary data saved (53760 records). [2025-09-30T17:11:13.284043] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-30T17:11:13.284157] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMC took 35.5s. Estimated remaining: 4h 21m 40s. Rate: 8.7 symbols/min [2025-09-30T17:11:13.516345] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:13.570312] [DEBUG] [LOCAL ] AMH: Loaded 51699 existing records from primary storage. [2025-09-30T17:11:13.570743] [INFO ] [MAIN ] AMH: Loaded 51699 existing records. [2025-09-30T17:11:13.779838] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:13.780120] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-30T17:11:13.780178] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-30T17:11:13.780567] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-30T17:11:13.780630] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-30T17:11:13.855163] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-30T17:11:14.186767] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:14.218340] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T17:11:14.283808] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T17:11:14.654373] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-30T17:11:15.426240] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T17:11:15.454380] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-30T17:11:16.254377] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-30T17:11:16.597226] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-30T17:11:17.054460] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-30T17:11:17.274321] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-30T17:11:17.320861] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T17:11:17.854472] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-30T17:11:18.654351] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-30T17:11:18.837930] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T17:11:19.454350] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-30T17:11:19.760006] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T17:11:19.853505] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T17:11:20.254410] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-30T17:11:21.044342] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T17:11:21.054314] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-30T17:11:21.435169] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T17:11:21.854367] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-30T17:11:22.654334] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-30T17:11:22.988266] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-30T17:11:23.454366] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-30T17:11:23.531638] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T17:11:23.955732] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T17:11:24.254407] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-30T17:11:24.750786] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T17:11:25.054447] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-30T17:11:25.854423] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-30T17:11:26.009593] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T17:11:26.120460] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T17:11:26.654403] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-30T17:11:27.335839] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T17:11:27.454449] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-30T17:11:28.254427] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-30T17:11:28.963261] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-30T17:11:28.976053] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-09-30T17:11:28.976239] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-30T17:11:29.057750] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-30T17:11:29.405168] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T17:11:29.419335] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T17:11:29.499979] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-30T17:11:29.500204] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-30T17:11:29.501088] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-30T17:11:29.501176] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-30T17:11:29.503224] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 53669 (keeping 200 days of data) [2025-09-30T17:11:29.848282] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-09-30T17:11:29.848954] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-30T17:11:29.849581] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMCR took 34.7s. Estimated remaining: 4h 25m 17s. Rate: 8.6 symbols/min [2025-09-30T17:11:29.862881] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-30T17:11:30.035971] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:30.081512] [DEBUG] [LOCAL ] AMN: Loaded 41796 existing records from primary storage. [2025-09-30T17:11:30.081877] [INFO ] [MAIN ] AMN: Loaded 41796 existing records. [2025-09-30T17:11:30.270733] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:30.270990] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-30T17:11:30.271038] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-30T17:11:30.271402] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-30T17:11:30.271459] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-30T17:11:30.658504] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:30.658624] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-30T17:11:30.879597] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T17:11:30.918961] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T17:11:31.454367] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-30T17:11:32.040665] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T17:11:32.254411] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-30T17:11:32.722319] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T17:11:32.727537] [INFO ] [REMOTE ] AMG: Full fetch complete (29817 records). [2025-09-30T17:11:32.727712] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-30T17:11:33.059464] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-30T17:11:33.140571] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-30T17:11:33.140695] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-30T17:11:33.141100] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-30T17:11:33.141149] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-30T17:11:33.142201] [DEBUG] [LOCAL ] AMG: Trimmed 29817 records to 20444 (keeping 200 days of data) [2025-09-30T17:11:33.275665] [DEBUG] [LOCAL ] AMG: Primary data saved (20444 records). [2025-09-30T17:11:33.275839] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-30T17:11:33.275934] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AMG took 22.7s. Estimated remaining: 4h 23m 48s. Rate: 8.6 symbols/min [2025-09-30T17:11:33.469931] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:33.507894] [DEBUG] [LOCAL ] AMP: Loaded 32281 existing records from primary storage. [2025-09-30T17:11:33.508204] [INFO ] [MAIN ] AMP: Loaded 32281 existing records. [2025-09-30T17:11:33.737898] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:33.738121] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-30T17:11:33.738176] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-30T17:11:33.738686] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-30T17:11:33.738779] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-30T17:11:33.859455] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-30T17:11:34.144328] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:34.177602] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T17:11:34.654367] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-30T17:11:34.905893] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T17:11:34.918302] [INFO ] [REMOTE ] AME: Full fetch complete (69862 records). [2025-09-30T17:11:34.918523] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-30T17:11:35.355332] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-30T17:11:35.355449] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-30T17:11:35.356285] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-30T17:11:35.356355] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-30T17:11:35.357855] [DEBUG] [LOCAL ] AME: Trimmed 69862 records to 48527 (keeping 200 days of data) [2025-09-30T17:11:35.467411] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-30T17:11:35.659186] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T17:11:35.743617] [DEBUG] [LOCAL ] AME: Primary data saved (48527 records). [2025-09-30T17:11:35.743795] [INFO ] [MAIN ] AME: Full history saved. [2025-09-30T17:11:35.746717] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AME took 34.2s. Estimated remaining: 4h 21m 59s. Rate: 8.7 symbols/min [2025-09-30T17:11:35.953714] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:36.029744] [DEBUG] [LOCAL ] AMPX: Loaded 52224 existing records from primary storage. [2025-09-30T17:11:36.030169] [INFO ] [MAIN ] AMPX: Loaded 52224 existing records. [2025-09-30T17:11:36.230082] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:36.230558] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-30T17:11:36.230697] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-30T17:11:36.231324] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-30T17:11:36.231428] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-30T17:11:36.265158] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-30T17:11:36.583962] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T17:11:36.742733] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:36.943417] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T17:11:37.054406] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-30T17:11:37.746634] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T17:11:37.854418] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-30T17:11:38.642321] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T17:11:38.654306] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-30T17:11:39.380902] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T17:11:39.454389] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-30T17:11:40.254381] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-30T17:11:40.326298] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T17:11:40.899964] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T17:11:41.054365] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-30T17:11:41.758202] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T17:11:41.854382] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-30T17:11:42.550328] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T17:11:42.654344] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-30T17:11:43.425903] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T17:11:43.454374] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-30T17:11:44.142064] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T17:11:44.254369] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-30T17:11:45.054364] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-30T17:11:45.442071] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T17:11:45.854346] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-30T17:11:45.928396] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T17:11:46.307452] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T17:11:46.654363] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-30T17:11:47.430986] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T17:11:47.454344] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-30T17:11:48.190378] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T17:11:48.254353] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-30T17:11:48.862426] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T17:11:49.054388] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-30T17:11:49.751111] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T17:11:49.854396] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-30T17:11:50.572750] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T17:11:50.654365] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-30T17:11:51.316405] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T17:11:51.454402] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-30T17:11:52.254339] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-30T17:11:52.526415] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T17:11:52.545966] [INFO ] [REMOTE ] AMH: Full fetch complete (74789 records). [2025-09-30T17:11:52.546297] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-30T17:11:52.899575] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:11:53.020401] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-30T17:11:53.020501] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-30T17:11:53.021255] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-30T17:11:53.021326] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-30T17:11:53.022947] [DEBUG] [LOCAL ] AMH: Trimmed 74789 records to 51702 (keeping 200 days of data) [2025-09-30T17:11:53.084345] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-30T17:11:53.356872] [DEBUG] [LOCAL ] AMH: Primary data saved (51702 records). [2025-09-30T17:11:53.357092] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-30T17:11:53.357271] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMH took 40.1s. Estimated remaining: 4h 25m 52s. Rate: 8.5 symbols/min [2025-09-30T17:11:53.552332] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:53.552537] [DEBUG] [LOCAL ] AMPY: No existing data file found in primary storage. [2025-09-30T17:11:53.552595] [WARN ] [MAIN ] AMPY: No existing data found, performing full refresh instead. [2025-09-30T17:11:53.552745] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-30T17:11:53.552800] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-30T17:11:53.552851] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-09-30T17:11:53.552907] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-30T17:11:53.859129] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-30T17:11:53.985444] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:54.026537] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T17:11:54.390614] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-30T17:11:54.398995] [INFO ] [REMOTE ] AMP: Full fetch complete (47388 records). [2025-09-30T17:11:54.399184] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-30T17:11:54.399923] [FATAL] [VALIDATOR ] AMP: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:11:54.400008] [FATAL] [MAIN ] AMP: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:11:54.400051] [WARN ] [MAIN ] AMP: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:11:54.400118] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-30T17:11:54.400182] [DEBUG] [LOCAL ] AMP: No primary data file found to delete. [2025-09-30T17:11:54.400218] [INFO ] [LOCAL ] AMP: Starting deletion of derivative data. [2025-09-30T17:11:54.400731] [DEBUG] [LOCAL ] AMP: Deleted derivative data file. [2025-09-30T17:11:54.400843] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMP took 21.1s. Estimated remaining: 4h 23m 32s. Rate: 8.6 symbols/min [2025-09-30T17:11:54.584659] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:11:54.626065] [DEBUG] [LOCAL ] AMR: Loaded 28957 existing records from primary storage. [2025-09-30T17:11:54.626352] [INFO ] [MAIN ] AMR: Loaded 28957 existing records. [2025-09-30T17:11:54.659952] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-30T17:11:54.821744] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:11:54.821953] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-30T17:11:54.822001] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-30T17:11:54.822416] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-30T17:11:54.822475] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-30T17:11:55.204167] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:11:55.424220] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T17:11:55.454345] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-30T17:11:55.871050] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:11:56.254373] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-30T17:11:57.054325] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-30T17:11:57.282460] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T17:11:57.465236] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T17:11:57.854330] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-30T17:11:57.912156] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T17:11:58.654343] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-30T17:11:59.013327] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T17:11:59.454420] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-30T17:12:00.254326] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-30T17:12:00.365636] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T17:12:00.985939] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T17:12:01.054345] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-30T17:12:01.633997] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T17:12:01.854400] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-30T17:12:02.408875] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T17:12:02.418774] [INFO ] [REMOTE ] AMN: Full fetch complete (60292 records). [2025-09-30T17:12:02.418965] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-30T17:12:02.660209] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-30T17:12:02.867320] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-30T17:12:02.867423] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-30T17:12:02.868152] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-30T17:12:02.868218] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-30T17:12:02.869532] [DEBUG] [LOCAL ] AMN: Trimmed 60292 records to 41757 (keeping 200 days of data) [2025-09-30T17:12:03.141001] [DEBUG] [LOCAL ] AMN: Primary data saved (41757 records). [2025-09-30T17:12:03.141180] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-30T17:12:03.142411] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMN took 33.3s. Estimated remaining: 4h 24m 4s. Rate: 8.6 symbols/min [2025-09-30T17:12:03.329276] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:03.369107] [DEBUG] [LOCAL ] AMRC: Loaded 38202 existing records from primary storage. [2025-09-30T17:12:03.369610] [INFO ] [MAIN ] AMRC: Loaded 38202 existing records. [2025-09-30T17:12:03.455830] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-30T17:12:03.580576] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:03.580889] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-30T17:12:03.580954] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-30T17:12:03.581285] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-30T17:12:03.581346] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-30T17:12:04.005715] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-30T17:12:04.009758] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:04.254423] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-30T17:12:04.374536] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T17:12:04.577967] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T17:12:05.054428] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-30T17:12:05.854396] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-30T17:12:06.221057] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T17:12:06.654347] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-30T17:12:06.717090] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-30T17:12:06.885427] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T17:12:07.454394] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-30T17:12:07.912865] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-30T17:12:08.254410] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-30T17:12:08.709610] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T17:12:09.054409] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-30T17:12:09.562370] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T17:12:09.854403] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-30T17:12:10.454963] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T17:12:10.654442] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-30T17:12:11.454366] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-30T17:12:12.006993] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-30T17:12:12.072542] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T17:12:12.254394] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-30T17:12:13.054402] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-30T17:12:13.126324] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T17:12:13.422097] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T17:12:13.854409] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-30T17:12:14.654433] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-30T17:12:14.804805] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T17:12:15.050057] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-30T17:12:15.062631] [INFO ] [REMOTE ] AMPX: Full fetch complete (74646 records). [2025-09-30T17:12:15.062897] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-30T17:12:15.459611] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-30T17:12:15.524745] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-30T17:12:15.524866] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-30T17:12:15.525630] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-30T17:12:15.525748] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-30T17:12:15.527231] [DEBUG] [LOCAL ] AMPX: Trimmed 74646 records to 52247 (keeping 200 days of data) [2025-09-30T17:12:15.870710] [DEBUG] [LOCAL ] AMPX: Primary data saved (52247 records). [2025-09-30T17:12:15.870876] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-30T17:12:15.870995] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPX took 40.1s. Estimated remaining: 4h 26m 2s. Rate: 8.5 symbols/min [2025-09-30T17:12:16.060867] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:16.061138] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-30T17:12:16.061250] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-30T17:12:16.061546] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-30T17:12:16.061591] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-30T17:12:16.061688] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-30T17:12:16.061742] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-30T17:12:16.234085] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:12:16.275858] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-30T17:12:16.506223] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:17.054419] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-30T17:12:17.562268] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:12:17.562607] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-30T17:12:17.562720] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:12:17.562773] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-09-30T17:12:17.562809] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:12:17.562849] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-30T17:12:17.562908] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-30T17:12:17.562944] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-30T17:12:17.562986] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-30T17:12:17.563035] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMRZ took 1.7s. Estimated remaining: 4h 23m 60s. Rate: 8.6 symbols/min [2025-09-30T17:12:17.788361] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:17.792922] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-30T17:12:17.834256] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T17:12:17.870790] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-30T17:12:17.899112] [DEBUG] [LOCAL ] AMT: Loaded 52433 existing records from primary storage. [2025-09-30T17:12:17.899536] [INFO ] [MAIN ] AMT: Loaded 52433 existing records. [2025-09-30T17:12:18.093287] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:18.093560] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-30T17:12:18.093615] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-30T17:12:18.094153] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-30T17:12:18.094213] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-30T17:12:18.489766] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:18.654396] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-30T17:12:19.445311] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T17:12:19.454536] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-30T17:12:20.254347] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-30T17:12:20.664278] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T17:12:20.885166] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T17:12:21.054385] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-30T17:12:21.653483] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T17:12:21.854385] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-30T17:12:22.659526] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-30T17:12:22.681974] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T17:12:23.454320] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-30T17:12:23.559922] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T17:12:23.567886] [INFO ] [REMOTE ] AMPY: Full fetch complete (51038 records). [2025-09-30T17:12:23.568017] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-30T17:12:24.029061] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-30T17:12:24.029178] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-30T17:12:24.029781] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-30T17:12:24.029848] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-30T17:12:24.031126] [DEBUG] [LOCAL ] AMPY: Trimmed 51038 records to 37712 (keeping 200 days of data) [2025-09-30T17:12:24.246166] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:12:24.254970] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-30T17:12:24.286525] [DEBUG] [LOCAL ] AMPY: Primary data saved (37712 records). [2025-09-30T17:12:24.286721] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-30T17:12:24.286818] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMPY took 30.9s. Estimated remaining: 4h 23m 47s. Rate: 8.6 symbols/min [2025-09-30T17:12:24.475328] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:24.498407] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T17:12:24.527967] [DEBUG] [LOCAL ] AMTB: Loaded 20251 existing records from primary storage. [2025-09-30T17:12:24.528269] [INFO ] [MAIN ] AMTB: Loaded 20251 existing records. [2025-09-30T17:12:24.719159] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:24.719513] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-30T17:12:24.719569] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-30T17:12:24.719934] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-30T17:12:24.719995] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-30T17:12:25.062976] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-30T17:12:25.108533] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:25.676333] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T17:12:25.854383] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-30T17:12:26.645314] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:12:26.654699] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-30T17:12:27.360884] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T17:12:27.454365] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-30T17:12:27.768554] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T17:12:27.774746] [INFO ] [REMOTE ] AMR: Full fetch complete (39853 records). [2025-09-30T17:12:27.774883] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-30T17:12:28.196921] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-30T17:12:28.197031] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-30T17:12:28.197528] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-30T17:12:28.197574] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-30T17:12:28.198772] [DEBUG] [LOCAL ] AMR: Trimmed 39853 records to 28930 (keeping 200 days of data) [2025-09-30T17:12:28.257161] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-30T17:12:28.390738] [DEBUG] [LOCAL ] AMR: Primary data saved (28930 records). [2025-09-30T17:12:28.390889] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-30T17:12:28.390973] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMR took 34.0s. Estimated remaining: 4h 22m 39s. Rate: 8.6 symbols/min [2025-09-30T17:12:28.581699] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:28.587569] [DEBUG] [LOCAL ] AMTD: Loaded 3600 existing records from primary storage. [2025-09-30T17:12:28.587814] [INFO ] [MAIN ] AMTD: Loaded 3600 existing records. [2025-09-30T17:12:28.792505] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:28.792924] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-30T17:12:28.793080] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-30T17:12:28.793565] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-30T17:12:28.793626] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-30T17:12:29.063106] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-30T17:12:29.225884] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:29.251709] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T17:12:29.526814] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T17:12:29.854382] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-30T17:12:30.654384] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-30T17:12:31.052953] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T17:12:31.245024] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-30T17:12:31.243526] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-30T17:12:31.454410] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-30T17:12:32.254412] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-30T17:12:33.054348] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-30T17:12:33.144454] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T17:12:33.153942] [INFO ] [REMOTE ] AMRC: Full fetch complete (52918 records). [2025-09-30T17:12:33.154106] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-30T17:12:33.589416] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-30T17:12:33.589510] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-30T17:12:33.590200] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-30T17:12:33.590292] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-30T17:12:33.592552] [DEBUG] [LOCAL ] AMRC: Trimmed 52918 records to 38174 (keeping 200 days of data) [2025-09-30T17:12:33.847228] [DEBUG] [LOCAL ] AMRC: Primary data saved (38174 records). [2025-09-30T17:12:33.847391] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-30T17:12:33.848106] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMRC took 30.7s. Estimated remaining: 4h 22m 1s. Rate: 8.6 symbols/min [2025-09-30T17:12:33.871798] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-30T17:12:34.046810] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:34.081735] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T17:12:34.132254] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T17:12:34.154945] [DEBUG] [LOCAL ] AMTM: Loaded 50658 existing records from primary storage. [2025-09-30T17:12:34.155341] [INFO ] [MAIN ] AMTM: Loaded 50658 existing records. [2025-09-30T17:12:34.344432] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:34.344709] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-30T17:12:34.344770] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-30T17:12:34.345058] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-30T17:12:34.345130] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-30T17:12:34.656006] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-30T17:12:34.664318] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:12:34.753966] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:35.454402] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-30T17:12:36.038717] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-30T17:12:36.254341] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-30T17:12:36.419230] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T17:12:37.054371] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-30T17:12:37.243046] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:12:37.456803] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-30T17:12:37.854431] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-30T17:12:38.344078] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T17:12:38.654389] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-30T17:12:39.454412] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-30T17:12:39.934951] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T17:12:40.254333] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-30T17:12:40.541356] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-30T17:12:40.921439] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T17:12:41.054373] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-30T17:12:41.854403] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-30T17:12:42.654333] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-30T17:12:42.827514] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T17:12:42.925291] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T17:12:43.454373] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-30T17:12:44.254328] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-30T17:12:44.332172] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T17:12:44.687960] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-30T17:12:45.054362] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-30T17:12:45.587445] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T17:12:45.602935] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T17:12:45.854366] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-30T17:12:46.654368] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-30T17:12:47.301920] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T17:12:47.454339] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-30T17:12:47.650272] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T17:12:48.254371] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-30T17:12:49.035844] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T17:12:49.054350] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-30T17:12:49.582164] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T17:12:49.595590] [INFO ] [REMOTE ] AMT: Full fetch complete (76010 records). [2025-09-30T17:12:49.595825] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-30T17:12:49.859536] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-30T17:12:50.106293] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-30T17:12:50.106418] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-30T17:12:50.107205] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-30T17:12:50.107333] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-30T17:12:50.109335] [DEBUG] [LOCAL ] AMT: Trimmed 76010 records to 52429 (keeping 200 days of data) [2025-09-30T17:12:50.231314] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T17:12:50.488520] [DEBUG] [LOCAL ] AMT: Primary data saved (52429 records). [2025-09-30T17:12:50.488835] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-30T17:12:50.490324] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMT took 32.9s. Estimated remaining: 4h 25m 15s. Rate: 8.5 symbols/min [2025-09-30T17:12:50.658505] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-30T17:12:50.697081] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:50.698691] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T17:12:50.701832] [INFO ] [REMOTE ] AMTD: Full fetch complete (5557 records). [2025-09-30T17:12:50.701953] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-30T17:12:50.807958] [DEBUG] [LOCAL ] AMWL: Loaded 8685 existing records from primary storage. [2025-09-30T17:12:50.824763] [INFO ] [MAIN ] AMWL: Loaded 8685 existing records. [2025-09-30T17:12:51.242206] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:51.263435] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-30T17:12:51.273759] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-30T17:12:51.278080] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-30T17:12:51.288778] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-30T17:12:51.443462] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-30T17:12:51.462099] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-30T17:12:51.462227] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-30T17:12:51.499095] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-30T17:12:51.513058] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-30T17:12:51.514315] [DEBUG] [LOCAL ] AMTD: Trimmed 5557 records to 3603 (keeping 200 days of data) [2025-09-30T17:12:51.759849] [DEBUG] [LOCAL ] AMTD: Primary data saved (3603 records). [2025-09-30T17:12:51.778600] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T17:12:51.783938] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-30T17:12:51.873490] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:51.873612] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTD took 23.5s. Estimated remaining: 4h 23m 12s. Rate: 8.6 symbols/min [2025-09-30T17:12:52.062832] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:52.111259] [DEBUG] [LOCAL ] AMX: Loaded 49128 existing records from primary storage. [2025-09-30T17:12:52.111668] [INFO ] [MAIN ] AMX: Loaded 49128 existing records. [2025-09-30T17:12:52.260110] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-30T17:12:52.303756] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:52.304155] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-30T17:12:52.304222] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-30T17:12:52.304568] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-30T17:12:52.304631] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-30T17:12:52.689478] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:53.043915] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T17:12:53.054369] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-30T17:12:53.520483] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T17:12:53.524776] [INFO ] [REMOTE ] AMTB: Full fetch complete (29993 records). [2025-09-30T17:12:53.524888] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-30T17:12:53.859459] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-30T17:12:53.925248] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-30T17:12:53.925329] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-30T17:12:53.925725] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-30T17:12:53.925815] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-30T17:12:53.926725] [DEBUG] [LOCAL ] AMTB: Trimmed 29993 records to 20278 (keeping 200 days of data) [2025-09-30T17:12:54.054989] [DEBUG] [LOCAL ] AMTB: Primary data saved (20278 records). [2025-09-30T17:12:54.055123] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-30T17:12:54.055239] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMTB took 29.8s. Estimated remaining: 4h 21m 27s. Rate: 8.6 symbols/min [2025-09-30T17:12:54.239040] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:12:54.279133] [DEBUG] [LOCAL ] AN: Loaded 32121 existing records from primary storage. [2025-09-30T17:12:54.279505] [INFO ] [MAIN ] AN: Loaded 32121 existing records. [2025-09-30T17:12:54.471770] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:12:54.472072] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-30T17:12:54.472130] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-30T17:12:54.472513] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-30T17:12:54.472576] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-30T17:12:54.666034] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-30T17:12:54.780842] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T17:12:54.907360] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T17:12:54.913552] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:12:55.454381] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-30T17:12:56.254413] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-30T17:12:56.301764] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T17:12:56.397370] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:12:57.054386] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-30T17:12:57.859553] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-30T17:12:57.865182] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T17:12:58.654369] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-30T17:12:58.780637] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T17:12:58.831994] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T17:12:59.454369] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-30T17:13:00.173640] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T17:13:00.254359] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-30T17:13:01.054383] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-30T17:13:01.252975] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T17:13:01.594203] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T17:13:01.854404] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-30T17:13:02.066738] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T17:13:02.654445] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-30T17:13:03.348382] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:13:03.454408] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-30T17:13:03.967200] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T17:13:04.058819] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T17:13:04.254388] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-30T17:13:05.054370] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-30T17:13:05.854390] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-30T17:13:06.055779] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T17:13:06.091597] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T17:13:06.654404] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-30T17:13:07.454428] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-30T17:13:07.670311] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:13:08.104744] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T17:13:08.107168] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T17:13:08.254356] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-30T17:13:09.054402] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-30T17:13:09.139732] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T17:13:09.854369] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-30T17:13:10.459103] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T17:13:10.654385] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-30T17:13:11.454399] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-30T17:13:11.665079] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T17:13:12.201078] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T17:13:12.254380] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-30T17:13:12.813068] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T17:13:13.054384] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-30T17:13:13.772165] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-30T17:13:13.854346] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-30T17:13:13.929861] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T17:13:14.654379] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-30T17:13:15.454337] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-30T17:13:15.501495] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T17:13:15.519058] [INFO ] [REMOTE ] AMTM: Full fetch complete (73951 records). [2025-09-30T17:13:15.519252] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-30T17:13:15.969811] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-30T17:13:15.969932] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-30T17:13:15.970749] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-30T17:13:15.970831] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-30T17:13:15.972698] [DEBUG] [LOCAL ] AMTM: Trimmed 73951 records to 50639 (keeping 200 days of data) [2025-09-30T17:13:16.001589] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T17:13:16.276187] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-30T17:13:16.320255] [DEBUG] [LOCAL ] AMTM: Primary data saved (50639 records). [2025-09-30T17:13:16.320416] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-30T17:13:16.320506] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMTM took 42.5s. Estimated remaining: 4h 26m 29s. Rate: 8.5 symbols/min [2025-09-30T17:13:16.526581] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:16.550450] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T17:13:16.607317] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-30T17:13:16.607720] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-09-30T17:13:16.799999] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:16.800315] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-30T17:13:16.800366] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-30T17:13:16.800765] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-30T17:13:16.800826] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-30T17:13:17.059624] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-30T17:13:17.194350] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:17.854421] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-30T17:13:18.048989] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T17:13:18.059870] [INFO ] [REMOTE ] AMX: Full fetch complete (70736 records). [2025-09-30T17:13:18.059992] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-30T17:13:18.151713] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:13:18.499998] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-30T17:13:18.500110] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-30T17:13:18.500905] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-30T17:13:18.500971] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-30T17:13:18.502606] [DEBUG] [LOCAL ] AMX: Trimmed 70736 records to 49110 (keeping 200 days of data) [2025-09-30T17:13:18.687543] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-30T17:13:18.825879] [DEBUG] [LOCAL ] AMX: Primary data saved (49110 records). [2025-09-30T17:13:18.826024] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-30T17:13:18.826138] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMX took 27.0s. Estimated remaining: 4h 24m 51s. Rate: 8.5 symbols/min [2025-09-30T17:13:19.026032] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:19.088629] [DEBUG] [LOCAL ] ANF: Loaded 52173 existing records from primary storage. [2025-09-30T17:13:19.089095] [INFO ] [MAIN ] ANF: Loaded 52173 existing records. [2025-09-30T17:13:19.330992] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:19.331307] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-30T17:13:19.331368] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-30T17:13:19.331939] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-30T17:13:19.331999] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-30T17:13:19.461233] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-30T17:13:19.872871] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:13:19.878579] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:19.883112] [INFO ] [REMOTE ] AMWL: Full fetch complete (14023 records). [2025-09-30T17:13:19.883238] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-30T17:13:20.256608] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-30T17:13:20.296313] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-30T17:13:20.296469] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-30T17:13:20.296824] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-30T17:13:20.296982] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-30T17:13:20.297954] [DEBUG] [LOCAL ] AMWL: Trimmed 14023 records to 8761 (keeping 200 days of data) [2025-09-30T17:13:20.375676] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-30T17:13:20.399195] [DEBUG] [LOCAL ] AMWL: Primary data saved (8761 records). [2025-09-30T17:13:20.399383] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-30T17:13:20.399575] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMWL took 29.9s. Estimated remaining: 4h 22m 55s. Rate: 8.6 symbols/min [2025-09-30T17:13:20.608606] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:20.627068] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-30T17:13:20.628109] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T17:13:20.627156] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-30T17:13:20.635345] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-30T17:13:20.635441] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-30T17:13:20.635539] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-30T17:13:20.635613] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-30T17:13:21.037196] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:21.054327] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-30T17:13:21.259322] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:13:21.259670] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-30T17:13:21.259760] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:13:21.259811] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-09-30T17:13:21.259874] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:13:21.259947] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-30T17:13:21.260015] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-30T17:13:21.260053] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-30T17:13:21.260113] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-30T17:13:21.260185] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. ANGX took 0.9s. Estimated remaining: 4h 20m 48s. Rate: 8.7 symbols/min [2025-09-30T17:13:21.440222] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:21.459802] [DEBUG] [LOCAL ] ANRO: Loaded 18969 existing records from primary storage. [2025-09-30T17:13:21.460065] [INFO ] [MAIN ] ANRO: Loaded 18969 existing records. [2025-09-30T17:13:21.647912] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:21.648120] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-30T17:13:21.648169] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-30T17:13:21.648441] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-30T17:13:21.648505] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-30T17:13:21.860018] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-30T17:13:22.028578] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:22.342061] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-30T17:13:22.654403] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-30T17:13:23.454425] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-30T17:13:24.145579] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-30T17:13:24.254341] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-30T17:13:24.499006] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T17:13:25.022248] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:13:25.054344] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-30T17:13:25.854353] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-30T17:13:26.230021] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-30T17:13:26.430418] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-30T17:13:26.654375] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-30T17:13:26.894795] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T17:13:27.454413] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-30T17:13:28.254418] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-30T17:13:28.759608] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-30T17:13:29.031921] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T17:13:29.054371] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-30T17:13:29.698969] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T17:13:29.706899] [INFO ] [REMOTE ] AN: Full fetch complete (47588 records). [2025-09-30T17:13:29.707100] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-30T17:13:29.866888] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-30T17:13:30.132787] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-30T17:13:30.132896] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-30T17:13:30.133458] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-30T17:13:30.133505] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-30T17:13:30.134586] [DEBUG] [LOCAL ] AN: Trimmed 47588 records to 32016 (keeping 200 days of data) [2025-09-30T17:13:30.340735] [DEBUG] [LOCAL ] AN: Primary data saved (32016 records). [2025-09-30T17:13:30.340883] [INFO ] [MAIN ] AN: Full history saved. [2025-09-30T17:13:30.341003] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. AN took 36.3s. Estimated remaining: 4h 21m 23s. Rate: 8.6 symbols/min [2025-09-30T17:13:30.530580] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:30.554542] [DEBUG] [LOCAL ] ANVS: Loaded 23113 existing records from primary storage. [2025-09-30T17:13:30.554890] [INFO ] [MAIN ] ANVS: Loaded 23113 existing records. [2025-09-30T17:13:30.662141] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-30T17:13:30.749896] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:30.750173] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-30T17:13:30.750231] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-30T17:13:30.750708] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-30T17:13:30.750769] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-30T17:13:31.129268] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:31.454425] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-30T17:13:31.569979] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-30T17:13:31.687233] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T17:13:31.877982] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-30T17:13:32.254385] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-30T17:13:33.021465] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T17:13:33.054315] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-30T17:13:33.296429] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T17:13:33.854363] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-30T17:13:34.654379] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-30T17:13:34.880496] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T17:13:35.086185] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T17:13:35.454373] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-30T17:13:36.254409] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-30T17:13:36.539698] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T17:13:37.054386] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-30T17:13:37.099559] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-30T17:13:37.854369] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-30T17:13:38.079327] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T17:13:38.127975] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-30T17:13:38.654382] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-30T17:13:39.454359] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-30T17:13:40.042258] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-30T17:13:40.254348] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-30T17:13:40.410353] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T17:13:40.518843] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-30T17:13:41.054369] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-30T17:13:41.356741] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T17:13:41.854384] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-30T17:13:42.654375] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-30T17:13:42.697487] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T17:13:43.077070] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T17:13:43.454371] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-30T17:13:43.978201] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T17:13:44.254364] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-30T17:13:45.054388] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-30T17:13:45.206201] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T17:13:45.585019] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-30T17:13:45.854377] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-30T17:13:46.063281] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T17:13:46.654366] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-30T17:13:47.454412] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-30T17:13:47.559503] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T17:13:48.154326] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-30T17:13:48.254377] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-30T17:13:48.659928] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T17:13:49.054355] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-30T17:13:49.854363] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-30T17:13:50.057385] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T17:13:50.210611] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T17:13:50.654348] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-30T17:13:51.454364] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-30T17:13:51.689896] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-30T17:13:52.073676] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T17:13:52.086115] [INFO ] [REMOTE ] ANET: Full fetch complete (77859 records). [2025-09-30T17:13:52.086306] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-30T17:13:52.260966] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-30T17:13:52.532306] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T17:13:52.561663] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-30T17:13:52.561949] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-30T17:13:52.562805] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-30T17:13:52.562904] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-30T17:13:52.561861] [INFO ] [REMOTE ] ANRO: Full fetch complete (29688 records). [2025-09-30T17:13:52.563287] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-30T17:13:52.634733] [DEBUG] [LOCAL ] ANET: Trimmed 77859 records to 53766 (keeping 200 days of data) [2025-09-30T17:13:53.064338] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-30T17:13:53.120173] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-30T17:13:53.120952] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-30T17:13:53.126947] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-30T17:13:53.128028] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-30T17:13:53.139851] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T17:13:53.139022] [DEBUG] [LOCAL ] ANRO: Trimmed 29688 records to 18824 (keeping 200 days of data) [2025-09-30T17:13:53.374860] [DEBUG] [LOCAL ] ANRO: Primary data saved (18824 records). [2025-09-30T17:13:53.375526] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-30T17:13:53.375966] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANRO took 32.1s. Estimated remaining: 4h 26m 26s. Rate: 8.5 symbols/min [2025-09-30T17:13:53.482334] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-09-30T17:13:53.482489] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-30T17:13:53.484403] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANET took 37.2s. Estimated remaining: 4h 24m 5s. Rate: 8.5 symbols/min [2025-09-30T17:13:53.854363] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-30T17:13:54.714861] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T17:13:54.730501] [INFO ] [REMOTE ] ANF: Full fetch complete (75592 records). [2025-09-30T17:13:54.730769] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-30T17:13:55.119930] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T17:13:55.160627] [INFO ] [REMOTE ] ANVS: Full fetch complete (36457 records). [2025-09-30T17:13:55.198972] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-30T17:13:55.203041] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-30T17:13:55.203391] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-30T17:13:55.204442] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-30T17:13:55.204532] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-30T17:13:55.315966] [DEBUG] [LOCAL ] ANF: Trimmed 75592 records to 52136 (keeping 200 days of data) [2025-09-30T17:13:55.768962] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-30T17:13:55.769382] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-30T17:13:55.769981] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-30T17:13:55.770082] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-30T17:13:55.773982] [DEBUG] [LOCAL ] ANVS: Trimmed 36457 records to 23170 (keeping 200 days of data) [2025-09-30T17:13:56.054015] [DEBUG] [LOCAL ] ANVS: Primary data saved (23170 records). [2025-09-30T17:13:56.055336] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-30T17:13:56.058352] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANVS took 25.7s. Estimated remaining: 4h 22m 34s. Rate: 8.6 symbols/min [2025-09-30T17:13:56.143254] [DEBUG] [LOCAL ] ANF: Primary data saved (52136 records). [2025-09-30T17:13:56.143398] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-30T17:13:56.143525] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANF took 37.3s. Estimated remaining: 4h 20m 17s. Rate: 8.6 symbols/min [2025-09-30T17:13:56.747544] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:56.906802] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:56.926122] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:56.857328] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:56.926450] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-30T17:13:56.927290] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-30T17:13:56.927462] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-30T17:13:56.927595] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-30T17:13:56.927951] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-30T17:13:56.928059] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-30T17:13:57.099140] [DEBUG] [LOCAL ] AOMR: Loaded 16553 existing records from primary storage. [2025-09-30T17:13:57.127946] [INFO ] [MAIN ] AOMR: Loaded 16553 existing records. [2025-09-30T17:13:57.321269] [DEBUG] [LOCAL ] AOD: Loaded 30055 existing records from primary storage. [2025-09-30T17:13:57.406448] [INFO ] [MAIN ] AOD: Loaded 30055 existing records. [2025-09-30T17:13:57.432441] [DEBUG] [LOCAL ] AON: Loaded 45463 existing records from primary storage. [2025-09-30T17:13:57.512724] [INFO ] [MAIN ] AON: Loaded 45463 existing records. [2025-09-30T17:13:57.661906] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:57.757570] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:57.778028] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-30T17:13:57.797953] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-30T17:13:57.813431] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-30T17:13:57.868569] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-30T17:13:57.873956] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-30T17:13:57.957728] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:57.984992] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-30T17:13:58.021083] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-30T17:13:58.056553] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-30T17:13:58.056737] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-30T17:13:58.070733] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:13:58.104227] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-30T17:13:58.140331] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:58.174289] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:13:58.199726] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-30T17:13:58.223562] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-30T17:13:58.209227] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-09-30T17:13:58.229017] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:13:58.239848] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-30T17:13:58.260547] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-30T17:13:58.234688] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-30T17:13:58.379464] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-30T17:13:58.419248] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-30T17:13:58.479986] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-30T17:13:58.586003] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 2.4s. Estimated remaining: 4h 18m 47s. Rate: 8.7 symbols/min [2025-09-30T17:13:59.173994] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:59.216292] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-30T17:13:59.374192] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:13:59.423823] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:59.447335] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-30T17:13:59.510630] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:13:59.511241] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-30T17:13:59.541229] [DEBUG] [LOCAL ] AORT: Loaded 29482 existing records from primary storage. [2025-09-30T17:13:59.541590] [INFO ] [MAIN ] AORT: Loaded 29482 existing records. [2025-09-30T17:13:59.751833] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:13:59.752122] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-30T17:13:59.752186] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-30T17:13:59.752446] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-30T17:13:59.752508] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-30T17:14:00.152215] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:14:00.152567] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-30T17:14:00.182230] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T17:14:00.185760] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-30T17:14:00.756622] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T17:14:00.763190] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-30T17:14:00.952805] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T17:14:00.955831] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-30T17:14:01.159539] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T17:14:01.168821] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-30T17:14:01.463841] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T17:14:01.562416] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T17:14:01.854381] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-30T17:14:02.065150] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T17:14:02.654333] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-30T17:14:02.834408] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T17:14:03.159277] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T17:14:03.454399] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-30T17:14:03.649474] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T17:14:04.254407] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-30T17:14:04.892033] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T17:14:05.054345] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-30T17:14:05.348768] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T17:14:05.854374] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-30T17:14:06.609148] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T17:14:06.654350] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-30T17:14:07.130329] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T17:14:07.454407] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-30T17:14:08.141245] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:14:08.254415] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-30T17:14:08.515270] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T17:14:09.054410] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-30T17:14:09.854388] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-30T17:14:10.129445] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T17:14:10.347042] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T17:14:10.654358] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-30T17:14:11.074372] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T17:14:11.454402] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-30T17:14:12.254399] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-30T17:14:12.423792] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T17:14:12.774847] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T17:14:13.054396] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-30T17:14:13.677521] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T17:14:13.854440] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-30T17:14:14.594629] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T17:14:14.654430] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-30T17:14:14.760497] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T17:14:15.454422] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-30T17:14:15.606940] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T17:14:16.254418] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-30T17:14:16.505380] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T17:14:17.057273] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-30T17:14:17.061298] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T17:14:17.854358] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-30T17:14:17.927488] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T17:14:18.654389] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-30T17:14:19.233681] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T17:14:19.433283] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T17:14:19.454303] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-30T17:14:20.254329] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-30T17:14:20.669927] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T17:14:21.054380] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-30T17:14:21.690031] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T17:14:21.854429] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-30T17:14:22.065070] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T17:14:22.069434] [INFO ] [REMOTE ] AOMR: Full fetch complete (23154 records). [2025-09-30T17:14:22.069568] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-30T17:14:22.487751] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-30T17:14:22.487848] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-30T17:14:22.488177] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-30T17:14:22.488234] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-30T17:14:22.488994] [DEBUG] [LOCAL ] AOMR: Trimmed 23154 records to 16575 (keeping 200 days of data) [2025-09-30T17:14:22.591007] [DEBUG] [LOCAL ] AOMR: Primary data saved (16575 records). [2025-09-30T17:14:22.591171] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-30T17:14:22.591293] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOMR took 26.4s. Estimated remaining: 4h 23m 55s. Rate: 8.5 symbols/min [2025-09-30T17:14:22.664550] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-30T17:14:22.787405] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:14:22.842530] [DEBUG] [LOCAL ] AOS: Loaded 48890 existing records from primary storage. [2025-09-30T17:14:22.842926] [INFO ] [MAIN ] AOS: Loaded 48890 existing records. [2025-09-30T17:14:23.041574] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:14:23.041924] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-30T17:14:23.041983] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-30T17:14:23.042358] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-30T17:14:23.042440] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-30T17:14:23.371635] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T17:14:23.422018] [INFO ] [REMOTE ] AOD: Full fetch complete (44171 records). [2025-09-30T17:14:23.443423] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-30T17:14:23.464367] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-30T17:14:23.489576] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:14:23.888723] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-30T17:14:23.888861] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-30T17:14:23.889463] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-30T17:14:23.889526] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-30T17:14:23.890608] [DEBUG] [LOCAL ] AOD: Trimmed 44171 records to 30085 (keeping 200 days of data) [2025-09-30T17:14:24.084325] [DEBUG] [LOCAL ] AOD: Primary data saved (30085 records). [2025-09-30T17:14:24.084468] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-30T17:14:24.086324] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AOD took 27.9s. Estimated remaining: 4h 22m 7s. Rate: 8.6 symbols/min [2025-09-30T17:14:24.255964] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-30T17:14:24.287031] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:14:24.303328] [DEBUG] [LOCAL ] AP: Loaded 7191 existing records from primary storage. [2025-09-30T17:14:24.303563] [INFO ] [MAIN ] AP: Loaded 7191 existing records. [2025-09-30T17:14:24.507416] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:14:24.508169] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-30T17:14:24.508295] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-30T17:14:24.523677] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-30T17:14:24.526116] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-30T17:14:24.545609] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T17:14:24.862426] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-30T17:14:25.066671] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-30T17:14:25.090034] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:14:25.854373] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-30T17:14:25.926404] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T17:14:26.510778] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T17:14:26.654415] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-30T17:14:27.194978] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T17:14:27.454378] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-30T17:14:28.252273] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T17:14:28.261441] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-30T17:14:28.263748] [INFO ] [REMOTE ] AON: Full fetch complete (64808 records). [2025-09-30T17:14:28.263884] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-30T17:14:28.691796] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-30T17:14:28.691904] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-30T17:14:28.692723] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-30T17:14:28.692819] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-30T17:14:28.713161] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T17:14:28.720392] [DEBUG] [LOCAL ] AON: Trimmed 64808 records to 45425 (keeping 200 days of data) [2025-09-30T17:14:28.721043] [INFO ] [REMOTE ] AORT: Full fetch complete (41788 records). [2025-09-30T17:14:28.721452] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-30T17:14:29.059782] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-30T17:14:29.295982] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-30T17:14:29.296623] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-30T17:14:29.297392] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-30T17:14:29.298006] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-30T17:14:29.305142] [DEBUG] [LOCAL ] AORT: Trimmed 41788 records to 29478 (keeping 200 days of data) [2025-09-30T17:14:29.692692] [DEBUG] [LOCAL ] AON: Primary data saved (45425 records). [2025-09-30T17:14:29.695073] [INFO ] [MAIN ] AON: Full history saved. [2025-09-30T17:14:29.702095] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AON took 33.6s. Estimated remaining: 4h 21m 35s. Rate: 8.6 symbols/min [2025-09-30T17:14:29.704531] [DEBUG] [LOCAL ] AORT: Primary data saved (29478 records). [2025-09-30T17:14:29.705065] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-30T17:14:29.728184] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AORT took 31.1s. Estimated remaining: 4h 19m 23s. Rate: 8.7 symbols/min [2025-09-30T17:14:29.991027] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T17:14:30.015500] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-30T17:14:30.121144] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:14:30.151521] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-09-30T17:14:30.162042] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-09-30T17:14:30.186201] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-30T17:14:30.200748] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-30T17:14:30.210585] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-30T17:14:30.239729] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:14:30.215931] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T17:14:30.239965] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-30T17:14:30.240413] [DEBUG] [LOCAL ] APD: No existing data file found in primary storage. [2025-09-30T17:14:30.250342] [WARN ] [MAIN ] APD: No existing data found, performing full refresh instead. [2025-09-30T17:14:30.315478] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-30T17:14:30.344359] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-30T17:14:30.367917] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-09-30T17:14:30.372347] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-30T17:14:30.660289] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-30T17:14:30.879016] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T17:14:31.109013] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:14:31.186963] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:14:31.454364] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-30T17:14:32.254392] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-30T17:14:32.397181] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T17:14:33.052390] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T17:14:33.059004] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-30T17:14:33.640015] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T17:14:33.854389] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-30T17:14:34.522046] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T17:14:34.654375] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-30T17:14:35.454343] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-30T17:14:35.627722] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T17:14:35.682231] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T17:14:35.855744] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-30T17:14:36.254358] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-30T17:14:37.054369] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-30T17:14:37.615894] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T17:14:37.859457] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-30T17:14:37.881070] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:14:38.490415] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-30T17:14:38.654366] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-30T17:14:39.454359] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-30T17:14:39.951627] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T17:14:40.254365] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-30T17:14:41.054341] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-30T17:14:41.217774] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:14:41.355370] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T17:14:41.854372] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-30T17:14:42.482340] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T17:14:42.636343] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T17:14:42.654306] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-30T17:14:43.259511] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T17:14:43.454363] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-30T17:14:44.254361] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-30T17:14:44.978014] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T17:14:45.054370] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-30T17:14:45.854362] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-30T17:14:46.130697] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T17:14:46.305534] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T17:14:46.544345] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T17:14:46.654384] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-30T17:14:47.454423] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-30T17:14:47.546479] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T17:14:47.549640] [INFO ] [REMOTE ] AP: Full fetch complete (8884 records). [2025-09-30T17:14:47.549838] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-30T17:14:47.550346] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:14:47.550433] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:14:47.550477] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:14:47.550518] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-30T17:14:47.550591] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-09-30T17:14:47.550672] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-09-30T17:14:47.551234] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-09-30T17:14:47.551332] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 23.5s. Estimated remaining: 4h 22m 30s. Rate: 8.6 symbols/min [2025-09-30T17:14:47.752959] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:14:47.753167] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-09-30T17:14:47.753206] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-09-30T17:14:47.753325] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-30T17:14:47.753367] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-30T17:14:47.753409] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-30T17:14:47.753443] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-30T17:14:48.142760] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:14:48.254361] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-30T17:14:49.054368] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-30T17:14:49.468015] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T17:14:49.816938] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T17:14:49.854357] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-30T17:14:50.663497] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-30T17:14:50.684102] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T17:14:51.147029] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T17:14:51.454354] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-30T17:14:51.824538] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T17:14:52.254399] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-30T17:14:53.026786] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T17:14:53.054319] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-30T17:14:53.854351] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-30T17:14:53.909950] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T17:14:54.382681] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T17:14:54.654411] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-30T17:14:55.239106] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T17:14:55.454363] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-30T17:14:56.080008] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T17:14:56.254375] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-30T17:14:57.010151] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T17:14:57.054370] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-30T17:14:57.831604] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:14:57.854311] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-30T17:14:58.625565] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:14:58.654321] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-30T17:14:59.438571] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T17:14:59.454300] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-30T17:14:59.989488] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T17:15:00.254402] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-30T17:15:01.054344] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-30T17:15:01.389726] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T17:15:01.399570] [INFO ] [REMOTE ] APAM: Full fetch complete (51602 records). [2025-09-30T17:15:01.399772] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-30T17:15:01.821456] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-30T17:15:01.859990] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-30T17:15:01.917360] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-30T17:15:01.917600] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-30T17:15:01.918270] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-30T17:15:01.918444] [INFO ] [REMOTE ] APD: Full fetch complete (66354 records). [2025-09-30T17:15:01.918673] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-30T17:15:01.918808] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-30T17:15:01.920340] [FATAL] [VALIDATOR ] APD: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:15:01.920558] [FATAL] [MAIN ] APD: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:15:01.920910] [WARN ] [MAIN ] APD: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:15:01.920987] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-30T17:15:01.921297] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-09-30T17:15:01.921443] [INFO ] [LOCAL ] APD: Starting deletion of derivative data. [2025-09-30T17:15:01.921167] [DEBUG] [LOCAL ] APAM: Trimmed 51602 records to 36128 (keeping 200 days of data) [2025-09-30T17:15:01.921807] [DEBUG] [LOCAL ] APD: No derivative data file found to delete. [2025-09-30T17:15:01.922309] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. APD took 32.2s. Estimated remaining: 4h 24m 33s. Rate: 8.5 symbols/min [2025-09-30T17:15:02.215424] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:02.384959] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-09-30T17:15:02.386235] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-09-30T17:15:02.562392] [DEBUG] [LOCAL ] APAM: Primary data saved (36128 records). [2025-09-30T17:15:02.606849] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-30T17:15:02.606589] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:02.607404] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APAM took 32.9s. Estimated remaining: 4h 22m 34s. Rate: 8.5 symbols/min [2025-09-30T17:15:02.607698] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-30T17:15:02.632038] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-30T17:15:02.672501] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-30T17:15:02.672808] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-30T17:15:02.975396] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:03.342800] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T17:15:03.347203] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:03.359289] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-30T17:15:03.360994] [DEBUG] [LOCAL ] APLE: Loaded 51976 existing records from primary storage. [2025-09-30T17:15:03.363776] [INFO ] [MAIN ] APLE: Loaded 51976 existing records. [2025-09-30T17:15:03.461015] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-30T17:15:03.599297] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:03.602234] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-30T17:15:03.602458] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-30T17:15:03.603907] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T17:15:03.603954] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-30T17:15:03.604091] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-30T17:15:04.022351] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:04.254373] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-30T17:15:05.054412] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-30T17:15:06.638876] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (3.28 seconds). [2025-09-30T17:15:06.654512] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-30T17:15:07.381697] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (3.92 seconds). [2025-09-30T17:15:07.395200] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-30T17:15:07.637164] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (3.38 seconds). [2025-09-30T17:15:07.653483] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-30T17:15:08.412058] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (3.36 seconds). [2025-09-30T17:15:08.421996] [INFO ] [REMOTE ] AOS: Full fetch complete (70594 records). [2025-09-30T17:15:08.422156] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-30T17:15:08.869123] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-30T17:15:08.869508] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-30T17:15:08.870267] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-30T17:15:08.870426] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-30T17:15:08.872046] [DEBUG] [LOCAL ] AOS: Trimmed 70594 records to 48866 (keeping 200 days of data) [2025-09-30T17:15:09.150058] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-30T17:15:09.166270] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-30T17:15:09.205238] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T17:15:09.221061] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-30T17:15:09.264429] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T17:15:09.341877] [DEBUG] [LOCAL ] AOS: Primary data saved (48866 records). [2025-09-30T17:15:09.342025] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-30T17:15:09.342114] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. AOS took 46.8s. Estimated remaining: 4h 22m 22s. Rate: 8.5 symbols/min [2025-09-30T17:15:09.531103] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:09.587563] [DEBUG] [LOCAL ] APO: Loaded 53382 existing records from primary storage. [2025-09-30T17:15:09.587957] [INFO ] [MAIN ] APO: Loaded 53382 existing records. [2025-09-30T17:15:09.787975] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:09.788240] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-30T17:15:09.788300] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-30T17:15:09.788826] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-30T17:15:09.788889] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-30T17:15:09.859623] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-30T17:15:10.165564] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:10.654434] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-30T17:15:10.794468] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:15:10.930554] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T17:15:11.454357] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-30T17:15:11.564222] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T17:15:12.254390] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-30T17:15:12.305835] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T17:15:13.054350] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-30T17:15:13.317123] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T17:15:13.854390] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-30T17:15:13.998465] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T17:15:14.545233] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:15:14.654393] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-30T17:15:15.454398] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-30T17:15:15.697904] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T17:15:16.254400] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-30T17:15:17.054367] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-30T17:15:17.950151] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-09-30T17:15:17.963565] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-30T17:15:18.063552] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-30T17:15:18.082465] [INFO ] [REMOTE ] APG: Full fetch complete (71639 records). [2025-09-30T17:15:18.082696] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-30T17:15:18.528034] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-30T17:15:18.528129] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-30T17:15:18.529043] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-30T17:15:18.529305] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-30T17:15:18.530923] [DEBUG] [LOCAL ] APG: Trimmed 71639 records to 50186 (keeping 200 days of data) [2025-09-30T17:15:18.900437] [DEBUG] [LOCAL ] APG: Primary data saved (50186 records). [2025-09-30T17:15:18.900608] [INFO ] [MAIN ] APG: Full history saved. [2025-09-30T17:15:18.900731] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APG took 31.3s. Estimated remaining: 4h 22m 58s. Rate: 8.5 symbols/min [2025-09-30T17:15:19.144939] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:19.155369] [DEBUG] [LOCAL ] APOS: Loaded 7514 existing records from primary storage. [2025-09-30T17:15:19.155587] [INFO ] [MAIN ] APOS: Loaded 7514 existing records. [2025-09-30T17:15:19.367482] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:19.368260] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-30T17:15:19.368469] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-30T17:15:19.368804] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-30T17:15:19.368867] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-30T17:15:19.700790] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (3.45 seconds). [2025-09-30T17:15:19.816730] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-30T17:15:19.850857] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:19.852883] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-30T17:15:19.891683] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-09-30T17:15:19.939164] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-30T17:15:20.254373] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-30T17:15:20.715839] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T17:15:21.054404] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-30T17:15:21.491236] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:15:21.854388] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-30T17:15:22.047455] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T17:15:22.478387] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T17:15:22.654373] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-30T17:15:23.454406] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-30T17:15:23.840237] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T17:15:24.069111] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T17:15:24.254398] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-30T17:15:24.409896] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T17:15:25.054429] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-30T17:15:25.656589] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T17:15:25.800387] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T17:15:25.854402] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-30T17:15:26.654450] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-30T17:15:27.454382] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-30T17:15:27.826931] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T17:15:28.254413] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-30T17:15:28.304314] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T17:15:28.965869] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-30T17:15:29.054416] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-30T17:15:29.854391] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-30T17:15:30.624951] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T17:15:30.624675] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-30T17:15:30.640117] [INFO ] [REMOTE ] APH: Full fetch complete (77684 records). [2025-09-30T17:15:30.640268] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-30T17:15:30.664533] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-30T17:15:31.101799] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-30T17:15:31.102045] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-30T17:15:31.102965] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-30T17:15:31.103219] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-30T17:15:31.104935] [DEBUG] [LOCAL ] APH: Trimmed 77684 records to 53691 (keeping 200 days of data) [2025-09-30T17:15:31.238711] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-30T17:15:31.459130] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-30T17:15:31.518152] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-09-30T17:15:31.518351] [INFO ] [MAIN ] APH: Full history saved. [2025-09-30T17:15:31.519299] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 29.6s. Estimated remaining: 4h 24m 27s. Rate: 8.5 symbols/min [2025-09-30T17:15:31.649176] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T17:15:31.742981] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:31.801879] [DEBUG] [LOCAL ] APTV: Loaded 52148 existing records from primary storage. [2025-09-30T17:15:31.802434] [INFO ] [MAIN ] APTV: Loaded 52148 existing records. [2025-09-30T17:15:32.009661] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:32.009948] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-30T17:15:32.010006] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-30T17:15:32.010309] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-30T17:15:32.010369] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-30T17:15:32.259441] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-30T17:15:32.419585] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:33.054379] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-30T17:15:33.429412] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T17:15:33.763923] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T17:15:33.854335] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-30T17:15:34.014893] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T17:15:34.654400] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-30T17:15:35.459455] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-30T17:15:35.485993] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:15:36.091517] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T17:15:36.254350] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-30T17:15:36.735770] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-30T17:15:36.752957] [INFO ] [REMOTE ] APLE: Full fetch complete (74275 records). [2025-09-30T17:15:36.753148] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-30T17:15:36.881678] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-30T17:15:37.059599] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-30T17:15:37.226461] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-30T17:15:37.226563] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-30T17:15:37.227405] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-30T17:15:37.227480] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-30T17:15:37.229090] [DEBUG] [LOCAL ] APLE: Trimmed 74275 records to 51941 (keeping 200 days of data) [2025-09-30T17:15:37.565849] [DEBUG] [LOCAL ] APLE: Primary data saved (51941 records). [2025-09-30T17:15:37.566020] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-30T17:15:37.566133] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APLE took 35.0s. Estimated remaining: 4h 24m 2s. Rate: 8.5 symbols/min [2025-09-30T17:15:37.763756] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:37.763979] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-09-30T17:15:37.764037] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-09-30T17:15:37.764152] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-30T17:15:37.764194] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-30T17:15:37.764237] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-09-30T17:15:37.764284] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-30T17:15:37.859500] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-30T17:15:38.144550] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:38.654382] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-30T17:15:39.070824] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T17:15:39.440931] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T17:15:39.443761] [INFO ] [REMOTE ] APOS: Full fetch complete (10483 records). [2025-09-30T17:15:39.444070] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-30T17:15:39.459511] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-30T17:15:39.842503] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-30T17:15:39.842667] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-30T17:15:39.843007] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-30T17:15:39.858137] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-30T17:15:39.872844] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-30T17:15:39.872950] [DEBUG] [LOCAL ] APOS: Trimmed 10483 records to 7580 (keeping 200 days of data) [2025-09-30T17:15:39.930304] [DEBUG] [LOCAL ] APOS: Primary data saved (7580 records). [2025-09-30T17:15:39.930451] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-30T17:15:39.930536] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APOS took 21.0s. Estimated remaining: 4h 22m 36s. Rate: 8.5 symbols/min [2025-09-30T17:15:40.117945] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:40.125047] [DEBUG] [LOCAL ] AQNB: Loaded 4142 existing records from primary storage. [2025-09-30T17:15:40.125270] [INFO ] [MAIN ] AQNB: Loaded 4142 existing records. [2025-09-30T17:15:40.259496] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-30T17:15:40.330157] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:40.330385] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-30T17:15:40.330435] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-30T17:15:40.330668] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-30T17:15:40.330739] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-30T17:15:40.726184] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:41.054357] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-30T17:15:41.594106] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-30T17:15:41.638949] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:15:41.854376] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-30T17:15:42.654408] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-30T17:15:43.014233] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T17:15:43.454335] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-30T17:15:43.557932] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T17:15:44.257089] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-30T17:15:44.281579] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T17:15:44.285824] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T17:15:44.298963] [INFO ] [REMOTE ] APO: Full fetch complete (77290 records). [2025-09-30T17:15:44.299134] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-30T17:15:44.736907] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-30T17:15:44.737037] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-30T17:15:44.737849] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-30T17:15:44.737918] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-30T17:15:44.739582] [DEBUG] [LOCAL ] APO: Trimmed 77290 records to 53383 (keeping 200 days of data) [2025-09-30T17:15:45.070517] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-30T17:15:45.098235] [DEBUG] [LOCAL ] APO: Primary data saved (53383 records). [2025-09-30T17:15:45.098415] [INFO ] [MAIN ] APO: Full history saved. [2025-09-30T17:15:45.098537] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APO took 35.8s. Estimated remaining: 4h 21m 57s. Rate: 8.5 symbols/min [2025-09-30T17:15:45.279142] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:15:45.332063] [DEBUG] [LOCAL ] AR: Loaded 53584 existing records from primary storage. [2025-09-30T17:15:45.332411] [INFO ] [MAIN ] AR: Loaded 53584 existing records. [2025-09-30T17:15:45.530853] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:15:45.531088] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-30T17:15:45.531136] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-30T17:15:45.531496] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-30T17:15:45.531557] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-30T17:15:45.616185] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T17:15:45.857031] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-30T17:15:45.944335] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:15:45.976985] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T17:15:46.388971] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T17:15:46.654351] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-30T17:15:47.205947] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T17:15:47.454393] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-30T17:15:48.254358] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-30T17:15:48.692181] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T17:15:49.054413] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-30T17:15:49.580471] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T17:15:49.854414] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-30T17:15:50.445347] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T17:15:50.654359] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-30T17:15:50.911186] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T17:15:51.060252] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-30T17:15:51.454383] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-30T17:15:52.254408] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-30T17:15:53.054387] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-30T17:15:53.274533] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T17:15:53.440848] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-30T17:15:53.824092] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T17:15:53.854371] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-30T17:15:54.654366] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-30T17:15:55.283198] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T17:15:55.454377] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-30T17:15:55.631959] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T17:15:56.254400] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-30T17:15:57.054409] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-30T17:15:57.096215] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T17:15:57.854345] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-30T17:15:58.124840] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T17:15:58.654442] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-30T17:15:58.867879] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T17:15:59.110910] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T17:15:59.422096] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T17:15:59.454453] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-30T17:16:00.254382] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-30T17:16:00.922989] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T17:16:00.924740] [INFO ] [REMOTE ] AQNB: Full fetch complete (5864 records). [2025-09-30T17:16:00.924844] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-30T17:16:00.925680] [FATAL] [VALIDATOR ] AQNB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:16:00.925795] [FATAL] [MAIN ] AQNB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:16:00.925893] [WARN ] [MAIN ] AQNB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:16:00.926013] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-30T17:16:00.926113] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-09-30T17:16:00.926189] [INFO ] [LOCAL ] AQNB: Starting deletion of derivative data. [2025-09-30T17:16:00.926636] [DEBUG] [LOCAL ] AQNB: Deleted derivative data file. [2025-09-30T17:16:00.926877] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. AQNB took 21.0s. Estimated remaining: 4h 24m 16s. Rate: 8.5 symbols/min [2025-09-30T17:16:01.059494] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-30T17:16:01.133871] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:01.192085] [DEBUG] [LOCAL ] ARCO: Loaded 44534 existing records from primary storage. [2025-09-30T17:16:01.192590] [INFO ] [MAIN ] ARCO: Loaded 44534 existing records. [2025-09-30T17:16:01.421295] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:16:01.422216] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-30T17:16:01.422307] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-30T17:16:01.422803] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-30T17:16:01.422911] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-30T17:16:01.598158] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T17:16:01.859504] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-30T17:16:01.961958] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:02.654375] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-30T17:16:03.042114] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T17:16:03.321229] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T17:16:03.454405] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-30T17:16:04.259743] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-30T17:16:04.271869] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T17:16:04.720814] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T17:16:05.054418] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-30T17:16:05.861138] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-30T17:16:05.885154] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T17:16:06.654361] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-30T17:16:06.887785] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T17:16:07.454334] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-30T17:16:07.491737] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T17:16:08.024630] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:16:08.254384] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-30T17:16:09.054346] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-30T17:16:09.388554] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T17:16:09.400617] [INFO ] [REMOTE ] APTV: Full fetch complete (75964 records). [2025-09-30T17:16:09.400828] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-30T17:16:09.850183] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-30T17:16:09.850305] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-30T17:16:09.851200] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-30T17:16:09.851321] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-30T17:16:09.853186] [DEBUG] [LOCAL ] APTV: Trimmed 75964 records to 52122 (keeping 200 days of data) [2025-09-30T17:16:09.854682] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-30T17:16:09.977193] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T17:16:10.225176] [DEBUG] [LOCAL ] APTV: Primary data saved (52122 records). [2025-09-30T17:16:10.225368] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-30T17:16:10.225539] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. APTV took 38.7s. Estimated remaining: 4h 24m 45s. Rate: 8.4 symbols/min [2025-09-30T17:16:10.410812] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:10.427510] [DEBUG] [LOCAL ] ARDC: Loaded 14689 existing records from primary storage. [2025-09-30T17:16:10.427763] [INFO ] [MAIN ] ARDC: Loaded 14689 existing records. [2025-09-30T17:16:10.625933] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:16:10.626390] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-30T17:16:10.626499] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-30T17:16:10.626824] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-30T17:16:10.626887] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-30T17:16:10.663577] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-30T17:16:11.043683] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:11.080404] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T17:16:11.454346] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-30T17:16:11.787186] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T17:16:12.130016] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T17:16:12.254380] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-30T17:16:13.054392] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-30T17:16:13.361184] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T17:16:13.867328] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-30T17:16:13.874512] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T17:16:13.887341] [INFO ] [REMOTE ] AQN: Full fetch complete (75292 records). [2025-09-30T17:16:13.887614] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-30T17:16:14.178247] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T17:16:14.393913] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-30T17:16:14.394029] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-30T17:16:14.395848] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-30T17:16:14.395960] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-30T17:16:14.400908] [DEBUG] [LOCAL ] AQN: Trimmed 75292 records to 51903 (keeping 200 days of data) [2025-09-30T17:16:14.679542] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-30T17:16:14.800078] [DEBUG] [LOCAL ] AQN: Primary data saved (51903 records). [2025-09-30T17:16:14.800396] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-30T17:16:14.800505] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQN took 37.2s. Estimated remaining: 4h 23m 57s. Rate: 8.5 symbols/min [2025-09-30T17:16:15.004989] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:15.005248] [DEBUG] [LOCAL ] ARDT: No existing data file found in primary storage. [2025-09-30T17:16:15.005314] [WARN ] [MAIN ] ARDT: No existing data found, performing full refresh instead. [2025-09-30T17:16:15.005458] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-30T17:16:15.005522] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-30T17:16:15.005598] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-09-30T17:16:15.005637] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-30T17:16:15.457355] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:15.457451] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-30T17:16:15.468701] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:16:15.756486] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T17:16:16.254378] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-30T17:16:16.991163] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T17:16:17.054356] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-30T17:16:17.462176] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:16:17.812633] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T17:16:17.854398] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-30T17:16:18.654380] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-30T17:16:19.062842] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T17:16:19.278608] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T17:16:19.454371] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-30T17:16:20.254376] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-30T17:16:20.699747] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T17:16:21.054400] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-30T17:16:21.243063] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-30T17:16:21.854392] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-30T17:16:22.605266] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T17:16:22.654317] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-30T17:16:23.050523] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T17:16:23.130733] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T17:16:23.454368] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-30T17:16:24.254379] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-30T17:16:24.890388] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:16:25.054369] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-30T17:16:25.771984] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T17:16:25.854404] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-30T17:16:26.387910] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T17:16:26.402292] [INFO ] [REMOTE ] AR: Full fetch complete (77533 records). [2025-09-30T17:16:26.402480] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-30T17:16:26.672825] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-30T17:16:26.918066] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-30T17:16:26.918236] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-30T17:16:26.919156] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-30T17:16:26.919226] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-30T17:16:26.920919] [DEBUG] [LOCAL ] AR: Trimmed 77533 records to 53584 (keeping 200 days of data) [2025-09-30T17:16:27.259186] [DEBUG] [LOCAL ] AR: Primary data saved (53584 records). [2025-09-30T17:16:27.259465] [INFO ] [MAIN ] AR: Full history saved. [2025-09-30T17:16:27.259596] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 42.2s. Estimated remaining: 4h 25m 17s. Rate: 8.4 symbols/min [2025-09-30T17:16:27.473675] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-30T17:16:27.473556] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:27.559703] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T17:16:27.571307] [DEBUG] [LOCAL ] ARE: Loaded 50593 existing records from primary storage. [2025-09-30T17:16:27.572292] [INFO ] [MAIN ] ARE: Loaded 50593 existing records. [2025-09-30T17:16:27.765947] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:16:27.766157] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-30T17:16:27.766316] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-30T17:16:27.766869] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-30T17:16:27.766932] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-30T17:16:28.084473] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T17:16:28.173828] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:28.254320] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-30T17:16:28.509024] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T17:16:29.054386] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-30T17:16:29.862903] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-30T17:16:29.868945] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T17:16:29.927907] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T17:16:30.654362] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-30T17:16:31.193998] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T17:16:31.454417] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-30T17:16:31.784986] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T17:16:32.254366] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-30T17:16:32.489712] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T17:16:33.054366] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-30T17:16:33.333338] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T17:16:33.338931] [INFO ] [REMOTE ] ARDC: Full fetch complete (20575 records). [2025-09-30T17:16:33.339115] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-30T17:16:33.772463] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-30T17:16:33.772582] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-30T17:16:33.772983] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-30T17:16:33.773108] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-30T17:16:33.773876] [DEBUG] [LOCAL ] ARDC: Trimmed 20575 records to 14721 (keeping 200 days of data) [2025-09-30T17:16:33.854467] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-30T17:16:33.874242] [DEBUG] [LOCAL ] ARDC: Primary data saved (14721 records). [2025-09-30T17:16:33.874442] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-30T17:16:33.874541] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 23.6s. Estimated remaining: 4h 25m 1s. Rate: 8.4 symbols/min [2025-09-30T17:16:34.087317] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:34.088922] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T17:16:34.159701] [DEBUG] [LOCAL ] ARES: Loaded 49525 existing records from primary storage. [2025-09-30T17:16:34.160132] [INFO ] [MAIN ] ARES: Loaded 49525 existing records. [2025-09-30T17:16:34.384174] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:16:34.384466] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-30T17:16:34.384515] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-30T17:16:34.384909] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-30T17:16:34.384971] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-30T17:16:34.659538] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-30T17:16:34.798856] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:35.405760] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T17:16:35.454401] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-30T17:16:35.955276] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T17:16:36.254370] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-30T17:16:37.054372] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-30T17:16:37.112181] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T17:16:37.854329] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-30T17:16:37.969196] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T17:16:38.371491] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T17:16:38.654354] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-30T17:16:39.468873] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-30T17:16:39.497530] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T17:16:40.254362] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-30T17:16:40.572817] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T17:16:41.054415] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-30T17:16:41.320979] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T17:16:41.333085] [INFO ] [REMOTE ] ARCO: Full fetch complete (65303 records). [2025-09-30T17:16:41.333254] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-30T17:16:41.336382] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:16:41.336498] [FATAL] [MAIN ] ARCO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:16:41.336563] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:16:41.336608] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-30T17:16:41.336707] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-09-30T17:16:41.336764] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-09-30T17:16:41.337216] [DEBUG] [LOCAL ] ARCO: Deleted derivative data file. [2025-09-30T17:16:41.340185] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARCO took 40.4s. Estimated remaining: 4h 24m 60s. Rate: 8.4 symbols/min [2025-09-30T17:16:41.533842] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:41.594580] [DEBUG] [LOCAL ] ARI: Loaded 43363 existing records from primary storage. [2025-09-30T17:16:41.594995] [INFO ] [MAIN ] ARI: Loaded 43363 existing records. [2025-09-30T17:16:41.793703] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:16:41.794037] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-30T17:16:41.794102] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-30T17:16:41.794505] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-30T17:16:41.794589] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-30T17:16:41.865824] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-30T17:16:41.998110] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T17:16:42.237857] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:42.654318] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-30T17:16:42.705753] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:16:43.316970] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T17:16:43.322927] [INFO ] [REMOTE ] ARDT: Full fetch complete (41216 records). [2025-09-30T17:16:43.323063] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-30T17:16:43.459466] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-30T17:16:43.753139] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-30T17:16:43.753235] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-30T17:16:43.753826] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-30T17:16:43.753899] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-30T17:16:43.754875] [DEBUG] [LOCAL ] ARDT: Trimmed 41216 records to 27698 (keeping 200 days of data) [2025-09-30T17:16:43.928443] [DEBUG] [LOCAL ] ARDT: Primary data saved (27698 records). [2025-09-30T17:16:43.928595] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-30T17:16:43.928710] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 29.1s. Estimated remaining: 4h 23m 41s. Rate: 8.5 symbols/min [2025-09-30T17:16:44.120023] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:44.120316] [DEBUG] [LOCAL ] ARIS: No existing data file found in primary storage. [2025-09-30T17:16:44.120387] [WARN ] [MAIN ] ARIS: No existing data found, performing full refresh instead. [2025-09-30T17:16:44.120632] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-30T17:16:44.120717] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-30T17:16:44.120771] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-09-30T17:16:44.120806] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-30T17:16:44.262942] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-30T17:16:44.520960] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:16:44.559661] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T17:16:44.850062] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T17:16:45.054372] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-30T17:16:45.854332] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-30T17:16:46.028075] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T17:16:46.477235] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T17:16:46.654407] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-30T17:16:47.439463] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T17:16:47.454314] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-30T17:16:48.128255] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T17:16:48.254405] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-30T17:16:49.054338] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-30T17:16:49.256989] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:16:49.854358] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-30T17:16:49.932202] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T17:16:50.654426] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-30T17:16:51.454464] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-30T17:16:51.585571] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T17:16:51.664855] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-30T17:16:52.254389] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-30T17:16:52.476249] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T17:16:52.585789] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T17:16:53.054379] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-30T17:16:53.854365] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-30T17:16:54.032161] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T17:16:54.501956] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:16:54.654402] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-30T17:16:55.235077] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T17:16:55.454370] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-30T17:16:56.254368] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-30T17:16:56.437170] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T17:16:57.054364] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-30T17:16:57.101677] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:16:57.854370] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-30T17:16:57.968007] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T17:16:58.654374] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-30T17:16:58.954635] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T17:16:58.965977] [INFO ] [REMOTE ] ARES: Full fetch complete (70699 records). [2025-09-30T17:16:58.966144] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-30T17:16:59.419682] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-30T17:16:59.419802] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-30T17:16:59.420491] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-30T17:16:59.420540] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-30T17:16:59.422063] [DEBUG] [LOCAL ] ARES: Trimmed 70699 records to 49530 (keeping 200 days of data) [2025-09-30T17:16:59.480433] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-30T17:16:59.753209] [DEBUG] [LOCAL ] ARES: Primary data saved (49530 records). [2025-09-30T17:16:59.753367] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-30T17:16:59.754761] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARES took 25.9s. Estimated remaining: 4h 25m 51s. Rate: 8.4 symbols/min [2025-09-30T17:16:59.971271] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:16:59.973742] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-09-30T17:16:59.973577] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T17:16:59.973938] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-09-30T17:16:59.984464] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-30T17:16:59.984724] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-30T17:16:59.984794] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-09-30T17:16:59.984834] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-30T17:17:00.000267] [INFO ] [REMOTE ] ARE: Full fetch complete (72599 records). [2025-09-30T17:17:00.041856] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-30T17:17:00.838926] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:00.850910] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-30T17:17:00.942354] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-30T17:17:00.945475] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-30T17:17:00.946712] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-30T17:17:00.949094] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T17:17:00.947167] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-30T17:17:00.961832] [DEBUG] [LOCAL ] ARE: Trimmed 72599 records to 50614 (keeping 200 days of data) [2025-09-30T17:17:01.062803] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-30T17:17:01.235176] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T17:17:01.337254] [DEBUG] [LOCAL ] ARE: Primary data saved (50614 records). [2025-09-30T17:17:01.337412] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-30T17:17:01.337505] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARE took 34.1s. Estimated remaining: 4h 24m 17s. Rate: 8.4 symbols/min [2025-09-30T17:17:01.546015] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:01.546243] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-09-30T17:17:01.546298] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-09-30T17:17:01.546468] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-30T17:17:01.546568] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-30T17:17:01.546635] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-09-30T17:17:01.546715] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-30T17:17:01.859932] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-30T17:17:01.973160] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:02.548838] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T17:17:02.654415] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-30T17:17:02.852905] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T17:17:03.144952] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T17:17:03.454398] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-30T17:17:04.254351] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-30T17:17:04.392422] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T17:17:05.028904] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:17:05.054318] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-30T17:17:05.854339] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-30T17:17:05.949987] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T17:17:06.654342] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-30T17:17:06.704240] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T17:17:07.116855] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T17:17:07.454387] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-30T17:17:08.058523] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T17:17:08.254387] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-30T17:17:09.054371] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-30T17:17:09.408285] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:17:09.417908] [INFO ] [REMOTE ] ARIS: Full fetch complete (60297 records). [2025-09-30T17:17:09.418045] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-30T17:17:09.873989] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-30T17:17:09.870706] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-30T17:17:09.875119] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-30T17:17:09.875849] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-30T17:17:09.875938] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-30T17:17:09.919871] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:17:09.917988] [DEBUG] [LOCAL ] ARIS: Trimmed 60297 records to 42103 (keeping 200 days of data) [2025-09-30T17:17:10.211788] [DEBUG] [LOCAL ] ARIS: Primary data saved (42103 records). [2025-09-30T17:17:10.211927] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-30T17:17:10.212005] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARIS took 26.3s. Estimated remaining: 4h 24m 37s. Rate: 8.4 symbols/min [2025-09-30T17:17:10.421628] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:10.421935] [DEBUG] [LOCAL ] AROC: No existing data file found in primary storage. [2025-09-30T17:17:10.422074] [WARN ] [MAIN ] AROC: No existing data found, performing full refresh instead. [2025-09-30T17:17:10.422277] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-30T17:17:10.422471] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-30T17:17:10.422590] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-09-30T17:17:10.422681] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-30T17:17:10.624329] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:17:10.662768] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-30T17:17:10.881409] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:11.454389] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-30T17:17:11.533444] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T17:17:12.023775] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T17:17:12.254391] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-30T17:17:12.956141] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T17:17:13.054378] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-30T17:17:13.769441] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T17:17:13.854387] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-30T17:17:14.493029] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T17:17:14.654402] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-30T17:17:15.454390] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-30T17:17:15.501105] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:17:15.900834] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T17:17:16.254370] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-30T17:17:17.054400] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-30T17:17:17.142928] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T17:17:17.812581] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T17:17:17.854396] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-30T17:17:18.573979] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T17:17:18.584046] [INFO ] [REMOTE ] ARI: Full fetch complete (62765 records). [2025-09-30T17:17:18.584217] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-30T17:17:18.665573] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-30T17:17:19.075403] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-30T17:17:19.075502] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-30T17:17:19.076233] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-30T17:17:19.076465] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-30T17:17:19.078076] [DEBUG] [LOCAL ] ARI: Trimmed 62765 records to 43459 (keeping 200 days of data) [2025-09-30T17:17:19.369399] [DEBUG] [LOCAL ] ARI: Primary data saved (43459 records). [2025-09-30T17:17:19.369551] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-30T17:17:19.370673] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARI took 38.0s. Estimated remaining: 4h 25m 1s. Rate: 8.4 symbols/min [2025-09-30T17:17:19.454742] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-30T17:17:19.563315] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:19.592708] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T17:17:19.655872] [DEBUG] [LOCAL ] ARR: Loaded 52025 existing records from primary storage. [2025-09-30T17:17:19.656231] [INFO ] [MAIN ] ARR: Loaded 52025 existing records. [2025-09-30T17:17:19.847421] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:17:19.847666] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-30T17:17:19.847730] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-30T17:17:19.848049] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-30T17:17:19.848123] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-30T17:17:20.259924] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-30T17:17:20.271168] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:20.494187] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T17:17:21.054371] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-30T17:17:21.114753] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T17:17:21.524311] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T17:17:21.854367] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-30T17:17:22.654362] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-30T17:17:22.815454] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T17:17:23.299517] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:17:23.454370] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-30T17:17:24.254377] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-30T17:17:24.378491] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T17:17:24.390104] [INFO ] [REMOTE ] ARLO: Full fetch complete (62279 records). [2025-09-30T17:17:24.390265] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-30T17:17:24.391380] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:17:24.391480] [FATAL] [MAIN ] ARLO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:17:24.391525] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:17:24.391567] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-30T17:17:24.391627] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-09-30T17:17:24.391703] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-09-30T17:17:24.391762] [DEBUG] [LOCAL ] ARLO: No derivative data file found to delete. [2025-09-30T17:17:24.391823] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 24.6s. Estimated remaining: 4h 24m 21s. Rate: 8.4 symbols/min [2025-09-30T17:17:24.587327] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:24.631661] [DEBUG] [LOCAL ] ARW: Loaded 33065 existing records from primary storage. [2025-09-30T17:17:24.631947] [INFO ] [MAIN ] ARW: Loaded 33065 existing records. [2025-09-30T17:17:24.820781] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:17:24.821030] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-30T17:17:24.821121] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-30T17:17:24.821613] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-30T17:17:24.821708] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-30T17:17:25.055133] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-30T17:17:25.223933] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:25.253538] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T17:17:25.854369] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-30T17:17:26.116080] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T17:17:26.654368] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-30T17:17:26.881095] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T17:17:27.260487] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-30T17:17:27.454367] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-30T17:17:28.254329] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-30T17:17:28.347918] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T17:17:28.808101] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T17:17:29.054361] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-30T17:17:29.728034] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T17:17:29.854371] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-30T17:17:30.654357] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-30T17:17:31.134442] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T17:17:31.454352] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-30T17:17:31.855432] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T17:17:32.254332] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-30T17:17:32.427696] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T17:17:32.594198] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T17:17:33.054426] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-30T17:17:33.854387] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-30T17:17:33.992961] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T17:17:34.004960] [INFO ] [REMOTE ] ARMK: Full fetch complete (72233 records). [2025-09-30T17:17:34.005222] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-30T17:17:34.006500] [FATAL] [VALIDATOR ] ARMK: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:17:34.006629] [FATAL] [MAIN ] ARMK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:17:34.006712] [WARN ] [MAIN ] ARMK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:17:34.006764] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-30T17:17:34.006857] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-09-30T17:17:34.006914] [INFO ] [LOCAL ] ARMK: Starting deletion of derivative data. [2025-09-30T17:17:34.006958] [DEBUG] [LOCAL ] ARMK: No derivative data file found to delete. [2025-09-30T17:17:34.007030] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARMK took 32.7s. Estimated remaining: 4h 24m 52s. Rate: 8.4 symbols/min [2025-09-30T17:17:34.192375] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:34.192683] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-30T17:17:34.192742] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-30T17:17:34.192915] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-30T17:17:34.192988] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-30T17:17:34.193056] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-30T17:17:34.193101] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-30T17:17:34.562843] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:34.654349] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-30T17:17:34.880777] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:17:34.881310] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-30T17:17:34.881437] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:17:34.881518] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-09-30T17:17:34.881605] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:17:34.881731] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-30T17:17:34.881816] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-30T17:17:34.881858] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-30T17:17:34.881900] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-30T17:17:34.881959] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. ARX took 0.9s. Estimated remaining: 4h 23m 11s. Rate: 8.4 symbols/min [2025-09-30T17:17:35.071268] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:35.071572] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-09-30T17:17:35.071630] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-09-30T17:17:35.071778] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-30T17:17:35.071820] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-30T17:17:35.071861] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-30T17:17:35.071893] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-30T17:17:35.450834] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:35.465970] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-30T17:17:35.494701] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-30T17:17:35.545256] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T17:17:36.254394] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-30T17:17:37.054490] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-30T17:17:37.294338] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T17:17:37.854347] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-30T17:17:37.950065] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T17:17:38.654345] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-30T17:17:38.999958] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T17:17:39.222240] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:17:39.454358] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-30T17:17:40.144330] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:17:40.254361] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-30T17:17:41.054302] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-30T17:17:41.332352] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T17:17:41.854346] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-30T17:17:42.105068] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T17:17:42.287451] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T17:17:42.654432] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-30T17:17:43.441430] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T17:17:43.454303] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-30T17:17:44.254393] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-30T17:17:44.573121] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T17:17:45.054397] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-30T17:17:45.207897] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T17:17:45.316913] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T17:17:45.854377] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-30T17:17:46.654419] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-30T17:17:47.071409] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T17:17:47.164985] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-30T17:17:47.454376] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-30T17:17:48.254356] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-30T17:17:48.409818] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T17:17:48.766137] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T17:17:49.054384] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-30T17:17:49.854420] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-30T17:17:49.989031] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:17:50.654395] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-30T17:17:51.088841] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T17:17:51.099418] [INFO ] [REMOTE ] AROC: Full fetch complete (70412 records). [2025-09-30T17:17:51.099566] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-30T17:17:51.100461] [FATAL] [VALIDATOR ] AROC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:17:51.100552] [FATAL] [MAIN ] AROC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:17:51.100596] [WARN ] [MAIN ] AROC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:17:51.100636] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-30T17:17:51.100752] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-09-30T17:17:51.100806] [INFO ] [LOCAL ] AROC: Starting deletion of derivative data. [2025-09-30T17:17:51.100849] [DEBUG] [LOCAL ] AROC: No derivative data file found to delete. [2025-09-30T17:17:51.100919] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. AROC took 40.9s. Estimated remaining: 4h 25m 19s. Rate: 8.4 symbols/min [2025-09-30T17:17:51.302555] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:51.318702] [DEBUG] [LOCAL ] ASA: Loaded 14041 existing records from primary storage. [2025-09-30T17:17:51.318965] [INFO ] [MAIN ] ASA: Loaded 14041 existing records. [2025-09-30T17:17:51.458952] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-30T17:17:51.545792] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:17:51.546500] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-30T17:17:51.546583] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-30T17:17:51.547161] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-30T17:17:51.547344] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-30T17:17:51.946529] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T17:17:51.994534] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:51.994828] [INFO ] [REMOTE ] ARR: Full fetch complete (75179 records). [2025-09-30T17:17:51.995119] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-30T17:17:52.265447] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-30T17:17:52.295185] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T17:17:52.463123] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-30T17:17:52.463242] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-30T17:17:52.464063] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-30T17:17:52.464134] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-30T17:17:52.465795] [DEBUG] [LOCAL ] ARR: Trimmed 75179 records to 52041 (keeping 200 days of data) [2025-09-30T17:17:52.823351] [DEBUG] [LOCAL ] ARR: Primary data saved (52041 records). [2025-09-30T17:17:52.823525] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-30T17:17:52.828582] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARR took 33.5s. Estimated remaining: 4h 23m 52s. Rate: 8.4 symbols/min [2025-09-30T17:17:53.006031] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:53.006219] [DEBUG] [LOCAL ] ASAN: No existing data file found in primary storage. [2025-09-30T17:17:53.006283] [WARN ] [MAIN ] ASAN: No existing data found, performing full refresh instead. [2025-09-30T17:17:53.006399] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-30T17:17:53.006442] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-30T17:17:53.006484] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-09-30T17:17:53.006517] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-30T17:17:53.063795] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-30T17:17:53.394665] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:53.429929] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T17:17:53.603122] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T17:17:53.854438] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-30T17:17:54.356582] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T17:17:54.363922] [INFO ] [REMOTE ] ARW: Full fetch complete (47863 records). [2025-09-30T17:17:54.364031] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-30T17:17:54.659495] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-30T17:17:54.779799] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-30T17:17:54.779892] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-30T17:17:54.780418] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-30T17:17:54.780467] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-30T17:17:54.781594] [DEBUG] [LOCAL ] ARW: Trimmed 47863 records to 33054 (keeping 200 days of data) [2025-09-30T17:17:54.984275] [DEBUG] [LOCAL ] ARW: Primary data saved (33054 records). [2025-09-30T17:17:54.984424] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-30T17:17:54.984509] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ARW took 30.6s. Estimated remaining: 4h 22m 32s. Rate: 8.5 symbols/min [2025-09-30T17:17:55.188108] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:17:55.245310] [DEBUG] [LOCAL ] ASB: Loaded 49512 existing records from primary storage. [2025-09-30T17:17:55.245819] [INFO ] [MAIN ] ASB: Loaded 49512 existing records. [2025-09-30T17:17:55.470794] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-30T17:17:55.477217] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:17:55.478001] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-30T17:17:55.479161] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-30T17:17:55.488277] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T17:17:55.491169] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-30T17:17:55.492269] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-30T17:17:55.897405] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:17:56.145689] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-30T17:17:56.254363] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-30T17:17:57.054392] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-30T17:17:57.205312] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T17:17:57.757839] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T17:17:57.854361] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-30T17:17:58.654347] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-30T17:17:58.828911] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T17:17:59.454424] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-30T17:17:59.694389] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T17:18:00.082380] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T17:18:00.239551] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T17:18:00.254374] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-30T17:18:01.054434] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-30T17:18:01.094395] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T17:18:01.854381] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-30T17:18:02.573012] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T17:18:02.654369] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-30T17:18:03.454326] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-30T17:18:03.658037] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T17:18:03.698386] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T17:18:04.254387] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-30T17:18:05.054448] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-30T17:18:05.105728] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T17:18:05.274054] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T17:18:05.854434] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-30T17:18:06.622516] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T17:18:06.654374] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-30T17:18:07.009322] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:18:07.023547] [INFO ] [REMOTE ] AS: Full fetch complete (76526 records). [2025-09-30T17:18:07.023809] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-30T17:18:07.455101] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-30T17:18:07.498160] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T17:18:07.504369] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-30T17:18:07.504547] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-30T17:18:07.509576] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-30T17:18:07.509819] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-30T17:18:07.515004] [DEBUG] [LOCAL ] AS: Trimmed 76526 records to 53084 (keeping 200 days of data) [2025-09-30T17:18:07.843398] [DEBUG] [LOCAL ] AS: Primary data saved (53084 records). [2025-09-30T17:18:07.843545] [INFO ] [MAIN ] AS: Full history saved. [2025-09-30T17:18:07.843704] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. AS took 33.0s. Estimated remaining: 4h 23m 49s. Rate: 8.4 symbols/min [2025-09-30T17:18:08.026853] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:18:08.033458] [DEBUG] [LOCAL ] ASBA: Loaded 3427 existing records from primary storage. [2025-09-30T17:18:08.033685] [INFO ] [MAIN ] ASBA: Loaded 3427 existing records. [2025-09-30T17:18:08.217675] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:18:08.217904] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-30T17:18:08.218003] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-30T17:18:08.218196] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-30T17:18:08.218285] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-30T17:18:08.261861] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-30T17:18:08.607308] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:18:09.054431] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-30T17:18:09.285916] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T17:18:09.473465] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T17:18:09.806310] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-30T17:18:09.854384] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-30T17:18:10.458201] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T17:18:10.654409] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-30T17:18:11.206709] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T17:18:11.454386] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-30T17:18:12.254363] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-30T17:18:12.640997] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-30T17:18:13.054330] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-30T17:18:13.178047] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T17:18:13.854399] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-30T17:18:14.303186] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T17:18:14.308132] [INFO ] [REMOTE ] ASA: Full fetch complete (18634 records). [2025-09-30T17:18:14.308217] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-30T17:18:14.308738] [FATAL] [VALIDATOR ] ASA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:18:14.308843] [FATAL] [MAIN ] ASA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:18:14.308892] [WARN ] [MAIN ] ASA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:18:14.308976] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-30T17:18:14.309063] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-09-30T17:18:14.309128] [INFO ] [LOCAL ] ASA: Starting deletion of derivative data. [2025-09-30T17:18:14.309525] [DEBUG] [LOCAL ] ASA: Deleted derivative data file. [2025-09-30T17:18:14.309661] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. ASA took 23.2s. Estimated remaining: 4h 23m 32s. Rate: 8.4 symbols/min [2025-09-30T17:18:14.529844] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:18:14.530043] [DEBUG] [LOCAL ] ASC: No existing data file found in primary storage. [2025-09-30T17:18:14.530082] [WARN ] [MAIN ] ASC: No existing data found, performing full refresh instead. [2025-09-30T17:18:14.530196] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-30T17:18:14.530238] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-30T17:18:14.530280] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-09-30T17:18:14.530315] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-30T17:18:14.659600] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-30T17:18:14.917320] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:18:15.220863] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T17:18:15.382287] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T17:18:15.454375] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-30T17:18:16.254374] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-30T17:18:16.853717] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T17:18:17.054403] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-30T17:18:17.138034] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T17:18:17.534731] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T17:18:17.854401] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-30T17:18:18.238615] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-30T17:18:18.654362] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-30T17:18:19.272702] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T17:18:19.454378] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-30T17:18:20.254363] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-30T17:18:21.032677] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-30T17:18:21.034117] [INFO ] [REMOTE ] ASBA: Full fetch complete (5293 records). [2025-09-30T17:18:21.034197] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-30T17:18:21.059587] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-30T17:18:21.452136] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-30T17:18:21.452409] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-30T17:18:21.452743] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-30T17:18:21.452872] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-30T17:18:21.453428] [DEBUG] [LOCAL ] ASBA: Trimmed 5293 records to 3450 (keeping 200 days of data) [2025-09-30T17:18:21.475819] [DEBUG] [LOCAL ] ASBA: Primary data saved (3450 records). [2025-09-30T17:18:21.476018] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-30T17:18:21.476127] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASBA took 13.6s. Estimated remaining: 4h 23m 25s. Rate: 8.4 symbols/min [2025-09-30T17:18:21.707044] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:18:21.709797] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-30T17:18:21.710002] [DEBUG] [LOCAL ] ASG: No existing data file found in primary storage. [2025-09-30T17:18:21.720438] [WARN ] [MAIN ] ASG: No existing data found, performing full refresh instead. [2025-09-30T17:18:21.721386] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-30T17:18:21.721468] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-30T17:18:21.721558] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-09-30T17:18:21.722044] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-30T17:18:21.859500] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-30T17:18:22.145025] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:18:22.654420] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-30T17:18:22.711361] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T17:18:23.454410] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-30T17:18:23.874880] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T17:18:24.254430] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-30T17:18:24.318541] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-30T17:18:25.054373] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-30T17:18:25.854431] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-30T17:18:25.951490] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-30T17:18:26.654369] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-30T17:18:27.237672] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T17:18:27.454366] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-30T17:18:27.584406] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-30T17:18:28.254329] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-30T17:18:28.320730] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (4.07 seconds). [2025-09-30T17:18:28.557150] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T17:18:28.588076] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T17:18:29.054356] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-30T17:18:29.854334] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-30T17:18:30.035720] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T17:18:30.047396] [INFO ] [REMOTE ] ASAN: Full fetch complete (76148 records). [2025-09-30T17:18:30.047552] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-30T17:18:30.048433] [FATAL] [VALIDATOR ] ASAN: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:18:30.048564] [FATAL] [MAIN ] ASAN: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:18:30.048610] [WARN ] [MAIN ] ASAN: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:18:30.048700] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-30T17:18:30.048776] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-09-30T17:18:30.048815] [INFO ] [LOCAL ] ASAN: Starting deletion of derivative data. [2025-09-30T17:18:30.048857] [DEBUG] [LOCAL ] ASAN: No derivative data file found to delete. [2025-09-30T17:18:30.048938] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASAN took 37.2s. Estimated remaining: 4h 23m 39s. Rate: 8.4 symbols/min [2025-09-30T17:18:30.249132] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:18:30.283554] [DEBUG] [LOCAL ] ASGI: Loaded 22549 existing records from primary storage. [2025-09-30T17:18:30.283912] [INFO ] [MAIN ] ASGI: Loaded 22549 existing records. [2025-09-30T17:18:30.495444] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:18:30.496254] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-30T17:18:30.496397] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-30T17:18:30.496710] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-30T17:18:30.496796] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-30T17:18:30.662852] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-30T17:18:30.927683] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T17:18:30.963045] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:18:31.433397] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T17:18:31.454354] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-30T17:18:31.989786] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T17:18:32.254350] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-30T17:18:32.982324] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T17:18:33.054355] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-30T17:18:33.866387] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-30T17:18:33.889881] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T17:18:34.246985] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T17:18:34.654404] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-30T17:18:35.023030] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T17:18:35.454368] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-30T17:18:35.547263] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T17:18:36.254367] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-30T17:18:37.054371] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-30T17:18:37.854351] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-30T17:18:38.238835] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-09-30T17:18:38.654382] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-30T17:18:38.994223] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-30T17:18:39.397479] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-30T17:18:39.454327] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-30T17:18:39.522886] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T17:18:40.169695] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T17:18:40.254350] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-30T17:18:40.480823] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T17:18:41.054385] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-30T17:18:41.830189] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T17:18:41.854313] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-30T17:18:42.346600] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T17:18:42.654353] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-30T17:18:43.454336] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-30T17:18:43.647930] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T17:18:43.658501] [INFO ] [REMOTE ] ASB: Full fetch complete (71240 records). [2025-09-30T17:18:43.658735] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-30T17:18:43.659590] [FATAL] [VALIDATOR ] ASB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:18:43.659704] [FATAL] [MAIN ] ASB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:18:43.659752] [WARN ] [MAIN ] ASB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:18:43.659851] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-30T17:18:43.659935] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-09-30T17:18:43.659983] [INFO ] [LOCAL ] ASB: Starting deletion of derivative data. [2025-09-30T17:18:43.660293] [DEBUG] [LOCAL ] ASB: Deleted derivative data file. [2025-09-30T17:18:43.660955] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASB took 48.7s. Estimated remaining: 4h 25m 3s. Rate: 8.4 symbols/min [2025-09-30T17:18:43.785355] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T17:18:43.865982] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:18:43.914962] [DEBUG] [LOCAL ] ASGN: Loaded 35955 existing records from primary storage. [2025-09-30T17:18:43.915270] [INFO ] [MAIN ] ASGN: Loaded 35955 existing records. [2025-09-30T17:18:44.112806] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:18:44.113032] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-30T17:18:44.113080] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-30T17:18:44.113527] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-30T17:18:44.113587] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-30T17:18:44.267214] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-30T17:18:44.403749] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T17:18:44.523378] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:18:45.054408] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-30T17:18:45.854443] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-30T17:18:45.886890] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T17:18:45.897865] [INFO ] [REMOTE ] ASC: Full fetch complete (56777 records). [2025-09-30T17:18:45.898052] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-30T17:18:46.331368] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-30T17:18:46.331488] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-30T17:18:46.332174] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-30T17:18:46.332242] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-30T17:18:46.333516] [DEBUG] [LOCAL ] ASC: Trimmed 56777 records to 37479 (keeping 200 days of data) [2025-09-30T17:18:46.572913] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T17:18:46.614932] [DEBUG] [LOCAL ] ASC: Primary data saved (37479 records). [2025-09-30T17:18:46.615108] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-30T17:18:46.615204] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASC took 32.3s. Estimated remaining: 4h 23m 57s. Rate: 8.4 symbols/min [2025-09-30T17:18:46.654394] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-30T17:18:47.024228] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T17:18:47.454370] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-30T17:18:48.049285] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:18:48.254383] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-30T17:18:48.766484] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T17:18:49.054403] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-30T17:18:49.613296] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T17:18:49.854361] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-30T17:18:50.113367] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T17:18:50.117457] [INFO ] [REMOTE ] ASG: Full fetch complete (31206 records). [2025-09-30T17:18:50.117548] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-30T17:18:50.118087] [FATAL] [VALIDATOR ] ASG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:18:50.118176] [FATAL] [MAIN ] ASG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:18:50.118221] [WARN ] [MAIN ] ASG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:18:50.118285] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-30T17:18:50.118396] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-09-30T17:18:50.118452] [INFO ] [LOCAL ] ASG: Starting deletion of derivative data. [2025-09-30T17:18:50.118496] [DEBUG] [LOCAL ] ASG: No derivative data file found to delete. [2025-09-30T17:18:50.118552] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASG took 28.6s. Estimated remaining: 4h 22m 58s. Rate: 8.4 symbols/min [2025-09-30T17:18:50.654399] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-30T17:18:51.021239] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T17:18:51.454398] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-30T17:18:51.832454] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T17:18:52.254365] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-30T17:18:52.928910] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T17:18:53.054574] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-30T17:18:53.384500] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T17:18:53.854432] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-30T17:18:54.411615] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T17:18:54.654342] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-30T17:18:54.827199] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T17:18:55.454415] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-30T17:18:56.017390] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T17:18:56.254388] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-30T17:18:56.570226] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T17:18:57.054389] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-30T17:18:57.563034] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T17:18:57.732903] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T17:18:57.854364] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-30T17:18:58.654406] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-30T17:18:59.028379] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T17:18:59.034811] [INFO ] [REMOTE ] ASGI: Full fetch complete (33625 records). [2025-09-30T17:18:59.034948] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-30T17:18:59.452480] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-30T17:18:59.452571] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-30T17:18:59.453021] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-30T17:18:59.453089] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-30T17:18:59.454097] [DEBUG] [LOCAL ] ASGI: Trimmed 33625 records to 22639 (keeping 200 days of data) [2025-09-30T17:18:59.623918] [DEBUG] [LOCAL ] ASGI: Primary data saved (22639 records). [2025-09-30T17:18:59.624080] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-30T17:18:59.624233] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASGI took 29.6s. Estimated remaining: 4h 23m 24s. Rate: 8.4 symbols/min [2025-09-30T17:18:59.858411] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T17:18:59.867444] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-30T17:19:01.448033] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T17:19:01.457326] [INFO ] [REMOTE ] ASGN: Full fetch complete (52162 records). [2025-09-30T17:19:01.457555] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-30T17:19:01.884792] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-30T17:19:01.884887] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-30T17:19:01.885484] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-30T17:19:01.885532] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-30T17:19:01.886956] [DEBUG] [LOCAL ] ASGN: Trimmed 52162 records to 35994 (keeping 200 days of data) [2025-09-30T17:19:02.129918] [DEBUG] [LOCAL ] ASGN: Primary data saved (35994 records). [2025-09-30T17:19:02.130301] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-30T17:19:02.130412] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 18.5s. Estimated remaining: 4h 22m 13s. Rate: 8.4 symbols/min [2025-09-30T17:19:02.858288] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:02.909947] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:02.917189] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:02.944629] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:02.945533] [DEBUG] [LOCAL ] ASR: No existing data file found in primary storage. [2025-09-30T17:19:02.945759] [DEBUG] [LOCAL ] ASIX: No existing data file found in primary storage. [2025-09-30T17:19:02.945823] [WARN ] [MAIN ] ASIX: No existing data found, performing full refresh instead. [2025-09-30T17:19:02.945909] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-30T17:19:02.945947] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-30T17:19:02.945990] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-09-30T17:19:02.946024] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-30T17:19:02.945630] [WARN ] [MAIN ] ASR: No existing data found, performing full refresh instead. [2025-09-30T17:19:02.954179] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-30T17:19:02.960617] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-30T17:19:02.971463] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-09-30T17:19:02.971621] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-30T17:19:03.387387] [DEBUG] [LOCAL ] ASH: Loaded 37715 existing records from primary storage. [2025-09-30T17:19:03.542535] [INFO ] [MAIN ] ASH: Loaded 37715 existing records. [2025-09-30T17:19:03.537200] [DEBUG] [LOCAL ] ASPN: Loaded 49585 existing records from primary storage. [2025-09-30T17:19:03.548044] [INFO ] [MAIN ] ASPN: Loaded 49585 existing records. [2025-09-30T17:19:04.028231] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:04.150569] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-30T17:19:04.188614] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:04.203728] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-30T17:19:04.250251] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:04.258093] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:04.258569] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-30T17:19:04.258690] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-30T17:19:04.258454] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-30T17:19:04.258790] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-30T17:19:04.259266] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-30T17:19:04.259337] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-30T17:19:04.264912] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-30T17:19:04.271246] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-30T17:19:05.014497] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:05.039923] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-30T17:19:05.081295] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:05.081845] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-30T17:19:05.136031] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T17:19:05.138542] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-30T17:19:05.341042] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T17:19:05.345028] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-30T17:19:05.783264] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T17:19:05.785476] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-30T17:19:06.130516] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:19:06.135082] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-30T17:19:06.248051] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:19:06.514712] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T17:19:06.654358] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-30T17:19:06.721958] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T17:19:07.113309] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:19:07.454362] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-30T17:19:08.073397] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T17:19:08.082106] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T17:19:08.254359] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-30T17:19:09.054354] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-30T17:19:09.512080] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T17:19:09.854402] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-30T17:19:10.654359] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-30T17:19:10.669155] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T17:19:10.764845] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:19:11.454383] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-30T17:19:11.751920] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T17:19:12.254362] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-30T17:19:13.054371] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-30T17:19:13.217943] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T17:19:13.370843] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T17:19:13.854368] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-30T17:19:14.375044] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T17:19:14.654384] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-30T17:19:15.216624] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:19:15.454384] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-30T17:19:16.002396] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T17:19:16.254367] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-30T17:19:17.037080] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T17:19:17.054320] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-30T17:19:17.221072] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T17:19:17.854344] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-30T17:19:18.540148] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T17:19:18.654371] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-30T17:19:19.454363] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-30T17:19:19.611316] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T17:19:19.879436] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T17:19:20.254362] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-30T17:19:20.608115] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T17:19:21.054346] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-30T17:19:21.182304] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T17:19:21.854377] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-30T17:19:22.571603] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T17:19:22.654343] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-30T17:19:22.676806] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T17:19:23.454355] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-30T17:19:24.059796] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T17:19:24.084026] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T17:19:24.254414] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-30T17:19:25.054357] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-30T17:19:25.635896] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T17:19:25.810488] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T17:19:25.854371] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-30T17:19:26.654381] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-30T17:19:27.454344] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-30T17:19:27.487376] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T17:19:27.545798] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T17:19:28.254361] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-30T17:19:29.054327] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-30T17:19:29.176306] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T17:19:29.184717] [INFO ] [REMOTE ] ASH: Full fetch complete (55000 records). [2025-09-30T17:19:29.184849] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-30T17:19:29.598478] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-30T17:19:29.598604] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-30T17:19:29.599273] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-30T17:19:29.599336] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-30T17:19:29.600496] [DEBUG] [LOCAL ] ASH: Trimmed 55000 records to 37777 (keeping 200 days of data) [2025-09-30T17:19:29.848821] [DEBUG] [LOCAL ] ASH: Primary data saved (37777 records). [2025-09-30T17:19:29.848977] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-30T17:19:29.849069] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASH took 27.7s. Estimated remaining: 4h 26m 49s. Rate: 8.3 symbols/min [2025-09-30T17:19:29.881979] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-30T17:19:30.035233] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:30.070329] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:19:30.124287] [DEBUG] [LOCAL ] ASX: Loaded 52837 existing records from primary storage. [2025-09-30T17:19:30.124625] [INFO ] [MAIN ] ASX: Loaded 52837 existing records. [2025-09-30T17:19:30.336130] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:30.337871] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T17:19:30.342522] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-30T17:19:30.343058] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-30T17:19:30.343427] [INFO ] [REMOTE ] ASIX: Full fetch complete (30044 records). [2025-09-30T17:19:30.343542] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-30T17:19:30.343670] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-30T17:19:30.343521] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-30T17:19:30.694529] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-30T17:19:31.014173] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T17:19:31.111836] [INFO ] [REMOTE ] ASR: Full fetch complete (12492 records). [2025-09-30T17:19:31.117866] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:31.149839] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-30T17:19:31.302379] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-30T17:19:31.302841] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-30T17:19:31.308810] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-30T17:19:31.314034] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-30T17:19:31.369043] [DEBUG] [LOCAL ] ASIX: Trimmed 30044 records to 22624 (keeping 200 days of data) [2025-09-30T17:19:31.456028] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-30T17:19:31.706134] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-30T17:19:31.706568] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-30T17:19:31.707725] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-30T17:19:31.708365] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-30T17:19:31.710948] [DEBUG] [LOCAL ] ASR: Trimmed 12492 records to 9385 (keeping 200 days of data) [2025-09-30T17:19:31.795830] [DEBUG] [LOCAL ] ASR: Primary data saved (9385 records). [2025-09-30T17:19:31.797355] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-30T17:19:31.797489] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASR took 29.6s. Estimated remaining: 4h 25m 29s. Rate: 8.3 symbols/min [2025-09-30T17:19:32.006733] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:32.007381] [DEBUG] [LOCAL ] ASIX: Primary data saved (22624 records). [2025-09-30T17:19:32.007692] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-30T17:19:32.008118] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASIX took 29.9s. Estimated remaining: 4h 23m 47s. Rate: 8.4 symbols/min [2025-09-30T17:19:32.194609] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:32.224567] [DEBUG] [LOCAL ] ATEN: Loaded 39679 existing records from primary storage. [2025-09-30T17:19:32.224933] [INFO ] [MAIN ] ATEN: Loaded 39679 existing records. [2025-09-30T17:19:32.417238] [DEBUG] [LOCAL ] ATGE: Loaded 31631 existing records from primary storage. [2025-09-30T17:19:32.441027] [INFO ] [MAIN ] ATGE: Loaded 31631 existing records. [2025-09-30T17:19:32.440787] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:32.485165] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-30T17:19:32.518701] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-30T17:19:32.546859] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-30T17:19:32.547183] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-30T17:19:32.716212] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:32.733013] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-30T17:19:32.748460] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-30T17:19:32.773353] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-30T17:19:32.773473] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-30T17:19:33.083546] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-30T17:19:33.184188] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-30T17:19:33.371311] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:33.427202] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-30T17:19:33.526298] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:33.560734] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-30T17:19:33.854372] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-30T17:19:34.654434] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-30T17:19:35.059715] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:19:35.256140] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-30T17:19:35.267604] [INFO ] [REMOTE ] ASPN: Full fetch complete (72283 records). [2025-09-30T17:19:35.267821] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-30T17:19:35.455839] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-30T17:19:35.620757] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T17:19:35.733431] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-30T17:19:35.733592] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-30T17:19:35.734350] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-30T17:19:35.734432] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-30T17:19:35.752700] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T17:19:35.759486] [DEBUG] [LOCAL ] ASPN: Trimmed 72283 records to 49569 (keeping 200 days of data) [2025-09-30T17:19:36.063539] [DEBUG] [LOCAL ] ASPN: Primary data saved (49569 records). [2025-09-30T17:19:36.063763] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-30T17:19:36.063858] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 33.9s. Estimated remaining: 4h 22m 58s. Rate: 8.4 symbols/min [2025-09-30T17:19:36.244079] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:36.261997] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-30T17:19:36.276631] [DEBUG] [LOCAL ] ATHM: Loaded 32365 existing records from primary storage. [2025-09-30T17:19:36.276938] [INFO ] [MAIN ] ATHM: Loaded 32365 existing records. [2025-09-30T17:19:36.462201] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:36.462848] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-30T17:19:36.462903] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-30T17:19:36.463203] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-30T17:19:36.463262] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-30T17:19:36.855432] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:36.952971] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T17:19:37.054365] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-30T17:19:37.651930] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:19:37.854381] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-30T17:19:38.563233] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T17:19:38.654332] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-30T17:19:39.307866] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T17:19:39.454361] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-30T17:19:40.254331] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-30T17:19:40.516916] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T17:19:40.769364] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T17:19:41.054369] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-30T17:19:41.394031] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T17:19:41.854357] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-30T17:19:42.654341] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-30T17:19:42.937919] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T17:19:43.097968] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T17:19:43.454351] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-30T17:19:44.198235] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T17:19:44.254337] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-30T17:19:45.054429] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-30T17:19:45.243452] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T17:19:45.854421] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-30T17:19:45.975441] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T17:19:46.613146] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T17:19:46.654352] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-30T17:19:47.288018] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T17:19:47.454384] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-30T17:19:47.767478] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T17:19:48.254423] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-30T17:19:49.054383] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-30T17:19:49.344254] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T17:19:49.515487] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-30T17:19:49.854377] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-30T17:19:50.400391] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T17:19:50.654393] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-30T17:19:51.454358] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-30T17:19:51.555237] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:19:52.132370] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T17:19:52.254358] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-30T17:19:52.821525] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T17:19:53.054365] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-30T17:19:53.745560] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T17:19:53.854416] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-30T17:19:54.530259] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T17:19:54.654328] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-30T17:19:55.107039] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T17:19:55.454398] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-30T17:19:55.906450] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T17:19:55.914804] [INFO ] [REMOTE ] ATEN: Full fetch complete (57390 records). [2025-09-30T17:19:55.914976] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-30T17:19:56.259607] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-30T17:19:56.345595] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-30T17:19:56.346065] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-30T17:19:56.346784] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-30T17:19:56.346852] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-30T17:19:56.348173] [DEBUG] [LOCAL ] ATEN: Trimmed 57390 records to 39539 (keeping 200 days of data) [2025-09-30T17:19:56.582144] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T17:19:56.624046] [DEBUG] [LOCAL ] ATEN: Primary data saved (39539 records). [2025-09-30T17:19:56.624201] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-30T17:19:56.624821] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ATEN took 24.8s. Estimated remaining: 4h 25m 50s. Rate: 8.3 symbols/min [2025-09-30T17:19:56.811174] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:56.821581] [DEBUG] [LOCAL ] ATHS: Loaded 6984 existing records from primary storage. [2025-09-30T17:19:56.821864] [INFO ] [MAIN ] ATHS: Loaded 6984 existing records. [2025-09-30T17:19:57.020032] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:57.020260] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-30T17:19:57.020310] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-30T17:19:57.020675] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-30T17:19:57.020736] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-30T17:19:57.059436] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-30T17:19:57.405042] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:19:57.854407] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-30T17:19:58.364014] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T17:19:58.378026] [INFO ] [REMOTE ] ASX: Full fetch complete (76591 records). [2025-09-30T17:19:58.378203] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-30T17:19:58.512067] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:19:58.664192] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-30T17:19:58.835665] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-30T17:19:58.835803] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-30T17:19:58.836805] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-30T17:19:58.836878] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-30T17:19:58.844721] [DEBUG] [LOCAL ] ASX: Trimmed 76591 records to 52849 (keeping 200 days of data) [2025-09-30T17:19:59.175689] [DEBUG] [LOCAL ] ASX: Primary data saved (52849 records). [2025-09-30T17:19:59.175834] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-30T17:19:59.175979] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ASX took 29.3s. Estimated remaining: 4h 24m 41s. Rate: 8.3 symbols/min [2025-09-30T17:19:59.373724] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:19:59.400369] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T17:19:59.460776] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T17:19:59.460898] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-30T17:19:59.467765] [DEBUG] [LOCAL ] ATI: Loaded 51503 existing records from primary storage. [2025-09-30T17:19:59.468192] [INFO ] [MAIN ] ATI: Loaded 51503 existing records. [2025-09-30T17:19:59.659838] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:19:59.660199] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-30T17:19:59.660266] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-30T17:19:59.661562] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-30T17:19:59.661630] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-30T17:20:00.038928] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:00.254372] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-30T17:20:01.054327] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-30T17:20:01.166725] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T17:20:01.854381] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-30T17:20:02.202193] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T17:20:02.303117] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-30T17:20:02.455259] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T17:20:02.461740] [INFO ] [REMOTE ] ATGE: Full fetch complete (46229 records). [2025-09-30T17:20:02.461982] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-30T17:20:02.660865] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-30T17:20:02.886561] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-30T17:20:02.886887] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-30T17:20:02.887418] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-30T17:20:02.887466] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-30T17:20:02.888962] [DEBUG] [LOCAL ] ATGE: Trimmed 46229 records to 31544 (keeping 200 days of data) [2025-09-30T17:20:03.102127] [DEBUG] [LOCAL ] ATGE: Primary data saved (31544 records). [2025-09-30T17:20:03.102278] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-30T17:20:03.102366] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATGE took 31.1s. Estimated remaining: 4h 23m 51s. Rate: 8.4 symbols/min [2025-09-30T17:20:03.213917] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T17:20:03.300248] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:03.335846] [DEBUG] [LOCAL ] ATKR: Loaded 35560 existing records from primary storage. [2025-09-30T17:20:03.336167] [INFO ] [MAIN ] ATKR: Loaded 35560 existing records. [2025-09-30T17:20:03.455504] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-30T17:20:03.594615] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:03.594909] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-30T17:20:03.594961] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-30T17:20:03.595320] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-30T17:20:03.595382] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-30T17:20:04.002506] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:04.254388] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-30T17:20:05.054359] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-30T17:20:05.293792] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T17:20:05.732757] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:20:05.834567] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T17:20:05.854311] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-30T17:20:06.579700] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-30T17:20:06.654367] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-30T17:20:07.454384] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-30T17:20:08.254360] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-30T17:20:08.340519] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T17:20:08.943937] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:20:09.054397] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-30T17:20:09.854389] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-30T17:20:09.928098] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T17:20:10.160561] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:20:10.608570] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T17:20:10.654415] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-30T17:20:11.454385] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-30T17:20:12.254335] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-30T17:20:12.615734] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T17:20:12.706270] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T17:20:13.054359] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-30T17:20:13.178444] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T17:20:13.854423] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-30T17:20:14.562540] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T17:20:14.654371] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-30T17:20:15.036335] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T17:20:15.454397] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-30T17:20:16.034784] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T17:20:16.246570] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T17:20:16.255057] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-30T17:20:17.054424] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-30T17:20:17.724747] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T17:20:17.854400] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-30T17:20:17.905393] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:20:18.654433] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-30T17:20:18.875035] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T17:20:19.381553] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-30T17:20:19.383434] [INFO ] [REMOTE ] ATHS: Full fetch complete (10053 records). [2025-09-30T17:20:19.383571] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-30T17:20:19.462254] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-30T17:20:19.809224] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-30T17:20:19.809392] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-30T17:20:19.809729] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-30T17:20:19.809794] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-30T17:20:19.810276] [DEBUG] [LOCAL ] ATHS: Trimmed 10053 records to 6995 (keeping 200 days of data) [2025-09-30T17:20:19.856274] [DEBUG] [LOCAL ] ATHS: Primary data saved (6995 records). [2025-09-30T17:20:19.856412] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-30T17:20:19.856539] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATHS took 23.2s. Estimated remaining: 4h 25m 49s. Rate: 8.3 symbols/min [2025-09-30T17:20:20.040527] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:20.091403] [DEBUG] [LOCAL ] ATMU: Loaded 39533 existing records from primary storage. [2025-09-30T17:20:20.091803] [INFO ] [MAIN ] ATMU: Loaded 39533 existing records. [2025-09-30T17:20:20.259745] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-30T17:20:20.287414] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:20.288912] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-30T17:20:20.289064] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-30T17:20:20.289701] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-30T17:20:20.289798] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-30T17:20:20.692348] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:21.054367] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-30T17:20:21.120882] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T17:20:21.764487] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T17:20:21.770072] [INFO ] [REMOTE ] ATHM: Full fetch complete (51168 records). [2025-09-30T17:20:21.770189] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-30T17:20:21.770871] [FATAL] [VALIDATOR ] ATHM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:20:21.770960] [FATAL] [MAIN ] ATHM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:20:21.771005] [WARN ] [MAIN ] ATHM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:20:21.771049] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-30T17:20:21.771146] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-09-30T17:20:21.771204] [INFO ] [LOCAL ] ATHM: Starting deletion of derivative data. [2025-09-30T17:20:21.771904] [DEBUG] [LOCAL ] ATHM: Deleted derivative data file. [2025-09-30T17:20:21.777842] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHM took 45.7s. Estimated remaining: 4h 24m 32s. Rate: 8.3 symbols/min [2025-09-30T17:20:21.859522] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-30T17:20:21.997053] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:22.064232] [DEBUG] [LOCAL ] ATO: Loaded 41864 existing records from primary storage. [2025-09-30T17:20:22.064677] [INFO ] [MAIN ] ATO: Loaded 41864 existing records. [2025-09-30T17:20:22.288407] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:22.288747] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-30T17:20:22.288805] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-30T17:20:22.289225] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-30T17:20:22.289332] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-30T17:20:22.655789] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-30T17:20:22.697955] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:22.723335] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T17:20:23.454355] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-30T17:20:23.512133] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T17:20:24.254374] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-30T17:20:24.310704] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:20:24.401329] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T17:20:25.054359] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-30T17:20:25.735798] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:20:25.854361] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-30T17:20:26.505718] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:20:26.654396] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-30T17:20:27.395235] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T17:20:27.454364] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-30T17:20:27.529802] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T17:20:28.254368] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-30T17:20:29.054359] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-30T17:20:29.437661] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T17:20:29.471569] [INFO ] [REMOTE ] ATI: Full fetch complete (73937 records). [2025-09-30T17:20:29.472260] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-30T17:20:29.473317] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T17:20:29.862225] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-30T17:20:29.916130] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-30T17:20:29.916223] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-30T17:20:29.917056] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-30T17:20:29.917136] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-30T17:20:29.923707] [DEBUG] [LOCAL ] ATI: Trimmed 73937 records to 51513 (keeping 200 days of data) [2025-09-30T17:20:30.245301] [DEBUG] [LOCAL ] ATI: Primary data saved (51513 records). [2025-09-30T17:20:30.245458] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-30T17:20:30.245544] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATI took 31.1s. Estimated remaining: 4h 24m 41s. Rate: 8.3 symbols/min [2025-09-30T17:20:30.430493] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:30.465804] [DEBUG] [LOCAL ] ATR: Loaded 30406 existing records from primary storage. [2025-09-30T17:20:30.466078] [INFO ] [MAIN ] ATR: Loaded 30406 existing records. [2025-09-30T17:20:30.656771] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-30T17:20:30.698202] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:30.721775] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-30T17:20:30.722230] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-30T17:20:30.723585] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-30T17:20:30.723517] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T17:20:30.732332] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-30T17:20:31.138939] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:31.166504] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T17:20:31.454356] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-30T17:20:32.081149] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T17:20:32.254390] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-30T17:20:32.532249] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T17:20:33.054403] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-30T17:20:33.785049] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T17:20:33.854380] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-30T17:20:34.406747] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T17:20:34.654393] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-30T17:20:35.460080] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-30T17:20:35.465410] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T17:20:35.474593] [INFO ] [REMOTE ] ATKR: Full fetch complete (53770 records). [2025-09-30T17:20:35.474801] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-30T17:20:35.906347] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-30T17:20:35.906465] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-30T17:20:35.907154] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-30T17:20:35.907239] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-30T17:20:35.908566] [DEBUG] [LOCAL ] ATKR: Trimmed 53770 records to 35629 (keeping 200 days of data) [2025-09-30T17:20:36.069259] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T17:20:36.176938] [DEBUG] [LOCAL ] ATKR: Primary data saved (35629 records). [2025-09-30T17:20:36.177088] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-30T17:20:36.177211] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATKR took 33.1s. Estimated remaining: 4h 24m 18s. Rate: 8.3 symbols/min [2025-09-30T17:20:36.259517] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-30T17:20:36.362138] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:36.381351] [DEBUG] [LOCAL ] ATS: Loaded 17851 existing records from primary storage. [2025-09-30T17:20:36.381597] [INFO ] [MAIN ] ATS: Loaded 17851 existing records. [2025-09-30T17:20:36.570084] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:36.570358] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-30T17:20:36.570407] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-30T17:20:36.570733] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-30T17:20:36.570797] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-30T17:20:36.971883] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:36.998942] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T17:20:37.054395] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-30T17:20:37.854381] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-30T17:20:37.913714] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T17:20:38.012270] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T17:20:38.654437] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-30T17:20:39.228422] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T17:20:39.454397] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-30T17:20:40.000154] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T17:20:40.254317] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-30T17:20:40.718093] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T17:20:41.054377] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-30T17:20:41.614744] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T17:20:41.854386] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-30T17:20:42.654326] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-30T17:20:42.739602] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T17:20:43.189568] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T17:20:43.454393] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-30T17:20:43.680506] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T17:20:44.254375] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-30T17:20:44.912120] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T17:20:45.054368] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-30T17:20:45.843840] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T17:20:45.854296] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-30T17:20:46.172858] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T17:20:46.654399] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-30T17:20:47.398895] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T17:20:47.454359] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-30T17:20:48.071322] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T17:20:48.254357] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-30T17:20:48.285089] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T17:20:49.054378] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-30T17:20:49.300226] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T17:20:49.854400] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-30T17:20:50.654342] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-30T17:20:50.688772] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T17:20:50.699586] [INFO ] [REMOTE ] ATMU: Full fetch complete (56839 records). [2025-09-30T17:20:50.699795] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-30T17:20:51.142549] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-30T17:20:51.142706] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-30T17:20:51.143727] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-30T17:20:51.143980] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-30T17:20:51.146058] [DEBUG] [LOCAL ] ATMU: Trimmed 56839 records to 39448 (keeping 200 days of data) [2025-09-30T17:20:51.443531] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T17:20:51.454854] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-30T17:20:51.474072] [DEBUG] [LOCAL ] ATMU: Primary data saved (39448 records). [2025-09-30T17:20:51.474240] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-30T17:20:51.475362] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATMU took 31.6s. Estimated remaining: 4h 25m 54s. Rate: 8.3 symbols/min [2025-09-30T17:20:51.701622] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:51.763316] [DEBUG] [LOCAL ] ATUS: Loaded 49225 existing records from primary storage. [2025-09-30T17:20:51.764059] [INFO ] [MAIN ] ATUS: Loaded 49225 existing records. [2025-09-30T17:20:51.971877] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:51.972235] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-30T17:20:51.972360] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-30T17:20:51.980034] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-30T17:20:51.991776] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-30T17:20:52.030557] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:20:52.254760] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-30T17:20:52.418305] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:52.572823] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T17:20:53.054379] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-30T17:20:53.463735] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T17:20:53.842300] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T17:20:53.854304] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-30T17:20:54.654361] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-30T17:20:54.785016] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T17:20:55.454410] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-30T17:20:56.094240] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T17:20:56.254402] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-30T17:20:57.054390] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-30T17:20:57.214146] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T17:20:57.823534] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T17:20:57.854418] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-30T17:20:58.098496] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T17:20:58.105386] [INFO ] [REMOTE ] ATR: Full fetch complete (43460 records). [2025-09-30T17:20:58.105538] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-30T17:20:58.529862] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-30T17:20:58.529948] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-30T17:20:58.530505] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-30T17:20:58.530572] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-30T17:20:58.531824] [DEBUG] [LOCAL ] ATR: Trimmed 43460 records to 30427 (keeping 200 days of data) [2025-09-30T17:20:58.654524] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-30T17:20:58.744137] [DEBUG] [LOCAL ] ATR: Primary data saved (30427 records). [2025-09-30T17:20:58.744306] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-30T17:20:58.744396] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATR took 28.5s. Estimated remaining: 4h 25m 47s. Rate: 8.3 symbols/min [2025-09-30T17:20:58.936221] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:20:58.991467] [DEBUG] [LOCAL ] AU: Loaded 52987 existing records from primary storage. [2025-09-30T17:20:58.991893] [INFO ] [MAIN ] AU: Loaded 52987 existing records. [2025-09-30T17:20:59.203380] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:20:59.203595] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-30T17:20:59.203667] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-30T17:20:59.204301] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-30T17:20:59.204377] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-30T17:20:59.458787] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-30T17:20:59.631305] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:20:59.658535] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T17:20:59.668054] [INFO ] [REMOTE ] ATO: Full fetch complete (60494 records). [2025-09-30T17:20:59.668281] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-30T17:20:59.935542] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T17:21:00.121479] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-30T17:21:00.121562] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-30T17:21:00.122390] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-30T17:21:00.122463] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-30T17:21:00.123846] [DEBUG] [LOCAL ] ATO: Trimmed 60494 records to 41879 (keeping 200 days of data) [2025-09-30T17:21:00.254431] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-30T17:21:00.428907] [DEBUG] [LOCAL ] ATO: Primary data saved (41879 records). [2025-09-30T17:21:00.429238] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-30T17:21:00.430872] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATO took 38.7s. Estimated remaining: 4h 24m 29s. Rate: 8.3 symbols/min [2025-09-30T17:21:00.671756] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:00.731958] [DEBUG] [LOCAL ] AUB: Loaded 46313 existing records from primary storage. [2025-09-30T17:21:00.732308] [INFO ] [MAIN ] AUB: Loaded 46313 existing records. [2025-09-30T17:21:00.967125] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:00.967562] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-30T17:21:00.967761] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-30T17:21:00.977337] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-30T17:21:00.997314] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-30T17:21:01.048324] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T17:21:01.085938] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-30T17:21:01.468220] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:01.835143] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:21:01.854325] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-30T17:21:02.101429] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T17:21:02.654385] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-30T17:21:03.280404] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T17:21:03.454368] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-30T17:21:03.705531] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T17:21:03.709612] [INFO ] [REMOTE ] ATS: Full fetch complete (25626 records). [2025-09-30T17:21:03.709777] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-30T17:21:04.136527] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-30T17:21:04.136618] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-30T17:21:04.137051] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-30T17:21:04.137116] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-30T17:21:04.138489] [DEBUG] [LOCAL ] ATS: Trimmed 25626 records to 17824 (keeping 200 days of data) [2025-09-30T17:21:04.248856] [DEBUG] [LOCAL ] ATS: Primary data saved (17824 records). [2025-09-30T17:21:04.249005] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-30T17:21:04.249092] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 28.1s. Estimated remaining: 4h 23m 39s. Rate: 8.3 symbols/min [2025-09-30T17:21:04.260964] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-30T17:21:04.452576] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:04.461835] [DEBUG] [LOCAL ] AUNA: Loaded 4872 existing records from primary storage. [2025-09-30T17:21:04.462097] [INFO ] [MAIN ] AUNA: Loaded 4872 existing records. [2025-09-30T17:21:04.679530] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:04.679837] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-30T17:21:04.679972] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-30T17:21:04.680378] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-30T17:21:04.680437] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-30T17:21:05.080933] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:05.073958] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-30T17:21:05.109691] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T17:21:05.465469] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T17:21:05.854388] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-30T17:21:06.654357] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-30T17:21:06.951058] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T17:21:07.011852] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:21:07.454388] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-30T17:21:08.254360] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-30T17:21:08.461325] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T17:21:08.899133] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-30T17:21:08.951750] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T17:21:09.054376] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-30T17:21:09.854379] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-30T17:21:10.535663] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T17:21:10.654376] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-30T17:21:10.752363] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:21:11.093592] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T17:21:11.454365] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-30T17:21:12.254364] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-30T17:21:12.659045] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-30T17:21:12.905124] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T17:21:13.054356] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-30T17:21:13.854376] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-30T17:21:14.654386] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-30T17:21:14.803946] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T17:21:15.199846] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T17:21:15.454398] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-30T17:21:15.528103] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:21:16.254387] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-30T17:21:17.047218] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:21:17.057204] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-30T17:21:17.854401] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-30T17:21:18.137470] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-30T17:21:18.654332] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-30T17:21:18.695150] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T17:21:19.454355] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-30T17:21:19.575241] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T17:21:19.640613] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T17:21:19.652978] [INFO ] [REMOTE ] ATUS: Full fetch complete (70922 records). [2025-09-30T17:21:19.653165] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-30T17:21:20.183020] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-30T17:21:20.183105] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-30T17:21:20.183813] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-30T17:21:20.183882] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-30T17:21:20.185421] [DEBUG] [LOCAL ] ATUS: Trimmed 70922 records to 49257 (keeping 200 days of data) [2025-09-30T17:21:20.276238] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-30T17:21:20.501381] [DEBUG] [LOCAL ] ATUS: Primary data saved (49257 records). [2025-09-30T17:21:20.501551] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-30T17:21:20.502137] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATUS took 29.0s. Estimated remaining: 4h 25m 25s. Rate: 8.3 symbols/min [2025-09-30T17:21:20.715968] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:20.759930] [DEBUG] [LOCAL ] AVA: Loaded 39461 existing records from primary storage. [2025-09-30T17:21:20.760256] [INFO ] [MAIN ] AVA: Loaded 39461 existing records. [2025-09-30T17:21:20.965952] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:20.967144] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-30T17:21:20.967306] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-30T17:21:20.967784] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-30T17:21:20.967882] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-30T17:21:21.055404] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-30T17:21:21.130076] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T17:21:21.132214] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T17:21:21.427754] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:21.854376] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-30T17:21:22.654403] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-30T17:21:22.931229] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T17:21:23.454357] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-30T17:21:23.708891] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T17:21:23.910020] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T17:21:24.254386] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-30T17:21:25.054366] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-30T17:21:25.545857] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-30T17:21:25.854325] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-30T17:21:26.026543] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T17:21:26.150401] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T17:21:26.654404] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-30T17:21:27.454353] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-30T17:21:27.900184] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-30T17:21:28.254374] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-30T17:21:28.314924] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T17:21:28.380944] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T17:21:29.054408] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-30T17:21:29.854404] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-30T17:21:30.306342] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-30T17:21:30.381762] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T17:21:30.654413] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-30T17:21:31.311029] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T17:21:31.320458] [INFO ] [REMOTE ] AUB: Full fetch complete (65651 records). [2025-09-30T17:21:31.320596] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-30T17:21:31.468132] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-30T17:21:31.751920] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-30T17:21:31.752021] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-30T17:21:31.752726] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-30T17:21:31.752796] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-30T17:21:31.754704] [DEBUG] [LOCAL ] AUB: Trimmed 65651 records to 46327 (keeping 200 days of data) [2025-09-30T17:21:32.068256] [DEBUG] [LOCAL ] AUB: Primary data saved (46327 records). [2025-09-30T17:21:32.071815] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-30T17:21:32.073009] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AUB took 31.6s. Estimated remaining: 4h 26m 11s. Rate: 8.2 symbols/min [2025-09-30T17:21:32.211897] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T17:21:32.259492] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-30T17:21:32.312282] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:32.324956] [DEBUG] [LOCAL ] AVAL: Loaded 8780 existing records from primary storage. [2025-09-30T17:21:32.325307] [INFO ] [MAIN ] AVAL: Loaded 8780 existing records. [2025-09-30T17:21:32.536891] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:32.537146] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-30T17:21:32.537223] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-30T17:21:32.537512] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-30T17:21:32.537577] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-30T17:21:32.960528] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:33.054396] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-30T17:21:33.117524] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T17:21:33.677135] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-30T17:21:33.854401] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-30T17:21:34.581887] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T17:21:34.654335] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-30T17:21:35.454338] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-30T17:21:35.811273] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T17:21:36.010405] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T17:21:36.089858] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-30T17:21:36.254380] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-30T17:21:36.992110] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T17:21:37.054391] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-30T17:21:37.854417] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-30T17:21:38.580406] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T17:21:38.654364] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-30T17:21:38.665400] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T17:21:39.454364] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-30T17:21:39.804807] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T17:21:40.254371] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-30T17:21:40.369823] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T17:21:40.371926] [INFO ] [REMOTE ] AUNA: Full fetch complete (7750 records). [2025-09-30T17:21:40.372002] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-30T17:21:40.769974] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-30T17:21:40.770055] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-30T17:21:40.770249] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-30T17:21:40.770289] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-30T17:21:40.770733] [DEBUG] [LOCAL ] AUNA: Trimmed 7750 records to 4917 (keeping 200 days of data) [2025-09-30T17:21:40.798809] [DEBUG] [LOCAL ] AUNA: Primary data saved (4917 records). [2025-09-30T17:21:40.798920] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-30T17:21:40.799003] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AUNA took 36.5s. Estimated remaining: 4h 26m 22s. Rate: 8.2 symbols/min [2025-09-30T17:21:40.976907] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:41.027870] [DEBUG] [LOCAL ] AVB: Loaded 41892 existing records from primary storage. [2025-09-30T17:21:41.028316] [INFO ] [MAIN ] AVB: Loaded 41892 existing records. [2025-09-30T17:21:41.059572] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-30T17:21:41.238419] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:41.238692] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-30T17:21:41.238774] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-30T17:21:41.239119] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-30T17:21:41.239180] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-30T17:21:41.638089] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:41.854404] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-30T17:21:42.308982] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-30T17:21:42.320879] [INFO ] [REMOTE ] AU: Full fetch complete (76276 records). [2025-09-30T17:21:42.321055] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-30T17:21:42.654472] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-30T17:21:42.775350] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-30T17:21:42.775562] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-30T17:21:42.776685] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-30T17:21:42.776774] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-30T17:21:42.778683] [DEBUG] [LOCAL ] AU: Trimmed 76276 records to 52991 (keeping 200 days of data) [2025-09-30T17:21:42.909685] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T17:21:42.927333] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T17:21:42.939037] [INFO ] [REMOTE ] AVA: Full fetch complete (55721 records). [2025-09-30T17:21:42.939735] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-30T17:21:43.452479] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-30T17:21:43.452586] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-30T17:21:43.453336] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-30T17:21:43.508616] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-30T17:21:43.508818] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-30T17:21:43.558666] [DEBUG] [LOCAL ] AVA: Trimmed 55721 records to 39426 (keeping 200 days of data) [2025-09-30T17:21:43.920448] [DEBUG] [LOCAL ] AVA: Primary data saved (39426 records). [2025-09-30T17:21:43.920864] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-30T17:21:43.921809] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AVA took 23.4s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-09-30T17:21:44.132528] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:44.133324] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-30T17:21:44.139685] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-30T17:21:44.140306] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-30T17:21:44.145999] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-30T17:21:44.156110] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-30T17:21:44.160802] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-30T17:21:44.177864] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T17:21:44.271689] [DEBUG] [LOCAL ] AU: Primary data saved (52991 records). [2025-09-30T17:21:44.266125] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-30T17:21:44.300944] [INFO ] [MAIN ] AU: Full history saved. [2025-09-30T17:21:44.301308] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AU took 45.6s. Estimated remaining: 4h 23m 52s. Rate: 8.3 symbols/min [2025-09-30T17:21:44.625125] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T17:21:44.744316] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:44.829711] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:44.848047] [DEBUG] [LOCAL ] AVD: Loaded 22711 existing records from primary storage. [2025-09-30T17:21:44.848445] [INFO ] [MAIN ] AVD: Loaded 22711 existing records. [2025-09-30T17:21:45.045194] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:45.045530] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-30T17:21:45.045592] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-30T17:21:45.045925] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-30T17:21:45.045988] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-30T17:21:45.054405] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-30T17:21:45.437447] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:45.451927] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:21:45.452316] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-30T17:21:45.452410] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:21:45.452492] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-09-30T17:21:45.452565] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:21:45.452660] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-30T17:21:45.452772] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-30T17:21:45.452867] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-30T17:21:45.452937] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-30T17:21:45.453049] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVBC took 1.5s. Estimated remaining: 4h 22m 32s. Rate: 8.3 symbols/min [2025-09-30T17:21:45.649611] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:21:45.674589] [DEBUG] [LOCAL ] AVK: Loaded 17863 existing records from primary storage. [2025-09-30T17:21:45.674913] [INFO ] [MAIN ] AVK: Loaded 17863 existing records. [2025-09-30T17:21:45.854361] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-30T17:21:45.883906] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:21:45.884389] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-30T17:21:45.884462] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-30T17:21:45.892567] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-30T17:21:45.906398] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-30T17:21:45.913480] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T17:21:46.348868] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:21:46.654381] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-30T17:21:47.408063] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T17:21:47.454373] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-30T17:21:47.791474] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T17:21:48.254456] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-30T17:21:48.320496] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T17:21:49.054446] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-30T17:21:49.356606] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T17:21:49.854381] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-30T17:21:49.928377] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T17:21:50.654363] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-30T17:21:50.725214] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T17:21:51.390760] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T17:21:51.454355] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-30T17:21:52.254379] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-30T17:21:52.285183] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T17:21:53.054406] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-30T17:21:53.811776] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T17:21:53.854767] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-30T17:21:53.858086] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T17:21:54.654525] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-30T17:21:54.777438] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T17:21:55.454386] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-30T17:21:56.254416] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-30T17:21:56.379927] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:21:56.381360] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T17:21:57.054368] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-30T17:21:57.098267] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T17:21:57.854408] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-30T17:21:58.504789] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:21:58.654502] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-30T17:21:58.896552] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T17:21:59.454349] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-30T17:21:59.720583] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-30T17:22:00.254381] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-30T17:22:00.890966] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:22:01.061271] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-30T17:22:01.067839] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T17:22:01.854383] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-30T17:22:01.922304] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T17:22:02.654380] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-30T17:22:02.947483] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T17:22:03.353882] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T17:22:03.355884] [INFO ] [REMOTE ] AVAL: Full fetch complete (14619 records). [2025-09-30T17:22:03.356021] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-30T17:22:03.459503] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-30T17:22:03.772208] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-30T17:22:03.772338] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-30T17:22:03.773494] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-30T17:22:03.773580] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-30T17:22:03.774504] [DEBUG] [LOCAL ] AVAL: Trimmed 14619 records to 8759 (keeping 200 days of data) [2025-09-30T17:22:03.834864] [DEBUG] [LOCAL ] AVAL: Primary data saved (8759 records). [2025-09-30T17:22:03.835005] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-30T17:22:03.835166] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVAL took 31.8s. Estimated remaining: 4h 24m 39s. Rate: 8.3 symbols/min [2025-09-30T17:22:04.026443] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:04.076293] [DEBUG] [LOCAL ] AVNS: Loaded 33542 existing records from primary storage. [2025-09-30T17:22:04.076664] [INFO ] [MAIN ] AVNS: Loaded 33542 existing records. [2025-09-30T17:22:04.266582] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-30T17:22:04.272998] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:22:04.274393] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-30T17:22:04.274446] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-30T17:22:04.274889] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-30T17:22:04.274978] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-30T17:22:04.655008] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T17:22:04.732177] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:05.054383] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-30T17:22:05.770119] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T17:22:05.854387] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-30T17:22:06.149247] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-30T17:22:06.654371] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-30T17:22:07.223783] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T17:22:07.455089] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-30T17:22:07.457819] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-30T17:22:08.254401] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-30T17:22:08.849812] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:22:09.054339] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-30T17:22:09.094967] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T17:22:09.854407] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-30T17:22:10.110414] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T17:22:10.654401] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-30T17:22:11.269248] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T17:22:11.454355] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-30T17:22:12.254404] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-30T17:22:12.503171] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T17:22:13.055838] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-30T17:22:13.062454] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T17:22:13.299747] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T17:22:13.854376] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-30T17:22:14.236948] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T17:22:14.241683] [INFO ] [REMOTE ] AVK: Full fetch complete (26601 records). [2025-09-30T17:22:14.241830] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-30T17:22:14.666257] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-30T17:22:14.746074] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-30T17:22:14.746182] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-30T17:22:14.746787] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-30T17:22:14.746872] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-30T17:22:14.748197] [DEBUG] [LOCAL ] AVK: Trimmed 26601 records to 17882 (keeping 200 days of data) [2025-09-30T17:22:14.867109] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T17:22:14.873945] [INFO ] [REMOTE ] AVD: Full fetch complete (33734 records). [2025-09-30T17:22:14.874555] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-30T17:22:15.311807] [DEBUG] [LOCAL ] AVK: Primary data saved (17882 records). [2025-09-30T17:22:15.348171] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-30T17:22:15.348295] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-30T17:22:15.347977] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-30T17:22:15.348490] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVK took 29.9s. Estimated remaining: 4h 25m 23s. Rate: 8.2 symbols/min [2025-09-30T17:22:15.349317] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-30T17:22:15.349633] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-30T17:22:15.442485] [DEBUG] [LOCAL ] AVD: Trimmed 33734 records to 22636 (keeping 200 days of data) [2025-09-30T17:22:15.455287] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-30T17:22:15.635953] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:15.637828] [DEBUG] [LOCAL ] AVNT: No existing data file found in primary storage. [2025-09-30T17:22:15.637901] [WARN ] [MAIN ] AVNT: No existing data found, performing full refresh instead. [2025-09-30T17:22:15.641127] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-30T17:22:15.652725] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-30T17:22:15.660668] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-09-30T17:22:15.668091] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-30T17:22:15.773210] [DEBUG] [LOCAL ] AVD: Primary data saved (22636 records). [2025-09-30T17:22:15.794878] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-30T17:22:15.798751] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVD took 31.5s. Estimated remaining: 4h 23m 54s. Rate: 8.3 symbols/min [2025-09-30T17:22:16.180926] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:16.204112] [DEBUG] [LOCAL ] AVTR: No existing data file found in primary storage. [2025-09-30T17:22:16.209360] [WARN ] [MAIN ] AVTR: No existing data found, performing full refresh instead. [2025-09-30T17:22:16.221471] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-30T17:22:16.236286] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-30T17:22:16.250852] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-09-30T17:22:16.256142] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-30T17:22:16.513310] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:16.551338] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-30T17:22:16.809841] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:16.837178] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T17:22:16.847320] [INFO ] [REMOTE ] AVB: Full fetch complete (58229 records). [2025-09-30T17:22:16.847477] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-30T17:22:16.848199] [FATAL] [VALIDATOR ] AVB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:22:16.848304] [FATAL] [MAIN ] AVB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:22:16.848375] [WARN ] [MAIN ] AVB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:22:16.848440] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-30T17:22:16.848502] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-09-30T17:22:16.848539] [INFO ] [LOCAL ] AVB: Starting deletion of derivative data. [2025-09-30T17:22:16.849062] [DEBUG] [LOCAL ] AVB: Deleted derivative data file. [2025-09-30T17:22:16.849178] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVB took 36.1s. Estimated remaining: 4h 22m 34s. Rate: 8.3 symbols/min [2025-09-30T17:22:17.034817] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T17:22:17.072940] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-30T17:22:17.077350] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:17.136615] [DEBUG] [LOCAL ] AVY: Loaded 37420 existing records from primary storage. [2025-09-30T17:22:17.136988] [INFO ] [MAIN ] AVY: Loaded 37420 existing records. [2025-09-30T17:22:17.345924] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:22:17.346158] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-30T17:22:17.346206] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-30T17:22:17.346592] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-30T17:22:17.346690] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-30T17:22:17.758820] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:17.783468] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T17:22:17.854391] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-30T17:22:18.644815] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T17:22:18.656050] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-30T17:22:19.344195] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:22:19.454388] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-30T17:22:20.117746] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T17:22:20.254363] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-30T17:22:20.976288] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T17:22:21.054366] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-30T17:22:21.181281] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T17:22:21.854367] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-30T17:22:22.654363] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-30T17:22:22.858952] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T17:22:23.449175] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T17:22:23.458566] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-30T17:22:24.033294] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T17:22:24.254403] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-30T17:22:25.054357] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-30T17:22:25.103617] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T17:22:25.726152] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T17:22:25.854388] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-30T17:22:26.314863] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T17:22:26.654379] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-30T17:22:27.454380] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-30T17:22:27.668337] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T17:22:28.254391] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-30T17:22:28.481442] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T17:22:28.514141] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T17:22:29.054406] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-30T17:22:29.837591] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T17:22:29.854315] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-30T17:22:30.654411] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-30T17:22:30.811241] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:22:31.047476] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T17:22:31.454386] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-30T17:22:32.144729] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T17:22:32.254422] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-30T17:22:32.980301] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T17:22:33.054399] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-30T17:22:33.679977] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T17:22:33.854374] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-30T17:22:34.654369] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-30T17:22:34.699209] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T17:22:35.298332] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:22:35.454432] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-30T17:22:36.254341] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-30T17:22:36.666420] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T17:22:36.968758] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T17:22:37.054405] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-30T17:22:37.672153] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T17:22:37.679832] [INFO ] [REMOTE ] AVNS: Full fetch complete (48196 records). [2025-09-30T17:22:37.679966] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-30T17:22:37.857114] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-30T17:22:38.095795] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-30T17:22:38.095917] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-30T17:22:38.096608] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-30T17:22:38.096742] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-30T17:22:38.098581] [DEBUG] [LOCAL ] AVNS: Trimmed 48196 records to 33665 (keeping 200 days of data) [2025-09-30T17:22:38.227363] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T17:22:38.356529] [DEBUG] [LOCAL ] AVNS: Primary data saved (33665 records). [2025-09-30T17:22:38.356708] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-30T17:22:38.356804] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNS took 34.5s. Estimated remaining: 4h 25m 15s. Rate: 8.2 symbols/min [2025-09-30T17:22:38.541396] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:38.568184] [DEBUG] [LOCAL ] AWF: Loaded 24244 existing records from primary storage. [2025-09-30T17:22:38.568515] [INFO ] [MAIN ] AWF: Loaded 24244 existing records. [2025-09-30T17:22:38.659758] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-30T17:22:38.782332] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:22:38.782701] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-30T17:22:38.782762] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-30T17:22:38.783495] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-30T17:22:38.783559] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-30T17:22:39.218179] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:39.241846] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:22:39.454368] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-30T17:22:40.098020] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:22:40.254324] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-30T17:22:40.685831] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T17:22:40.697279] [INFO ] [REMOTE ] AVNT: Full fetch complete (56273 records). [2025-09-30T17:22:40.697422] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-30T17:22:41.059446] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-30T17:22:41.135130] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-30T17:22:41.135213] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-30T17:22:41.135904] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-30T17:22:41.135970] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-30T17:22:41.137261] [DEBUG] [LOCAL ] AVNT: Trimmed 56273 records to 39241 (keeping 200 days of data) [2025-09-30T17:22:41.414293] [DEBUG] [LOCAL ] AVNT: Primary data saved (39241 records). [2025-09-30T17:22:41.414451] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-30T17:22:41.414534] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVNT took 26.1s. Estimated remaining: 4h 24m 18s. Rate: 8.3 symbols/min [2025-09-30T17:22:41.635739] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:41.635995] [DEBUG] [LOCAL ] AWI: No existing data file found in primary storage. [2025-09-30T17:22:41.636072] [WARN ] [MAIN ] AWI: No existing data found, performing full refresh instead. [2025-09-30T17:22:41.636234] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-30T17:22:41.636297] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-30T17:22:41.636368] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-09-30T17:22:41.636425] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-30T17:22:41.875735] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-30T17:22:42.233771] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T17:22:42.234933] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T17:22:42.373733] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:42.654417] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-30T17:22:43.454397] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-30T17:22:43.588976] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T17:22:43.829726] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T17:22:44.254368] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-30T17:22:44.866489] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T17:22:45.054405] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-30T17:22:45.644459] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T17:22:45.854324] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-30T17:22:46.195016] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T17:22:46.654387] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-30T17:22:47.454367] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-30T17:22:47.667908] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T17:22:47.676987] [INFO ] [REMOTE ] AVY: Full fetch complete (56223 records). [2025-09-30T17:22:47.677140] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-30T17:22:48.099952] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-30T17:22:48.100168] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-30T17:22:48.101016] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-30T17:22:48.101094] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-30T17:22:48.102451] [DEBUG] [LOCAL ] AVY: Trimmed 56223 records to 37441 (keeping 200 days of data) [2025-09-30T17:22:48.294316] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-30T17:22:48.385213] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T17:22:48.401563] [INFO ] [REMOTE ] AVTR: Full fetch complete (77439 records). [2025-09-30T17:22:48.403805] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-30T17:22:48.534696] [DEBUG] [LOCAL ] AVY: Primary data saved (37441 records). [2025-09-30T17:22:48.571292] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-30T17:22:48.593497] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVY took 31.7s. Estimated remaining: 4h 24m 10s. Rate: 8.3 symbols/min [2025-09-30T17:22:49.063997] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-30T17:22:49.087094] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:49.085340] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-30T17:22:49.088424] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-30T17:22:49.088634] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-30T17:22:49.083366] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T17:22:49.097910] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-30T17:22:49.099988] [DEBUG] [LOCAL ] AVTR: Trimmed 77439 records to 53562 (keeping 200 days of data) [2025-09-30T17:22:49.263177] [DEBUG] [LOCAL ] AWK: Loaded 48718 existing records from primary storage. [2025-09-30T17:22:49.264510] [INFO ] [MAIN ] AWK: Loaded 48718 existing records. [2025-09-30T17:22:49.482976] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:22:49.486307] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-30T17:22:49.486717] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-30T17:22:49.492465] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-30T17:22:49.560262] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-30T17:22:49.561225] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T17:22:49.860452] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-30T17:22:50.044758] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:50.138170] [DEBUG] [LOCAL ] AVTR: Primary data saved (53562 records). [2025-09-30T17:22:50.138329] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-30T17:22:50.138448] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVTR took 34.3s. Estimated remaining: 4h 22m 57s. Rate: 8.3 symbols/min [2025-09-30T17:22:50.322190] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:22:50.339064] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T17:22:50.367554] [DEBUG] [LOCAL ] AWP: Loaded 21606 existing records from primary storage. [2025-09-30T17:22:50.367870] [INFO ] [MAIN ] AWP: Loaded 21606 existing records. [2025-09-30T17:22:50.558071] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:22:50.558321] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-30T17:22:50.558434] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-30T17:22:50.558803] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-30T17:22:50.558875] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-30T17:22:50.657954] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-30T17:22:50.975935] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T17:22:50.981985] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:22:51.454327] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-30T17:22:51.547618] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T17:22:52.254374] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-30T17:22:53.054398] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-30T17:22:53.854428] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-30T17:23:05.206468] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (11.35 seconds). [2025-09-30T17:23:05.212895] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-30T17:23:05.285747] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (13.03 seconds). [2025-09-30T17:23:05.291702] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-30T17:23:05.447695] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (13.99 seconds). [2025-09-30T17:23:05.453352] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-30T17:23:05.556217] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (12.50 seconds). [2025-09-30T17:23:05.567434] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-30T17:23:06.739916] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:23:06.746256] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-30T17:23:06.966126] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T17:23:06.974313] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-30T17:23:06.995354] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T17:23:07.001814] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-30T17:23:07.203121] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T17:23:07.213399] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-30T17:23:07.641545] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T17:23:07.646115] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-30T17:23:08.303113] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T17:23:08.309840] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-30T17:23:08.430861] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T17:23:08.437764] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-30T17:23:08.652596] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T17:23:08.658717] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-30T17:23:08.850722] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T17:23:08.861122] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-30T17:23:09.429334] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:23:09.435167] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-30T17:23:09.472710] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T17:23:09.478479] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-30T17:23:09.500357] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:23:09.506466] [INFO ] [REMOTE ] AWF: Full fetch complete (35870 records). [2025-09-30T17:23:09.506665] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-30T17:23:09.507410] [FATAL] [VALIDATOR ] AWF: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:23:09.507503] [FATAL] [MAIN ] AWF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:23:09.507550] [WARN ] [MAIN ] AWF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:23:09.507596] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-30T17:23:09.507688] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-09-30T17:23:09.507807] [INFO ] [LOCAL ] AWF: Starting deletion of derivative data. [2025-09-30T17:23:09.508290] [DEBUG] [LOCAL ] AWF: Deleted derivative data file. [2025-09-30T17:23:09.508436] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 31.2s. Estimated remaining: 4h 25m 9s. Rate: 8.2 symbols/min [2025-09-30T17:23:09.731322] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:09.766276] [DEBUG] [LOCAL ] AWR: Loaded 22508 existing records from primary storage. [2025-09-30T17:23:09.766558] [INFO ] [MAIN ] AWR: Loaded 22508 existing records. [2025-09-30T17:23:09.969791] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:09.970039] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-30T17:23:09.970109] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-30T17:23:09.970469] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-30T17:23:09.970531] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-30T17:23:10.428027] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:10.430948] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T17:23:10.431785] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-30T17:23:10.439449] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-30T17:23:10.464619] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T17:23:10.472308] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-30T17:23:10.517301] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T17:23:10.529432] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-30T17:23:11.628439] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-30T17:23:11.633358] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-30T17:23:11.875329] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T17:23:11.880438] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-30T17:23:11.910132] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T17:23:11.917525] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-30T17:23:12.086895] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T17:23:12.254397] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-30T17:23:12.672386] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-30T17:23:12.843229] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T17:23:12.952384] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-30T17:23:13.054407] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-30T17:23:13.854341] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-30T17:23:13.912169] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T17:23:13.978162] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T17:23:14.654340] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-30T17:23:14.962790] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T17:23:15.454349] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-30T17:23:15.808295] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-30T17:23:15.814277] [INFO ] [REMOTE ] AWI: Full fetch complete (35287 records). [2025-09-30T17:23:15.814424] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-30T17:23:15.815077] [FATAL] [VALIDATOR ] AWI: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:23:15.815184] [FATAL] [MAIN ] AWI: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:23:15.815229] [WARN ] [MAIN ] AWI: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:23:15.815271] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-30T17:23:15.815329] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-09-30T17:23:15.815366] [INFO ] [LOCAL ] AWI: Starting deletion of derivative data. [2025-09-30T17:23:15.815439] [DEBUG] [LOCAL ] AWI: No derivative data file found to delete. [2025-09-30T17:23:15.815523] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 34.4s. Estimated remaining: 4h 24m 50s. Rate: 8.2 symbols/min [2025-09-30T17:23:15.996283] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:16.025628] [DEBUG] [LOCAL ] AX: Loaded 28381 existing records from primary storage. [2025-09-30T17:23:16.025944] [INFO ] [MAIN ] AX: Loaded 28381 existing records. [2025-09-30T17:23:16.220573] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:16.220841] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-30T17:23:16.220891] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-30T17:23:16.221116] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-30T17:23:16.221176] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-30T17:23:16.259534] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-30T17:23:16.704430] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:16.794241] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T17:23:17.054365] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-30T17:23:17.476397] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T17:23:17.480994] [INFO ] [REMOTE ] AWP: Full fetch complete (32474 records). [2025-09-30T17:23:17.481130] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-30T17:23:17.865223] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-30T17:23:17.959735] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-30T17:23:17.959824] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-30T17:23:17.960268] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-30T17:23:17.960313] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-30T17:23:17.961388] [DEBUG] [LOCAL ] AWP: Trimmed 32474 records to 21576 (keeping 200 days of data) [2025-09-30T17:23:18.098917] [DEBUG] [LOCAL ] AWP: Primary data saved (21576 records). [2025-09-30T17:23:18.099077] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-30T17:23:18.099176] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWP took 28.0s. Estimated remaining: 4h 23m 46s. Rate: 8.3 symbols/min [2025-09-30T17:23:18.285795] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:18.335228] [DEBUG] [LOCAL ] AXL: Loaded 50519 existing records from primary storage. [2025-09-30T17:23:18.335577] [INFO ] [MAIN ] AXL: Loaded 50519 existing records. [2025-09-30T17:23:18.539371] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:18.539628] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-30T17:23:18.539863] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-30T17:23:18.540290] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-30T17:23:18.540352] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-30T17:23:18.660605] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-30T17:23:18.974577] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:18.976892] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T17:23:19.022479] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T17:23:19.454347] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-30T17:23:19.856998] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T17:23:20.262608] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-30T17:23:20.268548] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T17:23:21.054436] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-30T17:23:21.520140] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T17:23:21.854399] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-30T17:23:22.144425] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T17:23:22.654393] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-30T17:23:23.290217] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T17:23:23.454366] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-30T17:23:24.191167] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T17:23:24.254368] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-30T17:23:24.988697] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T17:23:25.054326] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-30T17:23:25.293139] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T17:23:25.854432] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-30T17:23:26.643948] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T17:23:26.658953] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-30T17:23:26.661072] [INFO ] [REMOTE ] AWK: Full fetch complete (70604 records). [2025-09-30T17:23:26.661256] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-30T17:23:27.119786] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-30T17:23:27.120054] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-30T17:23:27.120872] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-30T17:23:27.121013] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-30T17:23:27.149367] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T17:23:27.158439] [DEBUG] [LOCAL ] AWK: Trimmed 70604 records to 48708 (keeping 200 days of data) [2025-09-30T17:23:27.454791] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-30T17:23:27.492736] [DEBUG] [LOCAL ] AWK: Primary data saved (48708 records). [2025-09-30T17:23:27.492903] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-30T17:23:27.493020] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWK took 38.9s. Estimated remaining: 4h 24m 3s. Rate: 8.2 symbols/min [2025-09-30T17:23:27.723931] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:27.789997] [DEBUG] [LOCAL ] AXP: Loaded 53201 existing records from primary storage. [2025-09-30T17:23:27.790354] [INFO ] [MAIN ] AXP: Loaded 53201 existing records. [2025-09-30T17:23:27.984905] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:27.985189] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-30T17:23:27.985246] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-30T17:23:27.985774] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-30T17:23:27.985834] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-30T17:23:28.259109] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-30T17:23:28.410816] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:28.445370] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T17:23:28.518155] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T17:23:29.054367] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-30T17:23:29.641120] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T17:23:29.854406] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-30T17:23:30.145021] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:23:30.654389] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-30T17:23:31.279794] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T17:23:31.454366] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-30T17:23:31.817992] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T17:23:31.824196] [INFO ] [REMOTE ] AWR: Full fetch complete (31997 records). [2025-09-30T17:23:31.824352] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-30T17:23:32.247521] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-30T17:23:32.247675] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-30T17:23:32.248165] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-30T17:23:32.248232] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-30T17:23:32.249270] [DEBUG] [LOCAL ] AWR: Trimmed 31997 records to 22569 (keeping 200 days of data) [2025-09-30T17:23:32.307833] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-30T17:23:32.406607] [DEBUG] [LOCAL ] AWR: Primary data saved (22569 records). [2025-09-30T17:23:32.406786] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-30T17:23:32.406879] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWR took 22.9s. Estimated remaining: 4h 23m 29s. Rate: 8.3 symbols/min [2025-09-30T17:23:32.607301] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:32.613488] [DEBUG] [LOCAL ] AXR: Loaded 3112 existing records from primary storage. [2025-09-30T17:23:32.613752] [INFO ] [MAIN ] AXR: Loaded 3112 existing records. [2025-09-30T17:23:32.824545] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:32.825048] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-30T17:23:32.825157] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-30T17:23:32.825404] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-30T17:23:32.825468] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-30T17:23:32.930630] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T17:23:33.062867] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-30T17:23:33.270847] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:33.854404] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-30T17:23:34.300856] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T17:23:34.654356] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-30T17:23:34.761078] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T17:23:35.106488] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-30T17:23:35.454716] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-30T17:23:36.163860] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T17:23:36.254416] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-30T17:23:36.446130] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T17:23:36.914700] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T17:23:37.054415] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-30T17:23:37.517522] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-30T17:23:37.854380] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-30T17:23:38.654386] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-30T17:23:38.942103] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T17:23:39.454376] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-30T17:23:40.254366] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-30T17:23:40.368205] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T17:23:40.560520] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T17:23:41.054404] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-30T17:23:41.854404] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-30T17:23:42.189693] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-30T17:23:42.286333] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T17:23:42.654400] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-30T17:23:42.936518] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T17:23:43.454391] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-30T17:23:44.017061] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T17:23:44.254369] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-30T17:23:44.479204] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T17:23:44.486047] [INFO ] [REMOTE ] AX: Full fetch complete (42663 records). [2025-09-30T17:23:44.486301] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-30T17:23:44.917070] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-30T17:23:44.917176] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-30T17:23:44.918008] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-30T17:23:44.918078] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-30T17:23:44.919314] [DEBUG] [LOCAL ] AX: Trimmed 42663 records to 28340 (keeping 200 days of data) [2025-09-30T17:23:45.054698] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-30T17:23:45.116687] [DEBUG] [LOCAL ] AX: Primary data saved (28340 records). [2025-09-30T17:23:45.116846] [INFO ] [MAIN ] AX: Full history saved. [2025-09-30T17:23:45.116965] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AX took 29.3s. Estimated remaining: 4h 24m 23s. Rate: 8.2 symbols/min [2025-09-30T17:23:45.315989] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:45.368810] [DEBUG] [LOCAL ] AXS: Loaded 38385 existing records from primary storage. [2025-09-30T17:23:45.369178] [INFO ] [MAIN ] AXS: Loaded 38385 existing records. [2025-09-30T17:23:45.579517] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:45.579799] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-30T17:23:45.579854] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-30T17:23:45.580391] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-30T17:23:45.580452] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-30T17:23:45.859602] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-30T17:23:46.030743] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:46.364098] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-30T17:23:46.453557] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-30T17:23:46.654399] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-30T17:23:46.811302] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T17:23:47.454399] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-30T17:23:48.254371] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-30T17:23:48.724685] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T17:23:48.952292] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-30T17:23:49.054363] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-30T17:23:49.630957] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T17:23:49.642231] [INFO ] [REMOTE ] AXL: Full fetch complete (72621 records). [2025-09-30T17:23:49.642397] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-30T17:23:49.738287] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T17:23:49.854938] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-30T17:23:50.116700] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-30T17:23:50.116815] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-30T17:23:50.117630] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-30T17:23:50.117715] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-30T17:23:50.119187] [DEBUG] [LOCAL ] AXL: Trimmed 72621 records to 50501 (keeping 200 days of data) [2025-09-30T17:23:50.428416] [DEBUG] [LOCAL ] AXL: Primary data saved (50501 records). [2025-09-30T17:23:50.428580] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-30T17:23:50.428703] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 32.3s. Estimated remaining: 4h 23m 53s. Rate: 8.2 symbols/min [2025-09-30T17:23:50.611512] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:23:50.660558] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-30T17:23:50.663963] [DEBUG] [LOCAL ] AXTA: Loaded 52065 existing records from primary storage. [2025-09-30T17:23:50.664418] [INFO ] [MAIN ] AXTA: Loaded 52065 existing records. [2025-09-30T17:23:50.872498] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:23:50.872740] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-30T17:23:50.872805] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-30T17:23:50.873411] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-30T17:23:50.873473] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-30T17:23:51.284179] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:23:51.344256] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:23:51.454342] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-30T17:23:52.254384] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-30T17:23:52.659817] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-30T17:23:52.830609] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-30T17:23:53.054389] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-30T17:23:53.553779] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-30T17:23:53.854407] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-30T17:23:54.654463] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-30T17:23:55.218528] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-30T17:23:55.289634] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T17:23:55.353831] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-30T17:23:55.454414] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-30T17:23:56.164149] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T17:23:56.254402] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-30T17:23:57.054365] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-30T17:23:57.477556] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-30T17:23:57.830104] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T17:23:57.854341] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-30T17:23:58.654398] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-30T17:23:59.346868] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T17:23:59.349127] [INFO ] [REMOTE ] AXR: Full fetch complete (4930 records). [2025-09-30T17:23:59.349223] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-30T17:23:59.460845] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-30T17:23:59.661506] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T17:23:59.906528] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-30T17:23:59.906607] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-30T17:23:59.906775] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-30T17:23:59.906836] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-30T17:23:59.907198] [DEBUG] [LOCAL ] AXR: Trimmed 4930 records to 3063 (keeping 200 days of data) [2025-09-30T17:23:59.925208] [DEBUG] [LOCAL ] AXR: Primary data saved (3063 records). [2025-09-30T17:23:59.925278] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-30T17:23:59.925354] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 27.5s. Estimated remaining: 4h 24m 11s. Rate: 8.2 symbols/min [2025-09-30T17:24:00.254376] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-30T17:24:01.054363] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-30T17:24:01.232781] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T17:24:01.854412] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-30T17:24:02.096993] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T17:24:02.634327] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:24:02.654369] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-30T17:24:03.044760] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T17:24:03.454378] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-30T17:24:04.254525] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-30T17:24:04.625479] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T17:24:04.879761] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T17:24:05.054392] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-30T17:24:05.691836] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T17:24:05.854400] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-30T17:24:06.654361] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-30T17:24:06.707847] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:24:07.147150] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T17:24:07.454401] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-30T17:24:08.254397] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-30T17:24:08.845050] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-30T17:24:08.861447] [INFO ] [REMOTE ] AXP: Full fetch complete (76891 records). [2025-09-30T17:24:08.861699] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-30T17:24:09.325400] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-30T17:24:09.325913] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-30T17:24:09.326858] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-30T17:24:09.337092] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-30T17:24:09.356539] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T17:24:09.365424] [DEBUG] [LOCAL ] AXP: Trimmed 76891 records to 53200 (keeping 200 days of data) [2025-09-30T17:24:09.367571] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-30T17:24:09.755586] [DEBUG] [LOCAL ] AXP: Primary data saved (53200 records). [2025-09-30T17:24:09.755785] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-30T17:24:09.755971] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXP took 42.3s. Estimated remaining: 4h 24m 31s. Rate: 8.2 symbols/min [2025-09-30T17:24:09.927256] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T17:24:09.939428] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-30T17:24:10.859885] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T17:24:10.869495] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-30T17:24:11.581414] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T17:24:11.593536] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-30T17:24:12.373923] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T17:24:12.383066] [INFO ] [REMOTE ] AXS: Full fetch complete (55631 records). [2025-09-30T17:24:12.383227] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-30T17:24:12.791002] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-30T17:24:12.791102] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-30T17:24:12.791746] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-30T17:24:12.791812] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-30T17:24:12.792995] [DEBUG] [LOCAL ] AXS: Trimmed 55631 records to 38397 (keeping 200 days of data) [2025-09-30T17:24:13.037990] [DEBUG] [LOCAL ] AXS: Primary data saved (38397 records). [2025-09-30T17:24:13.038179] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-30T17:24:13.039730] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXS took 27.9s. Estimated remaining: 4h 23m 40s. Rate: 8.2 symbols/min [2025-09-30T17:24:13.276385] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T17:24:13.288690] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-30T17:24:14.826728] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T17:24:14.839259] [INFO ] [REMOTE ] AXTA: Full fetch complete (74585 records). [2025-09-30T17:24:14.839564] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-30T17:24:14.843255] [FATAL] [VALIDATOR ] AXTA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:24:14.843436] [FATAL] [MAIN ] AXTA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:24:14.843883] [WARN ] [MAIN ] AXTA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:24:14.843953] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-30T17:24:14.844025] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-09-30T17:24:14.844082] [INFO ] [LOCAL ] AXTA: Starting deletion of derivative data. [2025-09-30T17:24:14.844751] [DEBUG] [LOCAL ] AXTA: Deleted derivative data file. [2025-09-30T17:24:14.844938] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 24.4s. Estimated remaining: 4h 22m 33s. Rate: 8.3 symbols/min [2025-09-30T17:24:15.513508] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:15.764913] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:15.765177] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-30T17:24:15.724457] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:15.784707] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:15.785259] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-30T17:24:15.785424] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-30T17:24:15.785628] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-30T17:24:15.785811] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-30T17:24:15.786101] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-30T17:24:15.926898] [DEBUG] [LOCAL ] AZO: Loaded 11372 existing records from primary storage. [2025-09-30T17:24:15.961047] [INFO ] [MAIN ] AZO: Loaded 11372 existing records. [2025-09-30T17:24:16.002498] [DEBUG] [LOCAL ] AZZ: Loaded 21975 existing records from primary storage. [2025-09-30T17:24:16.007924] [DEBUG] [LOCAL ] AYI: Loaded 25060 existing records from primary storage. [2025-09-30T17:24:16.048759] [INFO ] [MAIN ] AYI: Loaded 25060 existing records. [2025-09-30T17:24:16.113121] [INFO ] [MAIN ] AZZ: Loaded 21975 existing records. [2025-09-30T17:24:16.857326] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:16.916399] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:16.907730] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:16.922194] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-30T17:24:16.921856] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-30T17:24:16.960348] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-30T17:24:16.960174] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-30T17:24:16.997371] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-30T17:24:17.001676] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-30T17:24:17.001510] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:17.007409] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-30T17:24:17.007173] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-30T17:24:17.015103] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-30T17:24:17.015043] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-30T17:24:17.015230] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-30T17:24:17.039509] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-30T17:24:17.044815] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-30T17:24:18.188085] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:18.236305] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-30T17:24:18.260927] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:18.284054] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-30T17:24:18.352465] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:18.353452] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-30T17:24:18.377609] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T17:24:18.385970] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-30T17:24:19.211748] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-30T17:24:19.216223] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-30T17:24:19.287861] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T17:24:19.295337] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-30T17:24:19.308999] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T17:24:19.313931] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-30T17:24:19.375955] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T17:24:19.454350] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-30T17:24:19.509998] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:24:19.510354] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-30T17:24:19.510499] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:24:19.510577] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-09-30T17:24:19.510667] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:24:19.510739] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-30T17:24:19.510805] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-30T17:24:19.510841] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-30T17:24:19.510899] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-30T17:24:19.510971] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. B took 4.6s. Estimated remaining: 4h 21m 58s. Rate: 8.3 symbols/min [2025-09-30T17:24:19.692739] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:19.767482] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-30T17:24:19.767917] [INFO ] [MAIN ] BA: Loaded 53791 existing records. [2025-09-30T17:24:19.980126] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:19.980446] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-30T17:24:19.980510] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-30T17:24:19.981234] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-30T17:24:19.981350] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-30T17:24:20.132349] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T17:24:20.262155] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-30T17:24:20.440968] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:20.454235] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T17:24:20.592617] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T17:24:20.988988] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T17:24:21.054381] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-30T17:24:21.854338] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-30T17:24:22.161415] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T17:24:22.649268] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T17:24:22.654781] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-30T17:24:23.441837] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T17:24:23.454402] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-30T17:24:24.254417] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-30T17:24:24.816023] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:24:25.054364] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-30T17:24:25.338473] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T17:24:25.854415] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-30T17:24:26.654397] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-30T17:24:26.946360] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T17:24:27.454444] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-30T17:24:27.629482] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-30T17:24:27.944500] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T17:24:28.254412] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-30T17:24:28.348506] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T17:24:29.054405] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-30T17:24:29.854396] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-30T17:24:30.488820] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-30T17:24:30.531628] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T17:24:30.654416] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-30T17:24:31.067842] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T17:24:31.454371] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-30T17:24:32.254420] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-30T17:24:32.482240] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T17:24:32.594736] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-30T17:24:33.054415] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-30T17:24:33.115500] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T17:24:33.854370] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-30T17:24:34.089824] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T17:24:34.654603] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-30T17:24:35.454416] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-30T17:24:35.738314] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T17:24:36.134971] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-30T17:24:36.254367] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-30T17:24:36.613842] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T17:24:37.054417] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-30T17:24:37.232124] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T17:24:37.854327] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-30T17:24:37.930308] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T17:24:38.654410] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-30T17:24:38.680326] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T17:24:39.454412] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-30T17:24:39.679255] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T17:24:39.684736] [INFO ] [REMOTE ] AYI: Full fetch complete (36823 records). [2025-09-30T17:24:39.684900] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-30T17:24:40.121521] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-30T17:24:40.121624] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-30T17:24:40.122154] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-30T17:24:40.122236] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-30T17:24:40.123258] [DEBUG] [LOCAL ] AYI: Trimmed 36823 records to 25081 (keeping 200 days of data) [2025-09-30T17:24:40.254481] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-30T17:24:40.335877] [DEBUG] [LOCAL ] AYI: Primary data saved (25081 records). [2025-09-30T17:24:40.336057] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-30T17:24:40.336225] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AYI took 25.5s. Estimated remaining: 4h 24m 17s. Rate: 8.2 symbols/min [2025-09-30T17:24:40.538796] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:40.612049] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-30T17:24:40.613345] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-09-30T17:24:40.612856] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T17:24:40.821692] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:40.821970] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-30T17:24:40.822022] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-30T17:24:40.822418] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-30T17:24:40.822480] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-30T17:24:41.034907] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T17:24:41.063055] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-30T17:24:41.250525] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:41.854364] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-30T17:24:42.336796] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T17:24:42.342440] [INFO ] [REMOTE ] AZZ: Full fetch complete (30838 records). [2025-09-30T17:24:42.342623] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-30T17:24:42.659803] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-30T17:24:42.825765] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-30T17:24:42.825863] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-30T17:24:42.826372] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-30T17:24:42.826441] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-30T17:24:42.827502] [DEBUG] [LOCAL ] AZZ: Trimmed 30838 records to 21981 (keeping 200 days of data) [2025-09-30T17:24:42.979153] [DEBUG] [LOCAL ] AZZ: Primary data saved (21981 records). [2025-09-30T17:24:42.979291] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-30T17:24:42.979383] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AZZ took 28.1s. Estimated remaining: 4h 23m 20s. Rate: 8.2 symbols/min [2025-09-30T17:24:43.167032] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:43.228862] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-30T17:24:43.229252] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-09-30T17:24:43.430497] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:43.430825] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-30T17:24:43.430926] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-30T17:24:43.431589] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-30T17:24:43.431689] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-30T17:24:43.465416] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-30T17:24:43.854691] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:43.864357] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T17:24:43.867831] [INFO ] [REMOTE ] AZO: Full fetch complete (16188 records). [2025-09-30T17:24:43.868018] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-30T17:24:44.257339] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-30T17:24:44.300637] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-30T17:24:44.300881] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-30T17:24:44.301269] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-30T17:24:44.301550] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-30T17:24:44.302503] [DEBUG] [LOCAL ] AZO: Trimmed 16188 records to 11334 (keeping 200 days of data) [2025-09-30T17:24:44.396074] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-30T17:24:44.436308] [DEBUG] [LOCAL ] AZO: Primary data saved (11334 records). [2025-09-30T17:24:44.436498] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-30T17:24:44.436752] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. AZO took 29.6s. Estimated remaining: 4h 22m 10s. Rate: 8.3 symbols/min [2025-09-30T17:24:44.626914] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:24:44.690974] [DEBUG] [LOCAL ] BAH: Loaded 51698 existing records from primary storage. [2025-09-30T17:24:44.691582] [INFO ] [MAIN ] BAH: Loaded 51698 existing records. [2025-09-30T17:24:44.902127] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:24:44.902546] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-30T17:24:44.902595] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-30T17:24:44.903128] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-30T17:24:44.903189] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-30T17:24:45.060267] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-30T17:24:45.326831] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:24:45.854409] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-30T17:24:46.199547] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-30T17:24:46.437177] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-30T17:24:46.654385] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-30T17:24:47.454585] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-30T17:24:47.654921] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T17:24:47.758780] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-30T17:24:48.254416] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-30T17:24:48.727038] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-30T17:24:49.054587] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-30T17:24:49.854405] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-30T17:24:50.035102] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-30T17:24:50.135572] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T17:24:50.654389] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-30T17:24:51.008457] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-30T17:24:51.454387] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-30T17:24:51.854462] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-30T17:24:52.035190] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:24:52.254368] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-30T17:24:53.054391] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-30T17:24:53.401510] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-30T17:24:53.772603] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T17:24:53.854360] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-30T17:24:54.654398] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-30T17:24:55.454357] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-30T17:24:55.604059] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-30T17:24:55.899025] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-30T17:24:56.196026] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T17:24:56.254372] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-30T17:24:57.054360] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-30T17:24:57.863044] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-30T17:24:57.869693] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-30T17:24:58.102849] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-09-30T17:24:58.654374] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-30T17:24:59.437727] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-30T17:24:59.454300] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-30T17:25:00.254413] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-30T17:25:00.370848] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-30T17:25:01.054337] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-30T17:25:01.132987] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-30T17:25:01.145321] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-09-30T17:25:01.145507] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-30T17:25:01.632978] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-30T17:25:01.633167] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-30T17:25:01.634231] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-30T17:25:01.634316] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-30T17:25:01.636715] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 53790 (keeping 200 days of data) [2025-09-30T17:25:01.808291] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T17:25:01.887443] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-30T17:25:02.070882] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-09-30T17:25:02.071042] [INFO ] [MAIN ] BA: Full history saved. [2025-09-30T17:25:02.071142] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BA took 42.6s. Estimated remaining: 4h 23m 53s. Rate: 8.2 symbols/min [2025-09-30T17:25:02.277531] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:02.317674] [DEBUG] [LOCAL ] BAK: Loaded 39012 existing records from primary storage. [2025-09-30T17:25:02.318082] [INFO ] [MAIN ] BAK: Loaded 39012 existing records. [2025-09-30T17:25:02.525585] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:25:02.525863] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-30T17:25:02.525946] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-30T17:25:02.526274] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-30T17:25:02.526339] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-30T17:25:02.756739] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-09-30T17:25:02.921687] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-30T17:25:03.020205] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:03.454407] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-30T17:25:03.539386] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-30T17:25:03.586487] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:25:04.254395] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-30T17:25:04.823335] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T17:25:05.054417] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-30T17:25:05.318830] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-30T17:25:05.535501] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T17:25:05.854406] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-30T17:25:06.654369] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-30T17:25:07.080249] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T17:25:07.146831] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T17:25:07.454390] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-30T17:25:08.254409] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-30T17:25:08.789244] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T17:25:08.801403] [INFO ] [REMOTE ] BAH: Full fetch complete (74787 records). [2025-09-30T17:25:08.801575] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-30T17:25:09.063906] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-30T17:25:09.255952] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-30T17:25:09.256120] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-30T17:25:09.257047] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-30T17:25:09.257138] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-30T17:25:09.258974] [DEBUG] [LOCAL ] BAH: Trimmed 74787 records to 51655 (keeping 200 days of data) [2025-09-30T17:25:09.629425] [DEBUG] [LOCAL ] BAH: Primary data saved (51655 records). [2025-09-30T17:25:09.629592] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-30T17:25:09.629762] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BAH took 25.2s. Estimated remaining: 4h 23m 48s. Rate: 8.2 symbols/min [2025-09-30T17:25:09.852207] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:09.889117] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:25:09.898722] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-30T17:25:09.948767] [DEBUG] [LOCAL ] BALL: Loaded 51786 existing records from primary storage. [2025-09-30T17:25:09.949177] [INFO ] [MAIN ] BALL: Loaded 51786 existing records. [2025-09-30T17:25:10.197964] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:25:10.200360] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-30T17:25:10.200081] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-09-30T17:25:10.211092] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-30T17:25:10.212376] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-30T17:25:10.212447] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-30T17:25:10.609771] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:10.654433] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-30T17:25:11.077448] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T17:25:11.276712] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-30T17:25:11.454435] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-30T17:25:11.981704] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T17:25:12.254399] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-30T17:25:13.054380] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-30T17:25:13.860014] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-30T17:25:13.875455] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-30T17:25:14.068988] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T17:25:14.654363] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-30T17:25:15.264245] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T17:25:15.454400] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-30T17:25:15.677590] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-30T17:25:16.254427] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-30T17:25:16.823129] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T17:25:16.842391] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-30T17:25:16.842625] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-30T17:25:17.059358] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-30T17:25:17.109484] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T17:25:17.357900] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-30T17:25:17.357998] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-30T17:25:17.358884] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-30T17:25:17.358952] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-30T17:25:17.360743] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-09-30T17:25:17.657695] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T17:25:17.783526] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-09-30T17:25:17.783714] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-30T17:25:17.784713] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAC took 34.8s. Estimated remaining: 4h 23m 49s. Rate: 8.2 symbols/min [2025-09-30T17:25:17.864029] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-30T17:25:17.994162] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:17.994383] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-30T17:25:17.994430] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-30T17:25:17.994546] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-30T17:25:17.994591] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-30T17:25:17.994639] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-30T17:25:17.994729] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-30T17:25:18.393884] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:18.654399] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-30T17:25:19.400064] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T17:25:19.454399] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-30T17:25:19.756819] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-30T17:25:20.254393] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-30T17:25:20.468827] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T17:25:20.745264] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T17:25:21.054378] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-30T17:25:21.854411] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-30T17:25:22.254360] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T17:25:22.654359] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-30T17:25:22.918551] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-30T17:25:22.944149] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T17:25:22.944341] [INFO ] [REMOTE ] BABA: Full fetch complete (77593 records). [2025-09-30T17:25:22.949876] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-30T17:25:22.950790] [FATAL] [VALIDATOR ] BABA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:25:22.950888] [FATAL] [MAIN ] BABA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:25:22.950935] [WARN ] [MAIN ] BABA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:25:22.951002] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-30T17:25:22.951069] [DEBUG] [LOCAL ] BABA: No primary data file found to delete. [2025-09-30T17:25:22.951108] [INFO ] [LOCAL ] BABA: Starting deletion of derivative data. [2025-09-30T17:25:22.951429] [DEBUG] [LOCAL ] BABA: Deleted derivative data file. [2025-09-30T17:25:22.953936] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BABA took 42.6s. Estimated remaining: 4h 23m 20s. Rate: 8.2 symbols/min [2025-09-30T17:25:23.142837] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:23.209487] [DEBUG] [LOCAL ] BAM: Loaded 51993 existing records from primary storage. [2025-09-30T17:25:23.209857] [INFO ] [MAIN ] BAM: Loaded 51993 existing records. [2025-09-30T17:25:23.405393] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:25:23.405661] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-30T17:25:23.405727] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-30T17:25:23.406176] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-30T17:25:23.406237] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-30T17:25:23.465400] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-30T17:25:23.816570] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:24.238502] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T17:25:24.247376] [INFO ] [REMOTE ] BAK: Full fetch complete (56771 records). [2025-09-30T17:25:24.247530] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-30T17:25:24.248529] [FATAL] [VALIDATOR ] BAK: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:25:24.248636] [FATAL] [MAIN ] BAK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:25:24.248732] [WARN ] [MAIN ] BAK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:25:24.248814] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-30T17:25:24.248912] [DEBUG] [LOCAL ] BAK: No primary data file found to delete. [2025-09-30T17:25:24.248969] [INFO ] [LOCAL ] BAK: Starting deletion of derivative data. [2025-09-30T17:25:24.249272] [DEBUG] [LOCAL ] BAK: Deleted derivative data file. [2025-09-30T17:25:24.249392] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BAK took 22.2s. Estimated remaining: 4h 22m 10s. Rate: 8.2 symbols/min [2025-09-30T17:25:24.262723] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-30T17:25:24.482420] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:24.543437] [DEBUG] [LOCAL ] BANC: Loaded 51232 existing records from primary storage. [2025-09-30T17:25:24.543878] [INFO ] [MAIN ] BANC: Loaded 51232 existing records. [2025-09-30T17:25:24.744477] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:25:24.744762] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-30T17:25:24.744863] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-30T17:25:24.745547] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-30T17:25:24.745609] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-30T17:25:25.062334] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-30T17:25:25.163979] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:25.204540] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T17:25:25.703156] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T17:25:25.854315] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-30T17:25:26.330683] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T17:25:26.654522] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-30T17:25:27.243448] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T17:25:27.454403] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-30T17:25:27.576870] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T17:25:28.254419] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-30T17:25:29.021840] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T17:25:29.054711] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-30T17:25:29.057415] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T17:25:29.854433] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-30T17:25:30.452310] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T17:25:30.654418] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-30T17:25:31.460039] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-30T17:25:31.466583] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T17:25:31.945315] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T17:25:32.208061] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T17:25:32.254373] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-30T17:25:33.054399] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-30T17:25:33.854358] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-30T17:25:33.967625] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T17:25:34.559251] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T17:25:34.654401] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-30T17:25:35.245273] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T17:25:35.454378] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-30T17:25:36.124170] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T17:25:36.254371] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-30T17:25:36.283062] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T17:25:37.054428] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-30T17:25:37.854428] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-30T17:25:37.929737] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T17:25:38.654392] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-30T17:25:39.079986] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-30T17:25:39.368464] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T17:25:39.454386] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-30T17:25:40.254413] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-30T17:25:40.327295] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T17:25:41.057154] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-30T17:25:41.060164] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T17:25:41.180708] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:25:41.854417] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-30T17:25:42.593143] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T17:25:42.654391] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-30T17:25:43.172033] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T17:25:43.454396] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-30T17:25:43.922456] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T17:25:44.254371] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-30T17:25:44.631402] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-30T17:25:44.825879] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T17:25:45.054387] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-30T17:25:45.854397] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-30T17:25:46.654355] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-30T17:25:47.114587] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-30T17:25:47.125817] [INFO ] [REMOTE ] BAM: Full fetch complete (73842 records). [2025-09-30T17:25:47.125993] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-30T17:25:47.126834] [FATAL] [VALIDATOR ] BAM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:25:47.126929] [FATAL] [MAIN ] BAM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:25:47.126976] [WARN ] [MAIN ] BAM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:25:47.127021] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-30T17:25:47.127096] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-09-30T17:25:47.127155] [INFO ] [LOCAL ] BAM: Starting deletion of derivative data. [2025-09-30T17:25:47.127431] [DEBUG] [LOCAL ] BAM: Deleted derivative data file. [2025-09-30T17:25:47.128281] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BAM took 24.2s. Estimated remaining: 4h 24m 44s. Rate: 8.2 symbols/min [2025-09-30T17:25:47.324688] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:47.335033] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T17:25:47.338457] [INFO ] [REMOTE ] BALY: Full fetch complete (17041 records). [2025-09-30T17:25:47.338681] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-30T17:25:47.458812] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-30T17:25:47.595232] [DEBUG] [LOCAL ] BAP: Loaded 26168 existing records from primary storage. [2025-09-30T17:25:47.611317] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T17:25:47.611843] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:25:47.611955] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:25:47.612055] [INFO ] [MAIN ] BAP: Loaded 26168 existing records. [2025-09-30T17:25:47.651449] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-30T17:25:47.733755] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-30T17:25:47.776685] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-30T17:25:47.792275] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-30T17:25:47.812894] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BALY took 30.0s. Estimated remaining: 4h 23m 28s. Rate: 8.2 symbols/min [2025-09-30T17:25:47.826195] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T17:25:47.867342] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:25:47.890623] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-30T17:25:47.907082] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-30T17:25:47.960181] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-30T17:25:47.973834] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-30T17:25:48.197127] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:48.269244] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-30T17:25:48.511314] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:48.512484] [DEBUG] [LOCAL ] BARK: Loaded 38149 existing records from primary storage. [2025-09-30T17:25:48.513068] [INFO ] [MAIN ] BARK: Loaded 38149 existing records. [2025-09-30T17:25:48.708969] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:25:48.709217] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-30T17:25:48.709272] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-30T17:25:48.709616] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-30T17:25:48.709714] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-30T17:25:49.067667] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-30T17:25:49.115231] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:49.152741] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T17:25:49.164115] [INFO ] [REMOTE ] BALL: Full fetch complete (75366 records). [2025-09-30T17:25:49.164277] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-30T17:25:49.620741] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-30T17:25:49.620968] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-30T17:25:49.621891] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-30T17:25:49.621959] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-30T17:25:49.623671] [DEBUG] [LOCAL ] BALL: Trimmed 75366 records to 51794 (keeping 200 days of data) [2025-09-30T17:25:49.860852] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-30T17:25:49.885184] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T17:25:50.010193] [DEBUG] [LOCAL ] BALL: Primary data saved (51794 records). [2025-09-30T17:25:50.010360] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-30T17:25:50.010463] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BALL took 40.4s. Estimated remaining: 4h 22m 29s. Rate: 8.2 symbols/min [2025-09-30T17:25:50.215198] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:25:50.215503] [DEBUG] [LOCAL ] BAX: No existing data file found in primary storage. [2025-09-30T17:25:50.215717] [WARN ] [MAIN ] BAX: No existing data found, performing full refresh instead. [2025-09-30T17:25:50.215847] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-30T17:25:50.215890] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-30T17:25:50.215932] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-09-30T17:25:50.215966] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-30T17:25:50.615184] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T17:25:50.657383] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:25:50.657492] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-30T17:25:51.415544] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T17:25:51.454338] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-30T17:25:51.605373] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T17:25:52.254372] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-30T17:25:52.646608] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T17:25:53.054375] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-30T17:25:53.854376] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-30T17:25:54.024714] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T17:25:54.654359] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-30T17:25:54.789847] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T17:25:54.894558] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T17:25:55.454358] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-30T17:25:55.790144] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T17:25:56.254377] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-30T17:25:57.054348] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-30T17:25:57.110205] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T17:25:57.854401] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-30T17:25:58.004896] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T17:25:58.165936] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T17:25:58.654385] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-30T17:25:59.255747] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T17:25:59.454416] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-30T17:26:00.254411] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-30T17:26:00.566082] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T17:26:01.030360] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-30T17:26:01.042090] [INFO ] [REMOTE ] BANC: Full fetch complete (74227 records). [2025-09-30T17:26:01.042281] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-30T17:26:01.059491] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-30T17:26:01.539023] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-30T17:26:01.539204] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-30T17:26:01.540378] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-30T17:26:01.540456] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-30T17:26:01.542368] [DEBUG] [LOCAL ] BANC: Trimmed 74227 records to 51234 (keeping 200 days of data) [2025-09-30T17:26:01.697964] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T17:26:01.854464] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-30T17:26:01.971121] [DEBUG] [LOCAL ] BANC: Primary data saved (51234 records). [2025-09-30T17:26:01.971337] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-30T17:26:01.971591] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BANC took 37.7s. Estimated remaining: 4h 23m 9s. Rate: 8.2 symbols/min [2025-09-30T17:26:02.197054] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:02.262365] [DEBUG] [LOCAL ] BB: Loaded 52924 existing records from primary storage. [2025-09-30T17:26:02.262874] [INFO ] [MAIN ] BB: Loaded 52924 existing records. [2025-09-30T17:26:02.504428] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T17:26:02.529893] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:02.537386] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-30T17:26:02.537862] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-30T17:26:02.538305] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-30T17:26:02.538399] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-30T17:26:02.659588] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-30T17:26:02.965528] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:03.454353] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-30T17:26:03.575201] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T17:26:04.107440] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:26:04.254401] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-30T17:26:05.054455] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-30T17:26:05.290615] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T17:26:05.854425] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-30T17:26:05.903214] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T17:26:05.976398] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T17:26:06.654396] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-30T17:26:07.454404] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-30T17:26:07.848286] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-30T17:26:07.919470] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T17:26:08.254331] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-30T17:26:08.309559] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T17:26:09.054408] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-30T17:26:09.854383] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-30T17:26:10.364147] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-30T17:26:10.617185] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T17:26:10.654401] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-30T17:26:10.900231] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T17:26:11.454427] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-30T17:26:12.254387] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-30T17:26:12.569686] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T17:26:12.626221] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T17:26:12.633451] [INFO ] [REMOTE ] BAP: Full fetch complete (37714 records). [2025-09-30T17:26:12.633669] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-30T17:26:13.060080] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-30T17:26:13.078820] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-30T17:26:13.078923] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-30T17:26:13.079440] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-30T17:26:13.079509] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-30T17:26:13.080516] [DEBUG] [LOCAL ] BAP: Trimmed 37714 records to 26131 (keeping 200 days of data) [2025-09-30T17:26:13.262294] [DEBUG] [LOCAL ] BAP: Primary data saved (26131 records). [2025-09-30T17:26:13.262490] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-30T17:26:13.262633] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BAP took 26.1s. Estimated remaining: 4h 23m 41s. Rate: 8.2 symbols/min [2025-09-30T17:26:13.462004] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:13.485272] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T17:26:13.557132] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-30T17:26:13.557530] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-09-30T17:26:13.758759] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:13.758992] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-30T17:26:13.759042] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-30T17:26:13.759635] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-30T17:26:13.759766] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-30T17:26:13.861936] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-30T17:26:14.164344] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:14.654564] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-30T17:26:14.786367] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T17:26:15.454383] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-30T17:26:15.734909] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T17:26:15.743107] [INFO ] [REMOTE ] BARK: Full fetch complete (56364 records). [2025-09-30T17:26:15.743286] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-30T17:26:15.744061] [FATAL] [VALIDATOR ] BARK: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:26:15.744172] [FATAL] [MAIN ] BARK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:26:15.744248] [WARN ] [MAIN ] BARK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:26:15.744360] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-30T17:26:15.744470] [DEBUG] [LOCAL ] BARK: No primary data file found to delete. [2025-09-30T17:26:15.744541] [INFO ] [LOCAL ] BARK: Starting deletion of derivative data. [2025-09-30T17:26:15.744926] [DEBUG] [LOCAL ] BARK: Deleted derivative data file. [2025-09-30T17:26:15.745043] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BARK took 27.9s. Estimated remaining: 4h 22m 45s. Rate: 8.2 symbols/min [2025-09-30T17:26:15.957943] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:16.017067] [DEBUG] [LOCAL ] BBAR: Loaded 41378 existing records from primary storage. [2025-09-30T17:26:16.017440] [INFO ] [MAIN ] BBAR: Loaded 41378 existing records. [2025-09-30T17:26:16.229174] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:16.229475] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-30T17:26:16.229551] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-30T17:26:16.229951] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-30T17:26:16.230012] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-30T17:26:16.264338] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-30T17:26:16.695039] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:17.044225] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T17:26:17.056696] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-30T17:26:17.216411] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-30T17:26:17.854415] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-30T17:26:18.427309] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T17:26:18.488569] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T17:26:18.654404] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-30T17:26:19.454368] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-30T17:26:19.929717] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-30T17:26:20.254359] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-30T17:26:20.324785] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T17:26:21.050293] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T17:26:21.061084] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-30T17:26:21.854359] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-30T17:26:22.136716] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T17:26:22.649811] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T17:26:22.660269] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-30T17:26:23.454406] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-30T17:26:24.081261] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-30T17:26:24.254408] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-30T17:26:24.580459] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T17:26:25.054371] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-30T17:26:25.468551] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-30T17:26:25.482956] [INFO ] [REMOTE ] BAX: Full fetch complete (77443 records). [2025-09-30T17:26:25.483182] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-30T17:26:25.858530] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-30T17:26:25.962681] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-30T17:26:25.972247] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-30T17:26:25.973422] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-30T17:26:25.973530] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-30T17:26:25.977279] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T17:26:25.988334] [DEBUG] [LOCAL ] BAX: Trimmed 77443 records to 53492 (keeping 200 days of data) [2025-09-30T17:26:26.339983] [DEBUG] [LOCAL ] BAX: Primary data saved (53492 records). [2025-09-30T17:26:26.340140] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-30T17:26:26.340221] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BAX took 36.3s. Estimated remaining: 4h 23m 11s. Rate: 8.2 symbols/min [2025-09-30T17:26:26.548602] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:26.608302] [DEBUG] [LOCAL ] BBD: Loaded 53196 existing records from primary storage. [2025-09-30T17:26:26.608746] [INFO ] [MAIN ] BBD: Loaded 53196 existing records. [2025-09-30T17:26:26.660713] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-30T17:26:26.842686] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:26.842938] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-30T17:26:26.843000] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-30T17:26:26.843404] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-30T17:26:26.843466] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-30T17:26:27.273934] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:27.305079] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-30T17:26:27.454381] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-30T17:26:27.878899] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-30T17:26:27.948595] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T17:26:28.254418] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-30T17:26:29.054439] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-30T17:26:29.383027] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T17:26:29.857101] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-30T17:26:29.930243] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T17:26:30.654411] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-30T17:26:31.036885] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T17:26:31.454422] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-30T17:26:31.869213] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T17:26:32.254386] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-30T17:26:32.479611] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-30T17:26:33.054422] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-30T17:26:33.114850] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T17:26:33.854457] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-30T17:26:34.020880] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T17:26:34.654440] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-30T17:26:34.756696] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:26:35.222539] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T17:26:35.454374] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-30T17:26:36.254389] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-30T17:26:37.054394] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-30T17:26:37.147937] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T17:26:37.396961] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-30T17:26:37.810438] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T17:26:37.854410] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-30T17:26:38.654415] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-30T17:26:39.142348] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T17:26:39.154785] [INFO ] [REMOTE ] BB: Full fetch complete (76983 records). [2025-09-30T17:26:39.154962] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-30T17:26:39.456262] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-30T17:26:39.627439] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-30T17:26:39.641683] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-30T17:26:39.642791] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-30T17:26:39.643332] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-30T17:26:39.645296] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T17:26:39.656872] [INFO ] [REMOTE ] BBAR: Full fetch complete (60804 records). [2025-09-30T17:26:39.657219] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-30T17:26:39.657112] [DEBUG] [LOCAL ] BB: Trimmed 76983 records to 52928 (keeping 200 days of data) [2025-09-30T17:26:40.188128] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-30T17:26:40.189222] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-30T17:26:40.190525] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-30T17:26:40.191832] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-30T17:26:40.197702] [DEBUG] [LOCAL ] BBAR: Trimmed 60804 records to 41447 (keeping 200 days of data) [2025-09-30T17:26:40.473485] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T17:26:40.492779] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-30T17:26:40.719605] [DEBUG] [LOCAL ] BB: Primary data saved (52928 records). [2025-09-30T17:26:40.720278] [INFO ] [MAIN ] BB: Full history saved. [2025-09-30T17:26:40.720623] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BB took 38.7s. Estimated remaining: 4h 24m 13s. Rate: 8.2 symbols/min [2025-09-30T17:26:40.939671] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:40.954805] [DEBUG] [LOCAL ] BBAR: Primary data saved (41447 records). [2025-09-30T17:26:40.954973] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-30T17:26:40.955779] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAR took 25.2s. Estimated remaining: 4h 22m 56s. Rate: 8.2 symbols/min [2025-09-30T17:26:41.184731] [DEBUG] [LOCAL ] BBDC: Loaded 33080 existing records from primary storage. [2025-09-30T17:26:41.204633] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:41.203148] [INFO ] [MAIN ] BBDC: Loaded 33080 existing records. [2025-09-30T17:26:41.340820] [DEBUG] [LOCAL ] BBDO: Loaded 4954 existing records from primary storage. [2025-09-30T17:26:41.366030] [INFO ] [MAIN ] BBDO: Loaded 4954 existing records. [2025-09-30T17:26:41.502080] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:41.513799] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-30T17:26:41.514097] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-30T17:26:41.530053] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-30T17:26:41.535237] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-30T17:26:41.719681] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:41.725451] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-30T17:26:41.730673] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-30T17:26:41.761130] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-30T17:26:41.800524] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-30T17:26:42.169866] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:42.181471] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-30T17:26:42.453992] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:42.470359] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-30T17:26:42.482500] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-30T17:26:42.501317] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-09-30T17:26:42.654367] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-30T17:26:43.347158] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T17:26:43.454380] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-30T17:26:43.824128] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T17:26:44.018836] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T17:26:44.254372] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-30T17:26:45.054349] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-30T17:26:45.230510] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-30T17:26:45.525063] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T17:26:45.854333] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-30T17:26:45.908046] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T17:26:46.654380] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-30T17:26:47.454372] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-30T17:26:47.499412] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T17:26:47.676941] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T17:26:47.898423] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T17:26:48.254480] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-30T17:26:49.054392] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-30T17:26:49.709073] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:26:49.854369] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-30T17:26:50.181144] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T17:26:50.654380] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-30T17:26:51.454416] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-30T17:26:51.765302] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T17:26:51.777146] [INFO ] [REMOTE ] BBD: Full fetch complete (77112 records). [2025-09-30T17:26:51.777317] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-30T17:26:51.909091] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-30T17:26:52.242138] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T17:26:52.263387] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-30T17:26:52.276837] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-30T17:26:52.277351] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-30T17:26:52.278256] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-30T17:26:52.278468] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-30T17:26:52.280627] [DEBUG] [LOCAL ] BBD: Trimmed 77112 records to 53195 (keeping 200 days of data) [2025-09-30T17:26:52.617566] [DEBUG] [LOCAL ] BBD: Primary data saved (53195 records). [2025-09-30T17:26:52.617757] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-30T17:26:52.617872] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBD took 26.3s. Estimated remaining: 4h 23m 31s. Rate: 8.2 symbols/min [2025-09-30T17:26:52.815452] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:26:52.837810] [DEBUG] [LOCAL ] BBN: Loaded 18016 existing records from primary storage. [2025-09-30T17:26:52.838125] [INFO ] [MAIN ] BBN: Loaded 18016 existing records. [2025-09-30T17:26:53.060876] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-30T17:26:53.068914] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:26:53.070226] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-30T17:26:53.070282] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-30T17:26:53.070723] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-30T17:26:53.070819] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-30T17:26:53.477806] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:26:53.854409] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-30T17:26:54.025935] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T17:26:54.654408] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-30T17:26:54.991317] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-30T17:26:55.086307] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T17:26:55.141255] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T17:26:55.454401] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-30T17:26:56.254387] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-30T17:26:56.813872] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T17:26:57.054357] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-30T17:26:57.854388] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-30T17:26:58.456173] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T17:26:58.654320] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-30T17:26:58.790766] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T17:26:58.877924] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-30T17:26:59.454380] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-30T17:26:59.810764] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T17:27:00.254389] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-30T17:27:00.370956] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T17:27:00.973815] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T17:27:01.054353] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-30T17:27:01.647380] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T17:27:01.854363] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-30T17:27:02.441092] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T17:27:02.654399] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-30T17:27:03.454396] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-30T17:27:04.102379] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:27:04.254429] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-30T17:27:04.452944] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T17:27:05.054406] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-30T17:27:05.463465] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T17:27:05.471287] [INFO ] [REMOTE ] BBDC: Full fetch complete (48728 records). [2025-09-30T17:27:05.471404] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-30T17:27:05.859499] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-30T17:27:05.877191] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-30T17:27:05.877274] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-30T17:27:05.877922] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-30T17:27:05.878057] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-30T17:27:05.879286] [DEBUG] [LOCAL ] BBDC: Trimmed 48728 records to 33001 (keeping 200 days of data) [2025-09-30T17:27:06.091747] [DEBUG] [LOCAL ] BBDC: Primary data saved (33001 records). [2025-09-30T17:27:06.091895] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-30T17:27:06.092006] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBDC took 25.4s. Estimated remaining: 4h 24m 24s. Rate: 8.1 symbols/min [2025-09-30T17:27:06.286522] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:06.286722] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-30T17:27:06.286775] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-30T17:27:06.286893] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-30T17:27:06.286935] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-30T17:27:06.286979] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-30T17:27:06.287013] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-30T17:27:06.661067] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T17:27:06.661168] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-30T17:27:06.710281] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:06.704107] [INFO ] [REMOTE ] BBDO: Full fetch complete (7609 records). [2025-09-30T17:27:06.711553] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-30T17:27:07.112046] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-30T17:27:07.112172] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-30T17:27:07.112461] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-30T17:27:07.112521] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-30T17:27:07.112978] [DEBUG] [LOCAL ] BBDO: Trimmed 7609 records to 4915 (keeping 200 days of data) [2025-09-30T17:27:07.142719] [DEBUG] [LOCAL ] BBDO: Primary data saved (4915 records). [2025-09-30T17:27:07.142855] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-30T17:27:07.142938] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBDO took 26.2s. Estimated remaining: 4h 23m 15s. Rate: 8.2 symbols/min [2025-09-30T17:27:07.326019] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:07.332368] [DEBUG] [LOCAL ] BBU: Loaded 4536 existing records from primary storage. [2025-09-30T17:27:07.332549] [INFO ] [MAIN ] BBU: Loaded 4536 existing records. [2025-09-30T17:27:07.459549] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-30T17:27:07.533859] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:27:07.534781] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-30T17:27:07.535115] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-30T17:27:07.535393] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-30T17:27:07.535454] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-30T17:27:07.797402] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:27:07.828923] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-30T17:27:07.856845] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:27:07.870414] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-09-30T17:27:07.890476] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:27:07.901153] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-30T17:27:07.911841] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-30T17:27:07.945945] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T17:27:07.991547] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-30T17:27:08.033132] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-30T17:27:08.032970] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:08.034401] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBT took 1.9s. Estimated remaining: 4h 22m 5s. Rate: 8.2 symbols/min [2025-09-30T17:27:08.216919] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (3.16 seconds). [2025-09-30T17:27:08.261460] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-30T17:27:08.266363] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-30T17:27:08.267373] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-30T17:27:08.266157] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:08.267805] [DEBUG] [LOCAL ] BBUC: No existing data file found in primary storage. [2025-09-30T17:27:08.267875] [WARN ] [MAIN ] BBUC: No existing data found, performing full refresh instead. [2025-09-30T17:27:08.325823] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-30T17:27:08.364016] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-30T17:27:08.374897] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-09-30T17:27:08.375007] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-30T17:27:09.076251] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-30T17:27:09.091195] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-30T17:27:09.120178] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-30T17:27:09.132765] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-30T17:27:09.182826] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-30T17:27:09.182711] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:09.202903] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T17:27:09.205487] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-30T17:27:09.547690] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-09-30T17:27:09.547840] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-30T17:27:09.550172] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBAI took 56.3s. Estimated remaining: 4h 21m 2s. Rate: 8.2 symbols/min [2025-09-30T17:27:09.740246] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:09.745503] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-30T17:27:09.808682] [DEBUG] [LOCAL ] BBVA: Loaded 49353 existing records from primary storage. [2025-09-30T17:27:09.809051] [INFO ] [MAIN ] BBVA: Loaded 49353 existing records. [2025-09-30T17:27:09.859534] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-30T17:27:10.032164] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:27:10.032439] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-30T17:27:10.032489] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-30T17:27:10.033076] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-30T17:27:10.033137] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-30T17:27:10.424184] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:10.498259] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T17:27:10.654382] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-30T17:27:11.242066] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T17:27:11.454360] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-30T17:27:12.254335] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-30T17:27:12.275686] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T17:27:12.673294] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-30T17:27:13.054391] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-30T17:27:13.855901] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-30T17:27:13.857703] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T17:27:14.654409] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-30T17:27:15.272963] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T17:27:15.454328] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-30T17:27:15.529174] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T17:27:16.254370] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-30T17:27:16.426925] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T17:27:16.713638] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T17:27:17.054402] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-30T17:27:17.507860] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T17:27:17.854387] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-30T17:27:18.654392] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-30T17:27:18.677758] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T17:27:19.454394] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-30T17:27:19.645857] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:27:19.975608] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T17:27:20.254364] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-30T17:27:21.054329] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-30T17:27:21.207024] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T17:27:21.854417] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-30T17:27:22.562583] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T17:27:22.654410] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-30T17:27:22.868294] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T17:27:23.454422] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-30T17:27:24.254331] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-30T17:27:24.295476] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T17:27:24.330119] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T17:27:24.334877] [INFO ] [REMOTE ] BBN: Full fetch complete (26660 records). [2025-09-30T17:27:24.335020] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-30T17:27:24.731538] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-30T17:27:24.731621] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-30T17:27:24.732046] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-30T17:27:24.732103] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-30T17:27:24.732856] [DEBUG] [LOCAL ] BBN: Trimmed 26660 records to 18034 (keeping 200 days of data) [2025-09-30T17:27:24.845783] [DEBUG] [LOCAL ] BBN: Primary data saved (18034 records). [2025-09-30T17:27:24.845944] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-30T17:27:24.846037] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBN took 32.2s. Estimated remaining: 4h 22m 11s. Rate: 8.2 symbols/min [2025-09-30T17:27:25.031488] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:25.039194] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T17:27:25.056466] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-30T17:27:25.071023] [DEBUG] [LOCAL ] BBW: Loaded 26648 existing records from primary storage. [2025-09-30T17:27:25.071348] [INFO ] [MAIN ] BBW: Loaded 26648 existing records. [2025-09-30T17:27:25.259929] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:27:25.260170] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-30T17:27:25.260253] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-30T17:27:25.260688] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-30T17:27:25.260747] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-30T17:27:25.654151] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:25.730685] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T17:27:25.854384] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-30T17:27:26.654399] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-30T17:27:26.846246] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:27:27.454387] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-30T17:27:28.159468] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T17:27:28.254362] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-30T17:27:28.772892] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T17:27:28.982527] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T17:27:29.054407] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-30T17:27:29.679195] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-30T17:27:29.854381] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-30T17:27:30.654379] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-30T17:27:30.746768] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T17:27:31.454341] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-30T17:27:31.524434] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T17:27:31.526856] [INFO ] [REMOTE ] BBU: Full fetch complete (6580 records). [2025-09-30T17:27:31.526930] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-30T17:27:31.932720] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-30T17:27:31.932809] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-30T17:27:31.933006] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-30T17:27:31.933070] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-30T17:27:31.933510] [DEBUG] [LOCAL ] BBU: Trimmed 6580 records to 4648 (keeping 200 days of data) [2025-09-30T17:27:31.963482] [DEBUG] [LOCAL ] BBU: Primary data saved (4648 records). [2025-09-30T17:27:31.963634] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-30T17:27:31.963763] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBU took 24.8s. Estimated remaining: 4h 22m 2s. Rate: 8.2 symbols/min [2025-09-30T17:27:32.151029] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:32.207192] [DEBUG] [LOCAL ] BBWI: Loaded 53580 existing records from primary storage. [2025-09-30T17:27:32.207600] [INFO ] [MAIN ] BBWI: Loaded 53580 existing records. [2025-09-30T17:27:32.259517] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-30T17:27:32.410134] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:27:32.410377] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-30T17:27:32.410434] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-30T17:27:32.410957] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-30T17:27:32.411018] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-30T17:27:32.763532] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T17:27:32.834938] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:33.054383] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-30T17:27:33.854367] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-30T17:27:33.914046] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:27:34.112194] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T17:27:34.116179] [INFO ] [REMOTE ] BBUC: Full fetch complete (17930 records). [2025-09-30T17:27:34.116271] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-30T17:27:34.517752] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-30T17:27:34.517839] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-30T17:27:34.518197] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-30T17:27:34.518274] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-30T17:27:34.518942] [DEBUG] [LOCAL ] BBUC: Trimmed 17930 records to 13313 (keeping 200 days of data) [2025-09-30T17:27:34.607158] [DEBUG] [LOCAL ] BBUC: Primary data saved (13313 records). [2025-09-30T17:27:34.607306] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-30T17:27:34.607383] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBUC took 26.6s. Estimated remaining: 4h 21m 10s. Rate: 8.2 symbols/min [2025-09-30T17:27:34.665165] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-30T17:27:34.796231] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:34.850432] [DEBUG] [LOCAL ] BBY: Loaded 53470 existing records from primary storage. [2025-09-30T17:27:34.850846] [INFO ] [MAIN ] BBY: Loaded 53470 existing records. [2025-09-30T17:27:35.053527] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:27:35.053924] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-30T17:27:35.054033] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-30T17:27:35.060518] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-30T17:27:35.071337] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-30T17:27:35.077117] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T17:27:35.480865] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-30T17:27:35.486964] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:36.254352] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-30T17:27:36.709047] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-30T17:27:36.744074] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-30T17:27:37.054374] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-30T17:27:37.577821] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T17:27:37.854369] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-30T17:27:38.112354] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T17:27:38.654364] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-30T17:27:39.454372] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-30T17:27:39.667607] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T17:27:40.254328] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-30T17:27:40.390289] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T17:27:40.442404] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:27:41.054370] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-30T17:27:41.854360] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-30T17:27:41.993468] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T17:27:42.655370] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-30T17:27:42.673510] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T17:27:42.734997] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T17:27:43.454365] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-30T17:27:44.254364] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-30T17:27:44.429500] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T17:27:45.054360] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-30T17:27:45.174496] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T17:27:45.302431] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T17:27:45.854374] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-30T17:27:46.442144] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T17:27:46.654416] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-30T17:27:47.207207] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T17:27:47.454395] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-30T17:27:48.155280] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T17:27:48.254351] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-30T17:27:48.514460] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T17:27:49.054369] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-30T17:27:49.758057] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T17:27:49.854344] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-30T17:27:50.654351] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-30T17:27:50.745832] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T17:27:50.756548] [INFO ] [REMOTE ] BBVA: Full fetch complete (71583 records). [2025-09-30T17:27:50.756721] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-30T17:27:51.172115] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-30T17:27:51.172207] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-30T17:27:51.172945] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-30T17:27:51.173011] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-30T17:27:51.174422] [DEBUG] [LOCAL ] BBVA: Trimmed 71583 records to 49310 (keeping 200 days of data) [2025-09-30T17:27:51.462251] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-30T17:27:51.501335] [DEBUG] [LOCAL ] BBVA: Primary data saved (49310 records). [2025-09-30T17:27:51.501543] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-30T17:27:51.502827] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBVA took 42.0s. Estimated remaining: 4h 22m 33s. Rate: 8.2 symbols/min [2025-09-30T17:27:51.726175] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:51.764113] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T17:27:51.817537] [DEBUG] [LOCAL ] BC: Loaded 44259 existing records from primary storage. [2025-09-30T17:27:51.817914] [INFO ] [MAIN ] BC: Loaded 44259 existing records. [2025-09-30T17:27:52.014403] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:27:52.014663] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-30T17:27:52.014725] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-30T17:27:52.015093] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-30T17:27:52.015153] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-30T17:27:52.259261] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-30T17:27:52.417453] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:52.453026] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T17:27:52.737226] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T17:27:52.744933] [INFO ] [REMOTE ] BBW: Full fetch complete (39116 records). [2025-09-30T17:27:52.745075] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-30T17:27:53.059519] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-30T17:27:53.152410] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-30T17:27:53.152490] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-30T17:27:53.153053] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-30T17:27:53.153143] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-30T17:27:53.154209] [DEBUG] [LOCAL ] BBW: Trimmed 39116 records to 26640 (keeping 200 days of data) [2025-09-30T17:27:53.325019] [DEBUG] [LOCAL ] BBW: Primary data saved (26640 records). [2025-09-30T17:27:53.325157] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-30T17:27:53.325243] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBW took 28.5s. Estimated remaining: 4h 21m 34s. Rate: 8.2 symbols/min [2025-09-30T17:27:53.512069] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:27:53.512321] [DEBUG] [LOCAL ] BCAT: No existing data file found in primary storage. [2025-09-30T17:27:53.512390] [WARN ] [MAIN ] BCAT: No existing data found, performing full refresh instead. [2025-09-30T17:27:53.512531] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-30T17:27:53.512588] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-30T17:27:53.512683] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-09-30T17:27:53.512751] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-30T17:27:53.856895] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-30T17:27:53.947020] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:27:54.060222] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:27:54.654367] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-30T17:27:54.691707] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:27:55.314965] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T17:27:55.454363] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-30T17:27:56.135188] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T17:27:56.254375] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-30T17:27:57.054335] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-30T17:27:57.214548] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T17:27:57.344496] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T17:27:57.854359] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-30T17:27:58.252602] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T17:27:58.654369] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-30T17:27:59.359922] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T17:27:59.454380] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-30T17:28:00.078210] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T17:28:00.254384] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-30T17:28:00.986945] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T17:28:01.054382] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-30T17:28:01.863614] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-30T17:28:01.869475] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T17:28:02.654369] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-30T17:28:02.753625] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:28:03.196002] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T17:28:03.454384] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-30T17:28:04.121287] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T17:28:04.254439] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-30T17:28:04.984884] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T17:28:05.054388] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-30T17:28:05.849755] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T17:28:05.860063] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-30T17:28:06.654436] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-30T17:28:07.001798] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:28:07.013966] [INFO ] [REMOTE ] BBY: Full fetch complete (77239 records). [2025-09-30T17:28:07.014198] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-30T17:28:07.354692] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T17:28:07.459582] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-30T17:28:07.516038] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-30T17:28:07.516169] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-30T17:28:07.517247] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-30T17:28:07.517323] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-30T17:28:07.519723] [DEBUG] [LOCAL ] BBY: Trimmed 77239 records to 53467 (keeping 200 days of data) [2025-09-30T17:28:07.929098] [DEBUG] [LOCAL ] BBY: Primary data saved (53467 records). [2025-09-30T17:28:07.929274] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-30T17:28:07.929422] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBY took 33.3s. Estimated remaining: 4h 22m 35s. Rate: 8.2 symbols/min [2025-09-30T17:28:08.195487] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:08.234710] [DEBUG] [LOCAL ] BCC: Loaded 28242 existing records from primary storage. [2025-09-30T17:28:08.235125] [INFO ] [MAIN ] BCC: Loaded 28242 existing records. [2025-09-30T17:28:08.262373] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-30T17:28:08.452636] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:08.453138] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-30T17:28:08.453305] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-30T17:28:08.453794] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-30T17:28:08.453912] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-30T17:28:08.807129] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T17:28:08.882786] [INFO ] [REMOTE ] BBWI: Full fetch complete (77415 records). [2025-09-30T17:28:08.942701] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:08.942962] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-30T17:28:09.060245] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-30T17:28:09.197709] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T17:28:09.466087] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-30T17:28:09.466291] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-30T17:28:09.467286] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-30T17:28:09.467367] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-30T17:28:09.469047] [DEBUG] [LOCAL ] BBWI: Trimmed 77415 records to 53580 (keeping 200 days of data) [2025-09-30T17:28:09.748058] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:28:09.857228] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-30T17:28:09.859588] [DEBUG] [LOCAL ] BBWI: Primary data saved (53580 records). [2025-09-30T17:28:09.860781] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-30T17:28:09.862045] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BBWI took 37.9s. Estimated remaining: 4h 21m 37s. Rate: 8.2 symbols/min [2025-09-30T17:28:10.060135] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:10.118298] [DEBUG] [LOCAL ] BCE: Loaded 52283 existing records from primary storage. [2025-09-30T17:28:10.118821] [INFO ] [MAIN ] BCE: Loaded 52283 existing records. [2025-09-30T17:28:10.323149] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:10.323543] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-30T17:28:10.323742] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-30T17:28:10.324268] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-30T17:28:10.324329] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-30T17:28:10.665251] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-30T17:28:10.700480] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T17:28:10.775385] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:11.378282] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T17:28:11.454397] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-30T17:28:11.800339] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T17:28:12.254435] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-30T17:28:12.417810] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T17:28:13.054385] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-30T17:28:13.490252] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T17:28:13.854380] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-30T17:28:14.543809] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:28:14.654362] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-30T17:28:15.454434] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-30T17:28:15.575174] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T17:28:15.588439] [INFO ] [REMOTE ] BC: Full fetch complete (63820 records). [2025-09-30T17:28:15.589001] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-30T17:28:16.110570] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T17:28:16.202333] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-30T17:28:16.202430] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-30T17:28:16.203179] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-30T17:28:16.203254] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-30T17:28:16.204836] [DEBUG] [LOCAL ] BC: Trimmed 63820 records to 44228 (keeping 200 days of data) [2025-09-30T17:28:16.263492] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-30T17:28:16.490773] [DEBUG] [LOCAL ] BC: Primary data saved (44228 records). [2025-09-30T17:28:16.490917] [INFO ] [MAIN ] BC: Full history saved. [2025-09-30T17:28:16.494470] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BC took 25.0s. Estimated remaining: 4h 21m 23s. Rate: 8.2 symbols/min [2025-09-30T17:28:16.714247] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:16.752812] [DEBUG] [LOCAL ] BCH: Loaded 29497 existing records from primary storage. [2025-09-30T17:28:16.753200] [INFO ] [MAIN ] BCH: Loaded 29497 existing records. [2025-09-30T17:28:16.943156] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:16.943407] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-30T17:28:16.943458] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-30T17:28:16.943691] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-30T17:28:16.943769] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-30T17:28:17.059933] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-30T17:28:17.342783] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:17.366837] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T17:28:17.409560] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T17:28:17.854413] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-30T17:28:18.467575] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T17:28:18.654389] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-30T17:28:18.826851] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T17:28:19.454393] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-30T17:28:20.254365] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-30T17:28:20.415103] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T17:28:20.780835] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T17:28:21.054407] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-30T17:28:21.624889] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T17:28:21.854399] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-30T17:28:22.162789] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:28:22.654416] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-30T17:28:23.119536] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T17:28:23.454384] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-30T17:28:24.079283] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T17:28:24.254386] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-30T17:28:24.492301] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T17:28:25.054333] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-30T17:28:25.229101] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-30T17:28:25.854329] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-30T17:28:26.085426] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T17:28:26.654378] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-30T17:28:27.453540] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T17:28:27.461181] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-30T17:28:27.463225] [INFO ] [REMOTE ] BCAT: Full fetch complete (50066 records). [2025-09-30T17:28:27.463350] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-30T17:28:27.952629] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-30T17:28:27.952763] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-30T17:28:27.953493] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-30T17:28:27.953636] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-30T17:28:27.981948] [DEBUG] [LOCAL ] BCAT: Trimmed 50066 records to 34276 (keeping 200 days of data) [2025-09-30T17:28:27.983549] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T17:28:28.219304] [DEBUG] [LOCAL ] BCAT: Primary data saved (34276 records). [2025-09-30T17:28:28.219480] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-30T17:28:28.219576] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCAT took 34.9s. Estimated remaining: 4h 21m 56s. Rate: 8.2 symbols/min [2025-09-30T17:28:28.259464] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-30T17:28:28.429482] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:28.461067] [DEBUG] [LOCAL ] BCO: Loaded 26212 existing records from primary storage. [2025-09-30T17:28:28.461400] [INFO ] [MAIN ] BCO: Loaded 26212 existing records. [2025-09-30T17:28:28.683279] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:28.683565] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-30T17:28:28.683625] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-30T17:28:28.683943] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-30T17:28:28.684005] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-30T17:28:29.064209] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-30T17:28:29.112728] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:29.149089] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T17:28:29.683920] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T17:28:29.854385] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-30T17:28:30.167285] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T17:28:30.176449] [INFO ] [REMOTE ] BCC: Full fetch complete (40507 records). [2025-09-30T17:28:30.176602] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-30T17:28:30.576592] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-30T17:28:30.576745] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-30T17:28:30.577302] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-30T17:28:30.577378] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-30T17:28:30.580211] [DEBUG] [LOCAL ] BCC: Trimmed 40507 records to 28207 (keeping 200 days of data) [2025-09-30T17:28:30.677834] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-30T17:28:30.771158] [DEBUG] [LOCAL ] BCC: Primary data saved (28207 records). [2025-09-30T17:28:30.771303] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-30T17:28:30.771387] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCC took 22.8s. Estimated remaining: 4h 21m 5s. Rate: 8.2 symbols/min [2025-09-30T17:28:30.990495] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:31.047077] [DEBUG] [LOCAL ] BCS: Loaded 53457 existing records from primary storage. [2025-09-30T17:28:31.047456] [INFO ] [MAIN ] BCS: Loaded 53457 existing records. [2025-09-30T17:28:31.261740] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:31.262025] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-30T17:28:31.262111] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-30T17:28:31.262752] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-30T17:28:31.262835] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-30T17:28:31.458886] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-30T17:28:31.679174] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:31.729697] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T17:28:31.730194] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T17:28:32.254374] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-30T17:28:32.948220] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T17:28:33.054398] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-30T17:28:33.312548] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T17:28:33.854385] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-30T17:28:34.654351] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-30T17:28:34.906276] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T17:28:34.972417] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T17:28:35.454355] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-30T17:28:36.080436] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T17:28:36.254372] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-30T17:28:36.898160] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T17:28:37.054409] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-30T17:28:37.854386] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-30T17:28:38.144066] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T17:28:38.171584] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T17:28:38.654373] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-30T17:28:39.454397] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-30T17:28:39.613087] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T17:28:40.213694] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T17:28:40.254373] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-30T17:28:40.781565] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T17:28:41.054371] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-30T17:28:41.854346] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-30T17:28:42.034069] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T17:28:42.527709] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T17:28:42.654412] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-30T17:28:42.907308] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T17:28:43.454415] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-30T17:28:44.105832] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T17:28:44.254345] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-30T17:28:44.646307] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T17:28:45.054417] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-30T17:28:45.854331] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-30T17:28:45.900035] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T17:28:46.500018] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T17:28:46.511389] [INFO ] [REMOTE ] BCE: Full fetch complete (76074 records). [2025-09-30T17:28:46.511532] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-30T17:28:46.666272] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-30T17:28:46.962333] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-30T17:28:46.962488] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-30T17:28:46.963423] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-30T17:28:46.963622] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-30T17:28:46.965487] [DEBUG] [LOCAL ] BCE: Trimmed 76074 records to 52277 (keeping 200 days of data) [2025-09-30T17:28:47.240753] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T17:28:47.333081] [DEBUG] [LOCAL ] BCE: Primary data saved (52277 records). [2025-09-30T17:28:47.333224] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-30T17:28:47.333923] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCE took 37.5s. Estimated remaining: 4h 22m 22s. Rate: 8.1 symbols/min [2025-09-30T17:28:47.459518] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-30T17:28:47.514115] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:47.547886] [DEBUG] [LOCAL ] BCSF: Loaded 27789 existing records from primary storage. [2025-09-30T17:28:47.548169] [INFO ] [MAIN ] BCSF: Loaded 27789 existing records. [2025-09-30T17:28:47.745042] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:47.745334] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-30T17:28:47.745386] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-30T17:28:47.745675] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-30T17:28:47.745737] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-30T17:28:48.148771] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:48.168638] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T17:28:48.175606] [INFO ] [REMOTE ] BCH: Full fetch complete (40855 records). [2025-09-30T17:28:48.175796] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-30T17:28:48.263435] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-30T17:28:48.591226] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-30T17:28:48.591334] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-30T17:28:48.591887] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-30T17:28:48.591986] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-30T17:28:48.593160] [DEBUG] [LOCAL ] BCH: Trimmed 40855 records to 29483 (keeping 200 days of data) [2025-09-30T17:28:48.772435] [DEBUG] [LOCAL ] BCH: Primary data saved (29483 records). [2025-09-30T17:28:48.772586] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-30T17:28:48.772707] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCH took 32.3s. Estimated remaining: 4h 21m 21s. Rate: 8.2 symbols/min [2025-09-30T17:28:48.981374] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:49.004925] [DEBUG] [LOCAL ] BCX: Loaded 21626 existing records from primary storage. [2025-09-30T17:28:49.005184] [INFO ] [MAIN ] BCX: Loaded 21626 existing records. [2025-09-30T17:28:49.069674] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-30T17:28:49.215005] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:49.215299] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-30T17:28:49.215350] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-30T17:28:49.215807] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-30T17:28:49.215872] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-30T17:28:49.632760] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:49.651965] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T17:28:49.690275] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-30T17:28:49.854392] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-30T17:28:50.312566] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T17:28:50.654397] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-30T17:28:51.454331] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-30T17:28:51.551933] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:28:51.651427] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T17:28:52.254337] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-30T17:28:52.347386] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T17:28:53.054379] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-30T17:28:53.334075] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T17:28:53.854393] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-30T17:28:54.016826] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T17:28:54.654396] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-30T17:28:55.024380] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T17:28:55.454408] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-30T17:28:55.704201] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-30T17:28:56.254345] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-30T17:28:56.319005] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T17:28:57.054344] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-30T17:28:57.305522] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T17:28:57.854577] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-30T17:28:58.255567] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T17:28:58.260959] [INFO ] [REMOTE ] BCO: Full fetch complete (36745 records). [2025-09-30T17:28:58.261089] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-30T17:28:58.659444] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-30T17:28:58.702286] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-30T17:28:58.702552] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-30T17:28:58.703159] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-30T17:28:58.703309] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-30T17:28:58.704618] [DEBUG] [LOCAL ] BCO: Trimmed 36745 records to 26127 (keeping 200 days of data) [2025-09-30T17:28:58.874895] [DEBUG] [LOCAL ] BCO: Primary data saved (26127 records). [2025-09-30T17:28:58.875031] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-30T17:28:58.875117] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCO took 30.7s. Estimated remaining: 4h 21m 38s. Rate: 8.2 symbols/min [2025-09-30T17:28:59.088210] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:28:59.089796] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T17:28:59.119445] [DEBUG] [LOCAL ] BDC: Loaded 24595 existing records from primary storage. [2025-09-30T17:28:59.119746] [INFO ] [MAIN ] BDC: Loaded 24595 existing records. [2025-09-30T17:28:59.304200] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:28:59.304458] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-30T17:28:59.304507] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-30T17:28:59.304871] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-30T17:28:59.304931] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-30T17:28:59.463254] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-30T17:28:59.706536] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:28:59.734140] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T17:29:00.254373] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-30T17:29:01.054364] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-30T17:29:01.424573] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T17:29:01.426378] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-30T17:29:01.854368] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-30T17:29:02.192012] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T17:29:02.654379] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-30T17:29:03.454376] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-30T17:29:03.602052] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T17:29:03.630634] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T17:29:04.254334] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-30T17:29:04.321308] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T17:29:05.054379] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-30T17:29:05.844073] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:29:05.855131] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-30T17:29:06.047181] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T17:29:06.654351] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-30T17:29:06.783038] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T17:29:07.454359] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-30T17:29:07.528592] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T17:29:08.254371] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-30T17:29:09.054344] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-30T17:29:09.168880] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T17:29:09.279489] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T17:29:09.290972] [INFO ] [REMOTE ] BCS: Full fetch complete (77302 records). [2025-09-30T17:29:09.291146] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-30T17:29:09.719173] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-30T17:29:09.719511] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-30T17:29:09.720443] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-30T17:29:09.720515] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-30T17:29:09.722273] [DEBUG] [LOCAL ] BCS: Trimmed 77302 records to 53457 (keeping 200 days of data) [2025-09-30T17:29:09.855449] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-30T17:29:10.069469] [DEBUG] [LOCAL ] BCS: Primary data saved (53457 records). [2025-09-30T17:29:10.069679] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-30T17:29:10.069815] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCS took 39.3s. Estimated remaining: 4h 22m 6s. Rate: 8.1 symbols/min [2025-09-30T17:29:10.169282] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:29:10.654380] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-30T17:29:10.720620] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T17:29:11.454381] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-30T17:29:11.695771] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T17:29:12.254393] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-30T17:29:12.412232] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-30T17:29:12.417024] [INFO ] [REMOTE ] BCX: Full fetch complete (33896 records). [2025-09-30T17:29:12.417132] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-30T17:29:12.836334] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-30T17:29:12.836426] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-30T17:29:12.836884] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-30T17:29:12.836985] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-30T17:29:12.838011] [DEBUG] [LOCAL ] BCX: Trimmed 33896 records to 21589 (keeping 200 days of data) [2025-09-30T17:29:12.975947] [DEBUG] [LOCAL ] BCX: Primary data saved (21589 records). [2025-09-30T17:29:12.976091] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-30T17:29:12.976178] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCX took 24.2s. Estimated remaining: 4h 21m 18s. Rate: 8.2 symbols/min [2025-09-30T17:29:13.054408] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-30T17:29:13.381192] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T17:29:13.854431] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-30T17:29:14.261268] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T17:29:14.654394] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-30T17:29:15.146012] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T17:29:15.454388] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-30T17:29:15.799135] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T17:29:16.254349] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-30T17:29:16.346537] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T17:29:17.054397] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-30T17:29:18.153409] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T17:29:18.162459] [INFO ] [REMOTE ] BCSF: Full fetch complete (38315 records). [2025-09-30T17:29:18.162631] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-30T17:29:18.582770] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-30T17:29:18.582875] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-30T17:29:18.583419] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-30T17:29:18.583513] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-30T17:29:18.585847] [DEBUG] [LOCAL ] BCSF: Trimmed 38315 records to 27698 (keeping 200 days of data) [2025-09-30T17:29:18.773463] [DEBUG] [LOCAL ] BCSF: Primary data saved (27698 records). [2025-09-30T17:29:18.773632] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-30T17:29:18.774336] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCSF took 31.4s. Estimated remaining: 4h 20m 57s. Rate: 8.2 symbols/min [2025-09-30T17:29:19.235868] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-30T17:29:19.241552] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-30T17:29:20.798967] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T17:29:20.805219] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-30T17:29:21.721437] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T17:29:21.727346] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-30T17:29:22.730023] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T17:29:22.735611] [INFO ] [REMOTE ] BDC: Full fetch complete (35830 records). [2025-09-30T17:29:22.735772] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-30T17:29:23.176194] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-30T17:29:23.176303] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-30T17:29:23.176889] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-30T17:29:23.176959] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-30T17:29:23.178129] [DEBUG] [LOCAL ] BDC: Trimmed 35830 records to 24593 (keeping 200 days of data) [2025-09-30T17:29:23.335760] [DEBUG] [LOCAL ] BDC: Primary data saved (24593 records). [2025-09-30T17:29:23.335893] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-30T17:29:23.335978] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 24.5s. Estimated remaining: 4h 20m 25s. Rate: 8.2 symbols/min [2025-09-30T17:29:24.011121] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:24.069170] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:24.106936] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:24.162092] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:24.187361] [DEBUG] [LOCAL ] BDJ: Loaded 28915 existing records from primary storage. [2025-09-30T17:29:24.187888] [INFO ] [MAIN ] BDJ: Loaded 28915 existing records. [2025-09-30T17:29:24.430299] [DEBUG] [LOCAL ] BDN: Loaded 47512 existing records from primary storage. [2025-09-30T17:29:24.488748] [INFO ] [MAIN ] BDN: Loaded 47512 existing records. [2025-09-30T17:29:24.596230] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-09-30T17:29:24.595323] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:29:24.629875] [DEBUG] [LOCAL ] BDX: Loaded 52378 existing records from primary storage. [2025-09-30T17:29:24.635729] [INFO ] [MAIN ] BDX: Loaded 52378 existing records. [2025-09-30T17:29:24.635839] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-30T17:29:24.635231] [INFO ] [MAIN ] BE: Loaded 53653 existing records. [2025-09-30T17:29:24.652432] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-30T17:29:24.705283] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-30T17:29:24.843913] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-30T17:29:25.101694] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:29:25.223270] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-30T17:29:25.263857] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-30T17:29:25.299835] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:29:25.371229] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-30T17:29:25.365828] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:29:25.371336] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-30T17:29:25.398516] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-30T17:29:25.398834] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-30T17:29:25.435363] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-30T17:29:25.447348] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-30T17:29:25.447714] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-30T17:29:25.461906] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-30T17:29:25.476561] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-30T17:29:25.528703] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-30T17:29:26.512458] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:26.638053] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-30T17:29:27.129784] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:27.197157] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:27.197893] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-30T17:29:27.232920] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-30T17:29:27.277911] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:27.278255] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-30T17:29:27.934845] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T17:29:27.942034] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-30T17:29:30.132564] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-09-30T17:29:30.144257] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-30T17:29:30.303165] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (3.07 seconds). [2025-09-30T17:29:30.315815] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-30T17:29:30.318988] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-30T17:29:30.326800] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-30T17:29:30.384584] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-30T17:29:30.396012] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-30T17:29:31.239961] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T17:29:31.246359] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-30T17:29:31.811088] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T17:29:31.824231] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-30T17:29:31.906187] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T17:29:31.917851] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-30T17:29:32.150696] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T17:29:32.161276] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-30T17:29:32.447543] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T17:29:32.454329] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-30T17:29:33.190474] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T17:29:33.200686] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-30T17:29:33.509172] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T17:29:33.518940] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-30T17:29:33.664285] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T17:29:33.672849] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-30T17:29:33.779719] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-30T17:29:33.854360] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-30T17:29:34.565103] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:29:34.659808] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-30T17:29:34.673496] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T17:29:34.832677] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T17:29:35.454342] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-30T17:29:35.494317] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T17:29:36.151135] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-30T17:29:36.216539] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T17:29:36.254378] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-30T17:29:37.054406] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-30T17:29:37.325445] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T17:29:37.854364] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-30T17:29:38.408884] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T17:29:38.654363] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-30T17:29:38.729572] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T17:29:39.454360] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-30T17:29:40.254344] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-30T17:29:40.486705] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T17:29:40.878233] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T17:29:41.054359] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-30T17:29:41.115828] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T17:29:41.123361] [INFO ] [REMOTE ] BDJ: Full fetch complete (42936 records). [2025-09-30T17:29:41.123553] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-30T17:29:41.529633] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-30T17:29:41.529769] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-30T17:29:41.530268] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-30T17:29:41.530312] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-30T17:29:41.531428] [DEBUG] [LOCAL ] BDJ: Trimmed 42936 records to 28950 (keeping 200 days of data) [2025-09-30T17:29:41.712142] [DEBUG] [LOCAL ] BDJ: Primary data saved (28950 records). [2025-09-30T17:29:41.712293] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-30T17:29:41.712419] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 18.4s. Estimated remaining: 4h 21m 55s. Rate: 8.1 symbols/min [2025-09-30T17:29:41.869670] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-30T17:29:41.906675] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:41.906853] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-30T17:29:41.906894] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-30T17:29:41.907017] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-30T17:29:41.907093] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-30T17:29:41.907162] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-30T17:29:41.907198] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-30T17:29:42.297523] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:42.654385] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-30T17:29:42.706372] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:29:43.034063] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T17:29:43.048453] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-30T17:29:43.454363] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-30T17:29:44.254372] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-30T17:29:44.696916] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T17:29:45.054405] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-30T17:29:45.373696] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-30T17:29:45.854374] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-30T17:29:46.117768] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-30T17:29:46.261367] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T17:29:46.654369] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-30T17:29:47.454376] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-30T17:29:47.859969] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T17:29:48.254374] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-30T17:29:48.669926] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-30T17:29:48.953972] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T17:29:49.054382] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-30T17:29:49.854373] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-30T17:29:50.654351] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-30T17:29:50.776775] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T17:29:50.993823] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-30T17:29:51.440249] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:29:51.454316] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-30T17:29:52.254359] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-30T17:29:52.584425] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-30T17:29:53.054322] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-30T17:29:53.249583] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T17:29:53.261008] [INFO ] [REMOTE ] BDN: Full fetch complete (69261 records). [2025-09-30T17:29:53.261156] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-30T17:29:53.705160] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-30T17:29:53.705255] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-30T17:29:53.706074] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-30T17:29:53.706146] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-30T17:29:53.707717] [DEBUG] [LOCAL ] BDN: Trimmed 69261 records to 47511 (keeping 200 days of data) [2025-09-30T17:29:53.854597] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-30T17:29:54.028061] [DEBUG] [LOCAL ] BDN: Primary data saved (47511 records). [2025-09-30T17:29:54.028218] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-30T17:29:54.028308] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDN took 30.7s. Estimated remaining: 4h 22m 31s. Rate: 8.1 symbols/min [2025-09-30T17:29:54.213314] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:54.268144] [DEBUG] [LOCAL ] BEKE: Loaded 53241 existing records from primary storage. [2025-09-30T17:29:54.268573] [INFO ] [MAIN ] BEKE: Loaded 53241 existing records. [2025-09-30T17:29:54.367358] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-30T17:29:54.463865] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:29:54.464103] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-30T17:29:54.464151] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-30T17:29:54.465632] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-30T17:29:54.465717] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-30T17:29:54.662134] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-30T17:29:54.850912] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:55.019301] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-30T17:29:55.383440] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-30T17:29:55.454384] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-30T17:29:55.844630] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-30T17:29:56.254355] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-30T17:29:56.629009] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-30T17:29:56.629897] [INFO ] [REMOTE ] BEDU: Full fetch complete (1453 records). [2025-09-30T17:29:56.629970] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-30T17:29:56.818980] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-30T17:29:56.819187] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:29:56.819259] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:29:56.819331] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-30T17:29:56.819418] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-30T17:29:56.819457] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-30T17:29:56.819523] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-30T17:29:56.819604] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BEDU took 15.1s. Estimated remaining: 4h 21m 44s. Rate: 8.1 symbols/min [2025-09-30T17:29:57.003629] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:29:57.059459] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-30T17:29:57.061936] [DEBUG] [LOCAL ] BEN: Loaded 53054 existing records from primary storage. [2025-09-30T17:29:57.062454] [INFO ] [MAIN ] BEN: Loaded 53054 existing records. [2025-09-30T17:29:57.270606] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:29:57.270865] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-30T17:29:57.270914] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-30T17:29:57.272405] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-30T17:29:57.272469] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-30T17:29:57.648857] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:29:57.854363] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-30T17:29:58.654364] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-30T17:29:58.818992] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T17:29:59.454340] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-30T17:29:59.924075] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T17:30:00.061774] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T17:30:00.254368] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-30T17:30:01.059467] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-30T17:30:01.074059] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T17:30:01.707809] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T17:30:01.854377] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-30T17:30:02.654365] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-30T17:30:03.178508] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T17:30:03.189855] [INFO ] [REMOTE ] BDX: Full fetch complete (75777 records). [2025-09-30T17:30:03.190031] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-30T17:30:03.459485] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-30T17:30:03.645944] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-30T17:30:03.646181] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-30T17:30:03.647136] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-30T17:30:03.647256] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-30T17:30:03.649048] [DEBUG] [LOCAL ] BDX: Trimmed 75777 records to 52372 (keeping 200 days of data) [2025-09-30T17:30:03.779754] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-30T17:30:04.055711] [DEBUG] [LOCAL ] BDX: Primary data saved (52372 records). [2025-09-30T17:30:04.055868] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-30T17:30:04.055959] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BDX took 40.7s. Estimated remaining: 4h 21m 35s. Rate: 8.1 symbols/min [2025-09-30T17:30:04.267475] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:04.263197] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-30T17:30:04.305396] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T17:30:04.352499] [DEBUG] [LOCAL ] BEP: Loaded 38575 existing records from primary storage. [2025-09-30T17:30:04.352876] [INFO ] [MAIN ] BEP: Loaded 38575 existing records. [2025-09-30T17:30:04.573159] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:04.573484] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-30T17:30:04.573547] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-30T17:30:04.574024] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-30T17:30:04.574093] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-30T17:30:04.994979] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:05.054387] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-30T17:30:05.854343] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-30T17:30:06.124449] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-30T17:30:06.136023] [INFO ] [REMOTE ] BE: Full fetch complete (77272 records). [2025-09-30T17:30:06.136200] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-30T17:30:06.137198] [FATAL] [VALIDATOR ] BE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:30:06.137304] [FATAL] [MAIN ] BE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:30:06.137355] [WARN ] [MAIN ] BE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:30:06.137446] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-30T17:30:06.137548] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-09-30T17:30:06.137827] [INFO ] [LOCAL ] BE: Starting deletion of derivative data. [2025-09-30T17:30:06.138232] [DEBUG] [LOCAL ] BE: Deleted derivative data file. [2025-09-30T17:30:06.138338] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BE took 42.8s. Estimated remaining: 4h 20m 42s. Rate: 8.2 symbols/min [2025-09-30T17:30:06.350906] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:06.379767] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T17:30:06.425567] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T17:30:06.480695] [DEBUG] [LOCAL ] BEPC: Loaded 46440 existing records from primary storage. [2025-09-30T17:30:06.481055] [INFO ] [MAIN ] BEPC: Loaded 46440 existing records. [2025-09-30T17:30:06.660765] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-30T17:30:06.699686] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:06.699951] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-30T17:30:06.700007] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-30T17:30:06.700773] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-30T17:30:06.700837] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-30T17:30:07.104389] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:07.179018] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T17:30:07.454431] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-30T17:30:08.017820] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T17:30:08.254425] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-30T17:30:09.054391] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-30T17:30:09.110787] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T17:30:09.854402] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-30T17:30:10.018877] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T17:30:10.292441] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T17:30:10.654364] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-30T17:30:11.454407] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-30T17:30:11.815122] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T17:30:12.066405] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-30T17:30:12.254376] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-30T17:30:12.835731] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T17:30:13.054358] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-30T17:30:13.447323] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T17:30:13.854383] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-30T17:30:14.654334] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-30T17:30:14.947150] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T17:30:15.135676] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T17:30:15.454368] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-30T17:30:16.072160] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T17:30:16.254401] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-30T17:30:17.054431] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-30T17:30:17.304121] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T17:30:17.579320] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T17:30:17.854408] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-30T17:30:18.629170] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T17:30:18.654452] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-30T17:30:19.454390] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-30T17:30:19.779386] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T17:30:20.177014] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T17:30:20.254370] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-30T17:30:20.638447] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T17:30:21.054377] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-30T17:30:21.624500] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:30:21.854383] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-30T17:30:22.364340] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T17:30:22.654358] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-30T17:30:23.042057] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-30T17:30:23.454391] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-30T17:30:24.254319] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-30T17:30:24.347159] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T17:30:25.055087] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-30T17:30:25.055011] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T17:30:25.311153] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T17:30:25.854357] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-30T17:30:26.654363] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-30T17:30:26.928662] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T17:30:27.454336] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-30T17:30:27.551540] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T17:30:27.570674] [INFO ] [REMOTE ] BEKE: Full fetch complete (77192 records). [2025-09-30T17:30:27.570931] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-30T17:30:27.992238] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T17:30:28.109952] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-30T17:30:28.110053] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-30T17:30:28.110865] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-30T17:30:28.110932] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-30T17:30:28.112430] [DEBUG] [LOCAL ] BEKE: Trimmed 77192 records to 53241 (keeping 200 days of data) [2025-09-30T17:30:28.295180] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-30T17:30:28.470384] [DEBUG] [LOCAL ] BEKE: Primary data saved (53241 records). [2025-09-30T17:30:28.470574] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-30T17:30:28.474087] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEKE took 34.4s. Estimated remaining: 4h 22m 44s. Rate: 8.1 symbols/min [2025-09-30T17:30:28.708131] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:28.708343] [DEBUG] [LOCAL ] BEPH: No existing data file found in primary storage. [2025-09-30T17:30:28.708422] [WARN ] [MAIN ] BEPH: No existing data found, performing full refresh instead. [2025-09-30T17:30:28.708559] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-30T17:30:28.708603] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-30T17:30:28.708672] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-09-30T17:30:28.708728] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-30T17:30:29.059407] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-30T17:30:29.143043] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:29.181889] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T17:30:29.863470] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-30T17:30:29.869274] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T17:30:29.879179] [INFO ] [REMOTE ] BEP: Full fetch complete (58361 records). [2025-09-30T17:30:29.879363] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-30T17:30:30.291629] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-30T17:30:30.291751] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-30T17:30:30.292453] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-30T17:30:30.292507] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-30T17:30:30.294762] [DEBUG] [LOCAL ] BEP: Trimmed 58361 records to 38613 (keeping 200 days of data) [2025-09-30T17:30:30.536465] [DEBUG] [LOCAL ] BEP: Primary data saved (38613 records). [2025-09-30T17:30:30.536675] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-30T17:30:30.538446] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEP took 26.5s. Estimated remaining: 4h 21m 50s. Rate: 8.1 symbols/min [2025-09-30T17:30:30.654328] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-30T17:30:30.671253] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-30T17:30:30.751635] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:30.765877] [DEBUG] [LOCAL ] BEPI: Loaded 3481 existing records from primary storage. [2025-09-30T17:30:30.766190] [INFO ] [MAIN ] BEPI: Loaded 3481 existing records. [2025-09-30T17:30:30.991413] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T17:30:30.997667] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:31.008069] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-30T17:30:31.008281] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-30T17:30:31.008913] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-30T17:30:31.008994] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-30T17:30:31.407944] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:31.454374] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-30T17:30:31.967266] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-30T17:30:32.138799] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T17:30:32.155404] [INFO ] [REMOTE ] BEN: Full fetch complete (76504 records). [2025-09-30T17:30:32.155607] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-30T17:30:32.156670] [FATAL] [VALIDATOR ] BEN: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:30:32.156763] [FATAL] [MAIN ] BEN: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:30:32.156808] [WARN ] [MAIN ] BEN: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:30:32.156848] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-30T17:30:32.156920] [DEBUG] [LOCAL ] BEN: No primary data file found to delete. [2025-09-30T17:30:32.156990] [INFO ] [LOCAL ] BEN: Starting deletion of derivative data. [2025-09-30T17:30:32.157265] [DEBUG] [LOCAL ] BEN: Deleted derivative data file. [2025-09-30T17:30:32.157421] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEN took 35.3s. Estimated remaining: 4h 20m 53s. Rate: 8.1 symbols/min [2025-09-30T17:30:32.259524] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-30T17:30:32.357610] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:32.363365] [DEBUG] [LOCAL ] BEPJ: Loaded 3138 existing records from primary storage. [2025-09-30T17:30:32.363581] [INFO ] [MAIN ] BEPJ: Loaded 3138 existing records. [2025-09-30T17:30:32.589570] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:32.589903] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-30T17:30:32.589965] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-30T17:30:32.590323] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-30T17:30:32.590391] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-30T17:30:32.884010] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T17:30:33.003288] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:33.054321] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-30T17:30:33.607421] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-30T17:30:33.854388] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-30T17:30:34.427690] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T17:30:34.654375] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-30T17:30:35.122790] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-30T17:30:35.454378] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-30T17:30:35.885287] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-30T17:30:36.254393] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-30T17:30:36.659291] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-30T17:30:37.054387] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-30T17:30:37.854401] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-30T17:30:38.243886] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T17:30:38.413465] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T17:30:38.654409] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-30T17:30:39.454426] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-30T17:30:40.124727] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-30T17:30:40.254392] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-30T17:30:40.344098] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T17:30:40.356384] [INFO ] [REMOTE ] BEPC: Full fetch complete (68466 records). [2025-09-30T17:30:40.356539] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-30T17:30:40.746585] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-30T17:30:40.790329] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-30T17:30:40.790433] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-30T17:30:40.791228] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-30T17:30:40.791296] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-30T17:30:40.792748] [DEBUG] [LOCAL ] BEPC: Trimmed 68466 records to 46429 (keeping 200 days of data) [2025-09-30T17:30:41.055141] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-30T17:30:41.100004] [DEBUG] [LOCAL ] BEPC: Primary data saved (46429 records). [2025-09-30T17:30:41.100196] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-30T17:30:41.100345] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPC took 35.0s. Estimated remaining: 4h 20m 59s. Rate: 8.1 symbols/min [2025-09-30T17:30:41.289440] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:41.324873] [DEBUG] [LOCAL ] BFAM: Loaded 33077 existing records from primary storage. [2025-09-30T17:30:41.325195] [INFO ] [MAIN ] BFAM: Loaded 33077 existing records. [2025-09-30T17:30:41.522942] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:41.523160] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-30T17:30:41.523208] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-30T17:30:41.524165] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-30T17:30:41.524267] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-30T17:30:41.619932] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T17:30:41.859531] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-30T17:30:41.945767] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:42.312827] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T17:30:42.654409] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-30T17:30:43.454390] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-30T17:30:43.866434] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:30:44.084391] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T17:30:44.254372] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-30T17:30:44.700328] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-30T17:30:45.054391] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-30T17:30:45.776041] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T17:30:45.854316] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-30T17:30:46.514109] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T17:30:46.654383] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-30T17:30:47.176409] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T17:30:47.454417] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-30T17:30:48.073585] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T17:30:48.254405] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-30T17:30:49.054423] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-30T17:30:49.405765] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T17:30:49.761068] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T17:30:49.762854] [INFO ] [REMOTE ] BEPH: Full fetch complete (7713 records). [2025-09-30T17:30:49.763029] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-30T17:30:49.859492] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-30T17:30:50.165631] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-30T17:30:50.165747] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-30T17:30:50.165974] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-30T17:30:50.166027] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-30T17:30:50.166591] [DEBUG] [LOCAL ] BEPH: Trimmed 7713 records to 5285 (keeping 200 days of data) [2025-09-30T17:30:50.200110] [DEBUG] [LOCAL ] BEPH: Primary data saved (5285 records). [2025-09-30T17:30:50.200248] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-30T17:30:50.200374] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPH took 21.7s. Estimated remaining: 4h 21m 7s. Rate: 8.1 symbols/min [2025-09-30T17:30:50.407122] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:50.461020] [DEBUG] [LOCAL ] BFH: Loaded 41647 existing records from primary storage. [2025-09-30T17:30:50.461319] [INFO ] [MAIN ] BFH: Loaded 41647 existing records. [2025-09-30T17:30:50.582832] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T17:30:50.658842] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-30T17:30:50.662923] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:50.664383] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-30T17:30:50.664456] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-30T17:30:50.666413] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-30T17:30:50.666483] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-30T17:30:51.053843] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:51.264192] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T17:30:51.454390] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-30T17:30:51.904168] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-30T17:30:52.254370] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-30T17:30:53.054392] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-30T17:30:53.503554] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T17:30:53.505455] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T17:30:53.854398] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-30T17:30:54.278740] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-30T17:30:54.279980] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4492 records). [2025-09-30T17:30:54.280054] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-30T17:30:54.661421] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-30T17:30:54.701528] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-30T17:30:54.701616] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-30T17:30:54.701805] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-30T17:30:54.701862] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-30T17:30:54.702299] [DEBUG] [LOCAL ] BEPJ: Trimmed 4492 records to 3144 (keeping 200 days of data) [2025-09-30T17:30:54.724390] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3144 records). [2025-09-30T17:30:54.724539] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-30T17:30:54.724624] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPJ took 22.6s. Estimated remaining: 4h 20m 35s. Rate: 8.1 symbols/min [2025-09-30T17:30:54.933324] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:30:54.949789] [DEBUG] [LOCAL ] BFK: Loaded 13908 existing records from primary storage. [2025-09-30T17:30:54.950032] [INFO ] [MAIN ] BFK: Loaded 13908 existing records. [2025-09-30T17:30:55.161350] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:30:55.161976] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-30T17:30:55.162073] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-30T17:30:55.162887] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-30T17:30:55.162959] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-30T17:30:55.459580] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-30T17:30:55.570947] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:30:56.137247] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T17:30:56.254368] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-30T17:30:56.981835] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T17:30:57.013978] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:30:57.054422] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-30T17:30:57.465764] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T17:30:57.854421] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-30T17:30:58.253269] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-30T17:30:58.654411] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-30T17:30:59.110509] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T17:30:59.454445] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-30T17:30:59.972777] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T17:30:59.973992] [INFO ] [REMOTE ] BEPI: Full fetch complete (5015 records). [2025-09-30T17:30:59.974091] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-30T17:31:00.259560] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-30T17:31:00.383104] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-30T17:31:00.383210] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-30T17:31:00.383402] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-30T17:31:00.383444] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-30T17:31:00.383861] [DEBUG] [LOCAL ] BEPI: Trimmed 5015 records to 3514 (keeping 200 days of data) [2025-09-30T17:31:00.405855] [DEBUG] [LOCAL ] BEPI: Primary data saved (3514 records). [2025-09-30T17:31:00.405973] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-30T17:31:00.406059] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BEPI took 29.9s. Estimated remaining: 4h 20m 13s. Rate: 8.1 symbols/min [2025-09-30T17:31:00.599660] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:31:00.670168] [DEBUG] [LOCAL ] BFLY: Loaded 51799 existing records from primary storage. [2025-09-30T17:31:00.670552] [INFO ] [MAIN ] BFLY: Loaded 51799 existing records. [2025-09-30T17:31:00.870975] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:31:00.871338] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-30T17:31:00.871398] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-30T17:31:00.873389] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-30T17:31:00.873453] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-30T17:31:01.056619] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-30T17:31:01.255807] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:31:01.391960] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T17:31:01.854439] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-30T17:31:02.244406] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T17:31:02.654361] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-30T17:31:03.304385] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T17:31:03.454400] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-30T17:31:03.485508] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:31:04.254354] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-30T17:31:04.537399] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:31:05.054359] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-30T17:31:05.854347] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-30T17:31:05.995073] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T17:31:06.032461] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T17:31:06.654383] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-30T17:31:06.959480] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T17:31:07.454359] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-30T17:31:08.254403] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-30T17:31:08.411145] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:31:08.446865] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:31:09.054424] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-30T17:31:09.508287] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T17:31:09.854392] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-30T17:31:10.565840] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T17:31:10.593234] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T17:31:10.654638] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-30T17:31:11.360014] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T17:31:11.454747] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-30T17:31:12.254360] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-30T17:31:12.923512] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T17:31:13.048888] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T17:31:13.054327] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-30T17:31:13.854372] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-30T17:31:14.111967] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T17:31:14.654402] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-30T17:31:15.352342] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T17:31:15.454353] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-30T17:31:16.134554] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T17:31:16.199413] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-30T17:31:16.254362] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-30T17:31:17.054356] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-30T17:31:17.214539] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T17:31:17.854389] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-30T17:31:18.654370] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-30T17:31:18.812307] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T17:31:18.872791] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T17:31:18.876779] [INFO ] [REMOTE ] BFK: Full fetch complete (19240 records). [2025-09-30T17:31:18.876866] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-30T17:31:19.297288] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-30T17:31:19.297608] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-30T17:31:19.298093] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-30T17:31:19.298163] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-30T17:31:19.299177] [DEBUG] [LOCAL ] BFK: Trimmed 19240 records to 13853 (keeping 200 days of data) [2025-09-30T17:31:19.390400] [DEBUG] [LOCAL ] BFK: Primary data saved (13853 records). [2025-09-30T17:31:19.390579] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-30T17:31:19.390706] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFK took 24.7s. Estimated remaining: 4h 21m 43s. Rate: 8.1 symbols/min [2025-09-30T17:31:19.460800] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-30T17:31:19.583094] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:31:19.583288] [DEBUG] [LOCAL ] BFS: No existing data file found in primary storage. [2025-09-30T17:31:19.583337] [WARN ] [MAIN ] BFS: No existing data found, performing full refresh instead. [2025-09-30T17:31:19.583473] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-30T17:31:19.583515] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-30T17:31:19.583557] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-09-30T17:31:19.583590] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-30T17:31:19.980210] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:31:20.251520] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T17:31:20.265080] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-30T17:31:20.756125] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T17:31:21.054370] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-30T17:31:21.482222] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T17:31:21.822907] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-30T17:31:21.854373] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-30T17:31:22.654374] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-30T17:31:23.330957] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T17:31:23.454367] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-30T17:31:23.739393] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:31:24.254355] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-30T17:31:25.054351] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-30T17:31:25.251479] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:31:25.706298] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T17:31:25.714961] [INFO ] [REMOTE ] BFH: Full fetch complete (59713 records). [2025-09-30T17:31:25.715135] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-30T17:31:25.859447] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-30T17:31:26.155164] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-30T17:31:26.155289] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-30T17:31:26.156014] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-30T17:31:26.156081] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-30T17:31:26.157405] [DEBUG] [LOCAL ] BFH: Trimmed 59713 records to 41617 (keeping 200 days of data) [2025-09-30T17:31:26.419989] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T17:31:26.435442] [INFO ] [REMOTE ] BFAM: Full fetch complete (46693 records). [2025-09-30T17:31:26.445808] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T17:31:26.445989] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-30T17:31:26.451462] [FATAL] [VALIDATOR ] BFAM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:31:26.453441] [FATAL] [MAIN ] BFAM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:31:26.455558] [WARN ] [MAIN ] BFAM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:31:26.457708] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-30T17:31:26.458873] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-09-30T17:31:26.460180] [INFO ] [LOCAL ] BFAM: Starting deletion of derivative data. [2025-09-30T17:31:26.461314] [DEBUG] [LOCAL ] BFAM: Deleted derivative data file. [2025-09-30T17:31:26.461995] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFAM took 45.4s. Estimated remaining: 4h 21m 33s. Rate: 8.1 symbols/min [2025-09-30T17:31:26.668064] [DEBUG] [LOCAL ] BFH: Primary data saved (41617 records). [2025-09-30T17:31:26.667962] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-30T17:31:26.669699] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-30T17:31:26.671980] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFH took 36.5s. Estimated remaining: 4h 20m 26s. Rate: 8.1 symbols/min [2025-09-30T17:31:26.694224] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:31:26.757073] [DEBUG] [LOCAL ] BFZ: No existing data file found in primary storage. [2025-09-30T17:31:26.785915] [WARN ] [MAIN ] BFZ: No existing data found, performing full refresh instead. [2025-09-30T17:31:26.813451] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-30T17:31:26.819252] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-30T17:31:26.834704] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-09-30T17:31:26.839897] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-30T17:31:26.980987] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:31:27.316563] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:31:27.332127] [DEBUG] [LOCAL ] BG: Loaded 50382 existing records from primary storage. [2025-09-30T17:31:27.332415] [INFO ] [MAIN ] BG: Loaded 50382 existing records. [2025-09-30T17:31:27.452339] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T17:31:27.463383] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-30T17:31:27.543155] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:31:27.543382] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-30T17:31:27.543435] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-30T17:31:27.545255] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-30T17:31:27.545321] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-30T17:31:27.934478] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:31:28.254445] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-30T17:31:28.999519] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T17:31:29.054410] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-30T17:31:29.827135] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-30T17:31:29.854333] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-30T17:31:29.955720] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T17:31:30.654411] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-30T17:31:31.454342] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-30T17:31:31.474488] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T17:31:31.703964] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T17:31:32.122949] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-30T17:31:32.254390] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-30T17:31:32.861385] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T17:31:33.054410] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-30T17:31:33.854372] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-30T17:31:34.513067] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-30T17:31:34.654374] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-30T17:31:34.999480] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-30T17:31:35.414478] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T17:31:35.454424] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-30T17:31:36.083548] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T17:31:36.254367] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-30T17:31:37.054398] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-30T17:31:37.821459] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T17:31:37.854332] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-30T17:31:37.974260] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T17:31:37.985278] [INFO ] [REMOTE ] BFLY: Full fetch complete (75245 records). [2025-09-30T17:31:37.985450] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-30T17:31:38.404089] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-30T17:31:38.404183] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-30T17:31:38.405091] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-30T17:31:38.405162] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-30T17:31:38.406766] [DEBUG] [LOCAL ] BFLY: Trimmed 75245 records to 51779 (keeping 200 days of data) [2025-09-30T17:31:38.671415] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-30T17:31:38.716147] [DEBUG] [LOCAL ] BFLY: Primary data saved (51779 records). [2025-09-30T17:31:38.716265] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-30T17:31:38.716947] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFLY took 38.3s. Estimated remaining: 4h 20m 57s. Rate: 8.1 symbols/min [2025-09-30T17:31:38.806389] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T17:31:38.915916] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:31:38.937424] [DEBUG] [LOCAL ] BGB: Loaded 17484 existing records from primary storage. [2025-09-30T17:31:38.937754] [INFO ] [MAIN ] BGB: Loaded 17484 existing records. [2025-09-30T17:31:39.135691] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:31:39.135950] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-30T17:31:39.136009] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-30T17:31:39.136629] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-30T17:31:39.136728] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-30T17:31:39.459473] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-30T17:31:39.519967] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:31:40.226322] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:31:40.254315] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-30T17:31:40.380525] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T17:31:40.383827] [INFO ] [REMOTE ] BFS: Full fetch complete (12654 records). [2025-09-30T17:31:40.383917] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-30T17:31:40.787252] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-30T17:31:40.787333] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-30T17:31:40.787634] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-30T17:31:40.787715] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-30T17:31:40.788194] [DEBUG] [LOCAL ] BFS: Trimmed 12654 records to 9115 (keeping 200 days of data) [2025-09-30T17:31:40.845553] [DEBUG] [LOCAL ] BFS: Primary data saved (9115 records). [2025-09-30T17:31:40.845724] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-30T17:31:40.845810] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFS took 21.5s. Estimated remaining: 4h 20m 6s. Rate: 8.1 symbols/min [2025-09-30T17:31:41.035371] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:31:41.054563] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-30T17:31:41.055036] [DEBUG] [LOCAL ] BGH: Loaded 16600 existing records from primary storage. [2025-09-30T17:31:41.056445] [INFO ] [MAIN ] BGH: Loaded 16600 existing records. [2025-09-30T17:31:41.252018] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:31:41.252245] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-30T17:31:41.252293] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-30T17:31:41.252919] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-30T17:31:41.252980] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-30T17:31:41.661894] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:31:41.724457] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T17:31:41.854376] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-30T17:31:41.980776] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T17:31:42.654407] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-30T17:31:42.949609] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T17:31:43.454329] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-30T17:31:43.733883] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:31:44.254405] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-30T17:31:44.272843] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T17:31:44.997470] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T17:31:45.054376] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-30T17:31:45.854423] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-30T17:31:46.314878] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-30T17:31:46.654361] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-30T17:31:46.703338] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T17:31:47.294529] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T17:31:47.454373] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-30T17:31:48.254372] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-30T17:31:48.427554] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T17:31:48.779432] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-30T17:31:49.054375] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-30T17:31:49.814167] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T17:31:49.854320] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-30T17:31:50.654410] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-30T17:31:51.258637] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T17:31:51.363293] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T17:31:51.454386] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-30T17:31:52.254361] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-30T17:31:53.030581] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T17:31:53.054317] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-30T17:31:53.072220] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T17:31:53.854392] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-30T17:31:54.639572] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T17:31:54.654362] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-30T17:31:54.948985] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T17:31:55.454395] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-30T17:31:55.505904] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T17:31:56.254360] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-30T17:31:56.288121] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T17:31:57.054396] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-30T17:31:57.505243] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T17:31:57.854478] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-30T17:31:58.595215] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T17:31:58.654378] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-30T17:31:58.844547] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:31:59.454382] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-30T17:32:00.188832] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T17:32:00.251905] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T17:32:00.255876] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-30T17:32:00.256935] [INFO ] [REMOTE ] BFZ: Full fetch complete (18103 records). [2025-09-30T17:32:00.257765] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-30T17:32:00.681194] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-30T17:32:00.681290] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-30T17:32:00.681638] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-30T17:32:00.681724] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-30T17:32:00.682364] [DEBUG] [LOCAL ] BFZ: Trimmed 18103 records to 12147 (keeping 200 days of data) [2025-09-30T17:32:00.764680] [DEBUG] [LOCAL ] BFZ: Primary data saved (12147 records). [2025-09-30T17:32:00.764846] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-30T17:32:00.764929] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFZ took 34.3s. Estimated remaining: 4h 21m 41s. Rate: 8.1 symbols/min [2025-09-30T17:32:00.967200] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:00.982595] [DEBUG] [LOCAL ] BGR: Loaded 13477 existing records from primary storage. [2025-09-30T17:32:00.982823] [INFO ] [MAIN ] BGR: Loaded 13477 existing records. [2025-09-30T17:32:01.059587] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-30T17:32:01.187956] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:32:01.188191] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-30T17:32:01.188248] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-30T17:32:01.188993] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-30T17:32:01.189089] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-30T17:32:01.606879] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:01.758520] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-30T17:32:01.854423] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-30T17:32:02.341256] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T17:32:02.352936] [INFO ] [REMOTE ] BG: Full fetch complete (72778 records). [2025-09-30T17:32:02.353103] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-30T17:32:02.503776] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-30T17:32:02.664148] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-30T17:32:02.811944] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-30T17:32:02.812031] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-30T17:32:02.812901] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-30T17:32:02.812977] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-30T17:32:02.814488] [DEBUG] [LOCAL ] BG: Trimmed 72778 records to 50409 (keeping 200 days of data) [2025-09-30T17:32:03.147836] [DEBUG] [LOCAL ] BG: Primary data saved (50409 records). [2025-09-30T17:32:03.147986] [INFO ] [MAIN ] BG: Full history saved. [2025-09-30T17:32:03.149543] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BG took 36.5s. Estimated remaining: 4h 20m 53s. Rate: 8.1 symbols/min [2025-09-30T17:32:03.354323] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:03.374582] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T17:32:03.440931] [DEBUG] [LOCAL ] BGS: Loaded 50439 existing records from primary storage. [2025-09-30T17:32:03.441400] [INFO ] [MAIN ] BGS: Loaded 50439 existing records. [2025-09-30T17:32:03.459725] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-30T17:32:03.738941] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:32:03.739201] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-30T17:32:03.739283] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-30T17:32:03.741224] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-30T17:32:03.741322] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-30T17:32:04.259730] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-30T17:32:04.387149] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:04.495513] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T17:32:05.006127] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-30T17:32:05.054412] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-30T17:32:05.854369] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-30T17:32:06.195089] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T17:32:06.199389] [INFO ] [REMOTE ] BGH: Full fetch complete (22215 records). [2025-09-30T17:32:06.199494] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-30T17:32:06.592383] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-30T17:32:06.592481] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-30T17:32:06.592865] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-30T17:32:06.592927] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-30T17:32:06.593587] [DEBUG] [LOCAL ] BGH: Trimmed 22215 records to 16746 (keeping 200 days of data) [2025-09-30T17:32:06.654923] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-30T17:32:06.715969] [DEBUG] [LOCAL ] BGH: Primary data saved (16746 records). [2025-09-30T17:32:06.716157] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-30T17:32:06.716266] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BGH took 25.9s. Estimated remaining: 4h 20m 14s. Rate: 8.1 symbols/min [2025-09-30T17:32:06.907934] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:06.908128] [DEBUG] [LOCAL ] BGSF: No existing data file found in primary storage. [2025-09-30T17:32:06.908175] [WARN ] [MAIN ] BGSF: No existing data found, performing full refresh instead. [2025-09-30T17:32:06.908296] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-30T17:32:06.908339] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-30T17:32:06.908433] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-09-30T17:32:06.908472] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-30T17:32:07.301576] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:07.345310] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T17:32:07.454327] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-30T17:32:07.842893] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-30T17:32:07.930842] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-30T17:32:08.254380] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-30T17:32:09.054383] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-30T17:32:09.849021] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T17:32:09.854299] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-30T17:32:09.967514] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:32:10.424544] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-30T17:32:10.654376] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-30T17:32:11.454379] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-30T17:32:11.485598] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T17:32:11.489350] [INFO ] [REMOTE ] BGB: Full fetch complete (26795 records). [2025-09-30T17:32:11.489497] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-30T17:32:11.490058] [FATAL] [VALIDATOR ] BGB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:32:11.490148] [FATAL] [MAIN ] BGB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:32:11.490192] [WARN ] [MAIN ] BGB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:32:11.490252] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-30T17:32:11.490369] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-09-30T17:32:11.490409] [INFO ] [LOCAL ] BGB: Starting deletion of derivative data. [2025-09-30T17:32:11.490774] [DEBUG] [LOCAL ] BGB: Deleted derivative data file. [2025-09-30T17:32:11.490873] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGB took 32.8s. Estimated remaining: 4h 19m 46s. Rate: 8.1 symbols/min [2025-09-30T17:32:11.690288] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:11.709532] [DEBUG] [LOCAL ] BGT: Loaded 16594 existing records from primary storage. [2025-09-30T17:32:11.709918] [INFO ] [MAIN ] BGT: Loaded 16594 existing records. [2025-09-30T17:32:11.925743] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:32:11.925966] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-30T17:32:11.926021] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-30T17:32:11.926265] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-30T17:32:11.926331] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-30T17:32:12.259534] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-30T17:32:12.329909] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:12.741403] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T17:32:13.054342] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-30T17:32:13.100265] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T17:32:13.362836] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-30T17:32:13.854397] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-30T17:32:14.654365] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-30T17:32:15.022554] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T17:32:15.454357] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-30T17:32:15.976157] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T17:32:16.254407] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-30T17:32:16.524731] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T17:32:16.976886] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T17:32:17.054380] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-30T17:32:17.803566] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T17:32:17.854347] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-30T17:32:18.654350] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-30T17:32:18.789784] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T17:32:19.454375] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-30T17:32:20.092817] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T17:32:20.197548] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T17:32:20.254383] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-30T17:32:20.885843] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-30T17:32:21.054358] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-30T17:32:21.854372] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-30T17:32:22.059414] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T17:32:22.659800] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-30T17:32:22.667337] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-30T17:32:23.454390] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-30T17:32:24.045705] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T17:32:24.254380] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-30T17:32:24.345238] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-30T17:32:24.942908] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-30T17:32:25.054389] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-30T17:32:25.854393] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-30T17:32:26.327632] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-30T17:32:26.531862] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T17:32:26.654412] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-30T17:32:27.118226] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-30T17:32:27.454376] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-30T17:32:28.254361] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-30T17:32:28.524008] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T17:32:29.054324] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-30T17:32:29.358800] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T17:32:29.854381] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-30T17:32:30.507514] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T17:32:30.654373] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-30T17:32:30.756154] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-30T17:32:31.407170] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-30T17:32:31.411273] [INFO ] [REMOTE ] BGT: Full fetch complete (24340 records). [2025-09-30T17:32:31.411374] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-30T17:32:31.459550] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-30T17:32:31.838806] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-30T17:32:31.838909] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-30T17:32:31.839281] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-30T17:32:31.839329] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-30T17:32:31.840061] [DEBUG] [LOCAL ] BGT: Trimmed 24340 records to 16599 (keeping 200 days of data) [2025-09-30T17:32:31.945884] [DEBUG] [LOCAL ] BGT: Primary data saved (16599 records). [2025-09-30T17:32:31.946032] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-30T17:32:31.946141] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGT took 20.5s. Estimated remaining: 4h 21m 23s. Rate: 8.1 symbols/min [2025-09-30T17:32:32.129157] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:32.142864] [DEBUG] [LOCAL ] BGX: Loaded 10834 existing records from primary storage. [2025-09-30T17:32:32.143065] [INFO ] [MAIN ] BGX: Loaded 10834 existing records. [2025-09-30T17:32:32.259465] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-30T17:32:32.334282] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:32:32.334558] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-30T17:32:32.334608] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-30T17:32:32.335376] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-30T17:32:32.335438] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-30T17:32:32.472901] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T17:32:32.758445] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:33.054371] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-30T17:32:33.854394] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-30T17:32:33.915064] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T17:32:33.977441] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T17:32:34.517430] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T17:32:34.654398] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-30T17:32:35.454388] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-30T17:32:35.491857] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T17:32:36.254368] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-30T17:32:36.319687] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T17:32:37.054391] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-30T17:32:37.615298] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T17:32:37.739811] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T17:32:37.854388] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-30T17:32:38.654418] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-30T17:32:39.454377] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-30T17:32:39.588991] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T17:32:39.608104] [INFO ] [REMOTE ] BGS: Full fetch complete (72496 records). [2025-09-30T17:32:39.609289] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-30T17:32:39.609101] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T17:32:40.044004] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-30T17:32:40.044105] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-30T17:32:40.044894] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-30T17:32:40.044977] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-30T17:32:40.048162] [DEBUG] [LOCAL ] BGS: Trimmed 72496 records to 50452 (keeping 200 days of data) [2025-09-30T17:32:40.264383] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-30T17:32:40.364556] [DEBUG] [LOCAL ] BGS: Primary data saved (50452 records). [2025-09-30T17:32:40.364741] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-30T17:32:40.367455] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGS took 37.2s. Estimated remaining: 4h 21m 24s. Rate: 8.1 symbols/min [2025-09-30T17:32:40.563137] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:40.576354] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T17:32:40.581912] [INFO ] [REMOTE ] BGSF: Full fetch complete (8546 records). [2025-09-30T17:32:40.582036] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-30T17:32:40.778899] [DEBUG] [LOCAL ] BGY: Loaded 22400 existing records from primary storage. [2025-09-30T17:32:40.839584] [INFO ] [MAIN ] BGY: Loaded 22400 existing records. [2025-09-30T17:32:41.055277] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-30T17:32:41.180715] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-30T17:32:41.180425] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T17:32:41.201883] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-30T17:32:41.221188] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-30T17:32:41.234922] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-30T17:32:41.261185] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:32:41.262460] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-30T17:32:41.262526] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-30T17:32:41.262820] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-30T17:32:41.263134] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-30T17:32:41.334103] [DEBUG] [LOCAL ] BGSF: Trimmed 8546 records to 7130 (keeping 200 days of data) [2025-09-30T17:32:41.621186] [DEBUG] [LOCAL ] BGSF: Primary data saved (7130 records). [2025-09-30T17:32:41.624026] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-30T17:32:41.629826] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGSF took 34.9s. Estimated remaining: 4h 20m 27s. Rate: 8.1 symbols/min [2025-09-30T17:32:41.803047] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:41.869828] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-30T17:32:41.905203] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:41.905417] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-09-30T17:32:41.905473] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-09-30T17:32:41.905620] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-30T17:32:41.905715] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-30T17:32:41.905848] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-09-30T17:32:41.905906] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-30T17:32:42.277144] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T17:32:42.313273] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:42.549420] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T17:32:42.654426] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-30T17:32:43.454380] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-30T17:32:43.524587] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T17:32:44.045565] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T17:32:44.254394] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-30T17:32:45.020666] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T17:32:45.054379] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-30T17:32:45.854388] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-30T17:32:45.943769] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T17:32:46.654354] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-30T17:32:46.849044] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T17:32:46.852857] [INFO ] [REMOTE ] BGR: Full fetch complete (20100 records). [2025-09-30T17:32:46.853000] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-30T17:32:46.853574] [FATAL] [VALIDATOR ] BGR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:32:46.853691] [FATAL] [MAIN ] BGR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:32:46.853775] [WARN ] [MAIN ] BGR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:32:46.853851] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-30T17:32:46.853917] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-09-30T17:32:46.853965] [INFO ] [LOCAL ] BGR: Starting deletion of derivative data. [2025-09-30T17:32:46.854252] [DEBUG] [LOCAL ] BGR: Deleted derivative data file. [2025-09-30T17:32:46.854344] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGR took 46.1s. Estimated remaining: 4h 20m 2s. Rate: 8.1 symbols/min [2025-09-30T17:32:47.046688] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:47.046904] [DEBUG] [LOCAL ] BHC: No existing data file found in primary storage. [2025-09-30T17:32:47.046970] [WARN ] [MAIN ] BHC: No existing data found, performing full refresh instead. [2025-09-30T17:32:47.047103] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-30T17:32:47.047146] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-30T17:32:47.047189] [DEBUG] [LOCAL ] BHC: No primary data file found to delete. [2025-09-30T17:32:47.047223] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-30T17:32:47.454424] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-30T17:32:47.457992] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:47.571463] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T17:32:48.254329] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-30T17:32:48.290848] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T17:32:49.054419] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-30T17:32:49.854388] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-30T17:32:49.864604] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T17:32:49.939431] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T17:32:50.654405] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-30T17:32:50.687935] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T17:32:51.454398] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-30T17:32:51.634707] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:32:51.982348] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T17:32:52.254413] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-30T17:32:53.054363] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-30T17:32:53.463518] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T17:32:53.495702] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T17:32:53.854355] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-30T17:32:54.654388] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-30T17:32:54.940607] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T17:32:55.454379] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-30T17:32:55.872199] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T17:32:56.254378] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-30T17:32:56.284548] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T17:32:56.288636] [INFO ] [REMOTE ] BGX: Full fetch complete (16008 records). [2025-09-30T17:32:56.288798] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-30T17:32:56.685905] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-30T17:32:56.686001] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-30T17:32:56.686330] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-30T17:32:56.686374] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-30T17:32:56.687715] [DEBUG] [LOCAL ] BGX: Trimmed 16008 records to 10830 (keeping 200 days of data) [2025-09-30T17:32:56.765432] [DEBUG] [LOCAL ] BGX: Primary data saved (10830 records). [2025-09-30T17:32:56.765611] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-30T17:32:56.765779] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGX took 24.8s. Estimated remaining: 4h 20m 15s. Rate: 8.1 symbols/min [2025-09-30T17:32:56.952790] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:32:56.952950] [DEBUG] [LOCAL ] BHE: No existing data file found in primary storage. [2025-09-30T17:32:56.952987] [WARN ] [MAIN ] BHE: No existing data found, performing full refresh instead. [2025-09-30T17:32:56.953096] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-30T17:32:56.953137] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-30T17:32:56.953178] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-09-30T17:32:56.953209] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-30T17:32:57.059521] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-30T17:32:57.117291] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-30T17:32:57.360964] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:32:57.854344] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-30T17:32:58.047079] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:32:58.654402] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-30T17:32:59.202713] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T17:32:59.261672] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T17:32:59.454437] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-30T17:33:00.254396] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-30T17:33:00.343103] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T17:33:01.054347] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-30T17:33:01.365186] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:33:01.834728] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T17:33:01.854322] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-30T17:33:02.654361] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-30T17:33:03.051582] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T17:33:03.454348] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-30T17:33:03.493297] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T17:33:04.254389] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-30T17:33:04.900960] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T17:33:05.054332] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-30T17:33:05.136419] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T17:33:05.854410] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-30T17:33:06.139168] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T17:33:06.654329] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-30T17:33:06.746014] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T17:33:07.454433] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-30T17:33:08.010038] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:33:08.254373] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-30T17:33:08.422001] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T17:33:09.054369] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-30T17:33:09.530752] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T17:33:09.854376] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-30T17:33:10.625153] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T17:33:10.629511] [INFO ] [REMOTE ] BH: Full fetch complete (19497 records). [2025-09-30T17:33:10.629589] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-30T17:33:10.662033] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-30T17:33:10.975697] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T17:33:11.016472] [INFO ] [REMOTE ] BGY: Full fetch complete (33252 records). [2025-09-30T17:33:11.034990] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-30T17:33:11.062142] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-30T17:33:11.095178] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-30T17:33:11.120307] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-30T17:33:11.141048] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-30T17:33:11.175333] [DEBUG] [LOCAL ] BH: Trimmed 19497 records to 15828 (keeping 200 days of data) [2025-09-30T17:33:11.459437] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-30T17:33:11.596827] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-30T17:33:11.597306] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-30T17:33:11.597856] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-30T17:33:11.597939] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-30T17:33:11.602063] [DEBUG] [LOCAL ] BGY: Trimmed 33252 records to 22377 (keeping 200 days of data) [2025-09-30T17:33:11.762458] [DEBUG] [LOCAL ] BH: Primary data saved (15828 records). [2025-09-30T17:33:11.769668] [INFO ] [MAIN ] BH: Full history saved. [2025-09-30T17:33:11.771721] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BH took 30.1s. Estimated remaining: 4h 21m 7s. Rate: 8.1 symbols/min [2025-09-30T17:33:11.771568] [DEBUG] [LOCAL ] BGY: Primary data saved (22377 records). [2025-09-30T17:33:11.784506] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-30T17:33:11.811966] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BGY took 31.4s. Estimated remaining: 4h 20m 2s. Rate: 8.1 symbols/min [2025-09-30T17:33:12.205714] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:12.238745] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:12.260089] [DEBUG] [LOCAL ] BHK: Loaded 22906 existing records from primary storage. [2025-09-30T17:33:12.260604] [INFO ] [MAIN ] BHK: Loaded 22906 existing records. [2025-09-30T17:33:12.497942] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:33:12.526501] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-09-30T17:33:12.526668] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-30T17:33:12.530358] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-30T17:33:12.530807] [INFO ] [MAIN ] BHP: Loaded 53373 existing records. [2025-09-30T17:33:12.536129] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-30T17:33:12.553492] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-30T17:33:12.586790] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T17:33:12.722877] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-30T17:33:12.875627] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:33:12.897194] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-30T17:33:12.961214] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-30T17:33:13.003135] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-30T17:33:13.015536] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-30T17:33:13.220909] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:33:13.324991] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-30T17:33:13.399390] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:13.627371] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:13.854397] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-30T17:33:14.386450] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T17:33:14.654386] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-30T17:33:14.744882] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T17:33:14.777477] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T17:33:15.454437] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-30T17:33:16.030092] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:33:16.254356] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-30T17:33:16.373742] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T17:33:17.054356] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-30T17:33:17.588091] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T17:33:17.854359] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-30T17:33:17.978196] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T17:33:18.654362] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-30T17:33:19.289388] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T17:33:19.454371] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-30T17:33:19.617999] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T17:33:20.254401] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-30T17:33:21.054374] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-30T17:33:21.211897] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T17:33:21.616369] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-30T17:33:21.854358] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-30T17:33:22.515367] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T17:33:22.654336] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-30T17:33:22.815933] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T17:33:23.454406] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-30T17:33:24.073429] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T17:33:24.078707] [INFO ] [REMOTE ] BHE: Full fetch complete (36525 records). [2025-09-30T17:33:24.078823] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-30T17:33:24.284294] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-30T17:33:24.514856] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-30T17:33:24.514950] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-30T17:33:24.515491] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-30T17:33:24.515583] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-30T17:33:24.516687] [DEBUG] [LOCAL ] BHE: Trimmed 36525 records to 24753 (keeping 200 days of data) [2025-09-30T17:33:24.674798] [DEBUG] [LOCAL ] BHE: Primary data saved (24753 records). [2025-09-30T17:33:24.674964] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-30T17:33:24.675076] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHE took 27.9s. Estimated remaining: 4h 20m 37s. Rate: 8.1 symbols/min [2025-09-30T17:33:24.883171] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:24.908898] [DEBUG] [LOCAL ] BHR: Loaded 21364 existing records from primary storage. [2025-09-30T17:33:24.909243] [INFO ] [MAIN ] BHR: Loaded 21364 existing records. [2025-09-30T17:33:25.059492] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-30T17:33:25.181788] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:33:25.182999] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-30T17:33:25.183130] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-30T17:33:25.183736] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-30T17:33:25.183816] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-30T17:33:25.449589] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T17:33:25.553079] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-30T17:33:25.723261] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:25.854353] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-30T17:33:26.654321] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-30T17:33:26.729910] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T17:33:26.952202] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T17:33:26.965946] [INFO ] [REMOTE ] BHC: Full fetch complete (66977 records). [2025-09-30T17:33:26.966114] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-30T17:33:27.381432] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-30T17:33:27.381572] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-30T17:33:27.382340] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-30T17:33:27.382410] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-30T17:33:27.384545] [DEBUG] [LOCAL ] BHC: Trimmed 66977 records to 46835 (keeping 200 days of data) [2025-09-30T17:33:27.462240] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-30T17:33:27.492246] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T17:33:27.693142] [DEBUG] [LOCAL ] BHC: Primary data saved (46835 records). [2025-09-30T17:33:27.693301] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-30T17:33:27.693414] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHC took 40.8s. Estimated remaining: 4h 19m 55s. Rate: 8.1 symbols/min [2025-09-30T17:33:27.882983] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:27.883169] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-30T17:33:27.883214] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-30T17:33:27.883350] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-30T17:33:27.883392] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-30T17:33:27.883434] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-30T17:33:27.883468] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-30T17:33:28.255822] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-30T17:33:28.342463] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:28.587401] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T17:33:29.054365] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-30T17:33:29.418885] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-30T17:33:29.854362] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-30T17:33:30.069926] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T17:33:30.111226] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-30T17:33:30.654410] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-30T17:33:31.454390] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-30T17:33:32.153206] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T17:33:32.254338] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-30T17:33:32.576269] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T17:33:32.671694] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T17:33:33.054372] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-30T17:33:33.854408] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-30T17:33:34.129589] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-30T17:33:34.200736] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T17:33:34.654372] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-30T17:33:35.454375] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-30T17:33:35.645864] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T17:33:36.254404] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-30T17:33:36.455852] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T17:33:37.054362] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-30T17:33:37.854370] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-30T17:33:38.116408] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T17:33:38.193639] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-30T17:33:38.323824] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T17:33:38.331165] [INFO ] [REMOTE ] BHK: Full fetch complete (30184 records). [2025-09-30T17:33:38.331288] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-30T17:33:38.659844] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-30T17:33:38.755768] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-30T17:33:38.755849] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-30T17:33:38.756342] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-30T17:33:38.756406] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-30T17:33:38.757242] [DEBUG] [LOCAL ] BHK: Trimmed 30184 records to 23022 (keeping 200 days of data) [2025-09-30T17:33:38.908847] [DEBUG] [LOCAL ] BHK: Primary data saved (23022 records). [2025-09-30T17:33:38.908995] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-30T17:33:38.909097] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 27.1s. Estimated remaining: 4h 20m 17s. Rate: 8.1 symbols/min [2025-09-30T17:33:39.105940] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:39.160259] [DEBUG] [LOCAL ] BHVN: Loaded 49696 existing records from primary storage. [2025-09-30T17:33:39.160599] [INFO ] [MAIN ] BHVN: Loaded 49696 existing records. [2025-09-30T17:33:39.361611] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:33:39.361882] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-30T17:33:39.361975] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-30T17:33:39.362697] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-30T17:33:39.362760] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-30T17:33:39.459468] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-30T17:33:39.754991] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:40.139151] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T17:33:40.254365] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-30T17:33:40.299989] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T17:33:40.732786] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T17:33:41.054378] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-30T17:33:41.299041] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-30T17:33:41.854382] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-30T17:33:42.654333] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-30T17:33:42.992552] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-30T17:33:43.016398] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T17:33:43.454361] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-30T17:33:44.254353] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-30T17:33:44.561965] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T17:33:45.054401] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-30T17:33:45.725493] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T17:33:45.768303] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T17:33:45.854359] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-30T17:33:46.303795] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-30T17:33:46.304843] [INFO ] [REMOTE ] BHV: Full fetch complete (1373 records). [2025-09-30T17:33:46.304916] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-30T17:33:46.506686] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-30T17:33:46.506941] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:33:46.507015] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:33:46.507089] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-30T17:33:46.507160] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-30T17:33:46.507201] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-30T17:33:46.507258] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-30T17:33:46.507341] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHV took 18.8s. Estimated remaining: 4h 20m 11s. Rate: 8.1 symbols/min [2025-09-30T17:33:46.663173] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-30T17:33:46.693336] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:46.751744] [DEBUG] [LOCAL ] BILL: Loaded 52329 existing records from primary storage. [2025-09-30T17:33:46.752105] [INFO ] [MAIN ] BILL: Loaded 52329 existing records. [2025-09-30T17:33:46.942511] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:33:46.942771] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-30T17:33:46.942822] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-30T17:33:46.943157] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-30T17:33:46.943216] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-30T17:33:47.325139] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:47.454359] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-30T17:33:48.262925] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-30T17:33:48.282100] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T17:33:48.932879] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:33:49.054367] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-30T17:33:49.146761] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T17:33:49.854366] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-30T17:33:50.258537] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T17:33:50.654394] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-30T17:33:51.454323] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-30T17:33:51.690294] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T17:33:51.701989] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T17:33:52.254369] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-30T17:33:52.847425] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:33:53.059466] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-30T17:33:53.068964] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T17:33:53.854390] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-30T17:33:54.654375] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-30T17:33:54.792063] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T17:33:55.377104] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T17:33:55.383556] [INFO ] [REMOTE ] BHR: Full fetch complete (30609 records). [2025-09-30T17:33:55.383720] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-30T17:33:55.464592] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-30T17:33:55.834673] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-30T17:33:55.834768] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-30T17:33:55.835230] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-30T17:33:55.835272] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-30T17:33:55.836148] [DEBUG] [LOCAL ] BHR: Trimmed 30609 records to 21377 (keeping 200 days of data) [2025-09-30T17:33:55.968638] [DEBUG] [LOCAL ] BHR: Primary data saved (21377 records). [2025-09-30T17:33:55.968915] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-30T17:33:55.969080] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHR took 31.3s. Estimated remaining: 4h 20m 19s. Rate: 8.1 symbols/min [2025-09-30T17:33:56.159114] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:33:56.185491] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T17:33:56.220141] [DEBUG] [LOCAL ] BIO: Loaded 25004 existing records from primary storage. [2025-09-30T17:33:56.220415] [INFO ] [MAIN ] BIO: Loaded 25004 existing records. [2025-09-30T17:33:56.259550] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-30T17:33:56.423861] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:33:56.424114] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-30T17:33:56.424164] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-30T17:33:56.424525] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-30T17:33:56.424592] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-30T17:33:56.807006] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:33:57.054329] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-30T17:33:57.531209] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T17:33:57.854352] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-30T17:33:58.209749] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-30T17:33:58.397040] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T17:33:58.654360] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-30T17:33:58.802503] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T17:33:59.454378] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-30T17:34:00.254342] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-30T17:34:00.536702] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T17:34:00.548266] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T17:34:01.054361] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-30T17:34:01.854329] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-30T17:34:02.035872] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T17:34:02.048073] [INFO ] [REMOTE ] BHP: Full fetch complete (77247 records). [2025-09-30T17:34:02.048231] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-30T17:34:02.473076] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-30T17:34:02.473165] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-30T17:34:02.473959] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-30T17:34:02.474028] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-30T17:34:02.475723] [DEBUG] [LOCAL ] BHP: Trimmed 77247 records to 53373 (keeping 200 days of data) [2025-09-30T17:34:02.666459] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-30T17:34:02.830787] [DEBUG] [LOCAL ] BHP: Primary data saved (53373 records). [2025-09-30T17:34:02.830942] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-30T17:34:02.832476] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHP took 51.0s. Estimated remaining: 4h 20m 7s. Rate: 8.1 symbols/min [2025-09-30T17:34:03.056282] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:03.059016] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-30T17:34:03.126105] [DEBUG] [LOCAL ] BIP: Loaded 39545 existing records from primary storage. [2025-09-30T17:34:03.126447] [INFO ] [MAIN ] BIP: Loaded 39545 existing records. [2025-09-30T17:34:03.322473] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:34:03.322750] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-30T17:34:03.322838] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-30T17:34:03.323298] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-30T17:34:03.323387] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-30T17:34:03.457096] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-30T17:34:03.738619] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:03.787135] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T17:34:03.794474] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T17:34:04.254363] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-30T17:34:05.054347] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-30T17:34:05.313915] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T17:34:05.854332] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-30T17:34:05.967663] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T17:34:06.020638] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T17:34:06.654387] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-30T17:34:06.989089] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T17:34:07.454765] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-30T17:34:07.709246] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T17:34:08.254360] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-30T17:34:09.054339] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-30T17:34:09.551670] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-30T17:34:09.848265] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T17:34:09.858618] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-30T17:34:10.370066] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T17:34:10.654357] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-30T17:34:11.452591] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T17:34:11.460133] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-30T17:34:12.254330] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-30T17:34:12.755416] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:34:12.765083] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-30T17:34:13.054348] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-30T17:34:13.638756] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:34:13.854355] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-30T17:34:14.654359] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-30T17:34:14.792446] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T17:34:15.454348] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-30T17:34:15.727112] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T17:34:16.002605] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T17:34:16.254356] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-30T17:34:17.051016] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T17:34:17.063401] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-30T17:34:17.066913] [INFO ] [REMOTE ] BILL: Full fetch complete (75250 records). [2025-09-30T17:34:17.067179] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-30T17:34:17.068375] [FATAL] [VALIDATOR ] BILL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:34:17.068479] [FATAL] [MAIN ] BILL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:34:17.068555] [WARN ] [MAIN ] BILL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:34:17.068635] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-30T17:34:17.068754] [DEBUG] [LOCAL ] BILL: No primary data file found to delete. [2025-09-30T17:34:17.068797] [INFO ] [LOCAL ] BILL: Starting deletion of derivative data. [2025-09-30T17:34:17.069068] [DEBUG] [LOCAL ] BILL: Deleted derivative data file. [2025-09-30T17:34:17.069202] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BILL took 30.6s. Estimated remaining: 4h 20m 51s. Rate: 8.0 symbols/min [2025-09-30T17:34:17.254986] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:17.255176] [DEBUG] [LOCAL ] BIPC: No existing data file found in primary storage. [2025-09-30T17:34:17.255219] [WARN ] [MAIN ] BIPC: No existing data found, performing full refresh instead. [2025-09-30T17:34:17.255336] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-30T17:34:17.255377] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-30T17:34:17.255419] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-09-30T17:34:17.255450] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-30T17:34:17.646441] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:17.810078] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T17:34:17.821573] [INFO ] [REMOTE ] BHVN: Full fetch complete (69809 records). [2025-09-30T17:34:17.821777] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-30T17:34:17.859521] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-30T17:34:18.255209] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-30T17:34:18.255315] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-30T17:34:18.256431] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-30T17:34:18.256528] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-30T17:34:18.258375] [DEBUG] [LOCAL ] BHVN: Trimmed 69809 records to 49759 (keeping 200 days of data) [2025-09-30T17:34:18.569695] [DEBUG] [LOCAL ] BHVN: Primary data saved (49759 records). [2025-09-30T17:34:18.569885] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-30T17:34:18.569993] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BHVN took 39.7s. Estimated remaining: 4h 19m 58s. Rate: 8.1 symbols/min [2025-09-30T17:34:18.663265] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-30T17:34:18.771505] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:18.800007] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T17:34:18.811810] [DEBUG] [LOCAL ] BIPH: Loaded 2572 existing records from primary storage. [2025-09-30T17:34:18.812162] [INFO ] [MAIN ] BIPH: Loaded 2572 existing records. [2025-09-30T17:34:19.015078] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:34:19.015357] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-30T17:34:19.015407] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-30T17:34:19.015606] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-30T17:34:19.015702] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-30T17:34:19.415757] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:19.437521] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T17:34:19.454310] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-30T17:34:19.683537] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T17:34:20.254378] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-30T17:34:20.833351] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T17:34:20.926304] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-30T17:34:21.054404] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-30T17:34:21.854377] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-30T17:34:22.201092] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T17:34:22.654406] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-30T17:34:22.964885] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T17:34:23.454374] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-30T17:34:24.022551] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:34:24.254362] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-30T17:34:24.720452] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T17:34:25.054367] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-30T17:34:25.854335] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-30T17:34:25.907734] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T17:34:26.154245] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T17:34:26.158872] [INFO ] [REMOTE ] BIO: Full fetch complete (34089 records). [2025-09-30T17:34:26.159015] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-30T17:34:26.588300] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-30T17:34:26.588427] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-30T17:34:26.588924] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-30T17:34:26.588990] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-30T17:34:26.590057] [DEBUG] [LOCAL ] BIO: Trimmed 34089 records to 24946 (keeping 200 days of data) [2025-09-30T17:34:26.655312] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-30T17:34:26.750243] [DEBUG] [LOCAL ] BIO: Primary data saved (24946 records). [2025-09-30T17:34:26.750387] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-30T17:34:26.750477] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIO took 30.8s. Estimated remaining: 4h 19m 57s. Rate: 8.1 symbols/min [2025-09-30T17:34:27.072566] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T17:34:27.327877] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-30T17:34:27.454412] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-30T17:34:28.016712] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-30T17:34:28.254385] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-30T17:34:29.054416] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-30T17:34:29.455585] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T17:34:29.854418] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-30T17:34:30.643903] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T17:34:30.654306] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-30T17:34:31.282322] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T17:34:31.291701] [INFO ] [REMOTE ] BIP: Full fetch complete (56832 records). [2025-09-30T17:34:31.291858] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-30T17:34:31.471296] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-30T17:34:31.786189] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-30T17:34:31.786475] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-30T17:34:31.787319] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-30T17:34:31.787391] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-30T17:34:31.788911] [DEBUG] [LOCAL ] BIP: Trimmed 56832 records to 39540 (keeping 200 days of data) [2025-09-30T17:34:32.064791] [DEBUG] [LOCAL ] BIP: Primary data saved (39540 records). [2025-09-30T17:34:32.065009] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-30T17:34:32.066244] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIP took 29.2s. Estimated remaining: 4h 19m 33s. Rate: 8.1 symbols/min [2025-09-30T17:34:32.189185] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T17:34:32.203173] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T17:34:32.254371] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-30T17:34:32.809190] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T17:34:33.054398] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-30T17:34:33.555942] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T17:34:33.854379] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-30T17:34:34.654417] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-30T17:34:35.017702] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T17:34:35.080899] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-30T17:34:35.454415] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-30T17:34:35.940097] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T17:34:36.254397] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-30T17:34:37.054428] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-30T17:34:37.450675] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T17:34:37.763762] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T17:34:37.854354] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-30T17:34:38.385267] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-30T17:34:38.386419] [INFO ] [REMOTE ] BIPH: Full fetch complete (4335 records). [2025-09-30T17:34:38.386492] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-30T17:34:38.669605] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-30T17:34:38.868747] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-30T17:34:38.868845] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-30T17:34:38.869022] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-30T17:34:38.869070] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-30T17:34:38.869516] [DEBUG] [LOCAL ] BIPH: Trimmed 4335 records to 2575 (keeping 200 days of data) [2025-09-30T17:34:38.891631] [DEBUG] [LOCAL ] BIPH: Primary data saved (2575 records). [2025-09-30T17:34:38.891842] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-30T17:34:38.891947] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BIPH took 20.3s. Estimated remaining: 4h 19m 21s. Rate: 8.1 symbols/min [2025-09-30T17:34:40.216618] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T17:34:40.226603] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-30T17:34:41.921891] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T17:34:41.930744] [INFO ] [REMOTE ] BIPC: Full fetch complete (59879 records). [2025-09-30T17:34:41.930895] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-30T17:34:42.335533] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-30T17:34:42.335620] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-30T17:34:42.336302] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-30T17:34:42.336360] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-30T17:34:42.337635] [DEBUG] [LOCAL ] BIPC: Trimmed 59879 records to 41499 (keeping 200 days of data) [2025-09-30T17:34:42.599949] [DEBUG] [LOCAL ] BIPC: Primary data saved (41499 records). [2025-09-30T17:34:42.600098] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-30T17:34:42.600180] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPC took 25.5s. Estimated remaining: 4h 18m 46s. Rate: 8.1 symbols/min [2025-09-30T17:34:43.293436] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:43.351809] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:43.362483] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:43.382173] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:34:43.394352] [DEBUG] [LOCAL ] BIPI: Loaded 3221 existing records from primary storage. [2025-09-30T17:34:43.391629] [DEBUG] [LOCAL ] BIPJ: Loaded 3022 existing records from primary storage. [2025-09-30T17:34:43.395089] [INFO ] [MAIN ] BIPJ: Loaded 3022 existing records. [2025-09-30T17:34:43.394836] [INFO ] [MAIN ] BIPI: Loaded 3221 existing records. [2025-09-30T17:34:43.629949] [DEBUG] [LOCAL ] BIT: Loaded 22570 existing records from primary storage. [2025-09-30T17:34:43.680222] [INFO ] [MAIN ] BIT: Loaded 22570 existing records. [2025-09-30T17:34:43.732436] [DEBUG] [LOCAL ] BIRK: Loaded 50899 existing records from primary storage. [2025-09-30T17:34:43.881841] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:34:43.899951] [INFO ] [MAIN ] BIRK: Loaded 50899 existing records. [2025-09-30T17:34:43.925342] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-30T17:34:43.946813] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:34:43.930617] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-30T17:34:43.988266] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-30T17:34:44.017279] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-30T17:34:44.017222] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-30T17:34:44.028086] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-30T17:34:44.094525] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-30T17:34:44.181835] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-30T17:34:44.286599] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:34:44.365417] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-30T17:34:44.436759] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-30T17:34:44.448076] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-30T17:34:44.426350] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:34:44.483377] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-30T17:34:44.515433] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-30T17:34:44.536944] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-30T17:34:44.624947] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-30T17:34:44.671305] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-30T17:34:45.481417] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:45.575302] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-30T17:34:45.583749] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:45.621863] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-30T17:34:45.735402] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:45.774824] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-30T17:34:45.868878] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:34:45.869191] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-30T17:34:46.390401] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T17:34:46.393302] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-30T17:34:46.553221] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T17:34:46.554837] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-30T17:34:46.898804] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-30T17:34:46.900171] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-30T17:34:46.983688] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T17:34:46.987021] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-30T17:34:46.985122] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:34:46.993296] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-30T17:34:47.270259] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-30T17:34:47.407042] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T17:34:47.441720] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T17:34:47.454308] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-30T17:34:48.147240] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T17:34:48.254405] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-30T17:34:48.665017] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T17:34:48.918848] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-30T17:34:49.054405] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-30T17:34:49.507673] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-30T17:34:49.854373] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-30T17:34:50.388952] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-30T17:34:50.654397] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-30T17:34:51.454387] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-30T17:34:51.853173] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-30T17:34:51.973733] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T17:34:52.254390] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-30T17:34:52.586226] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-30T17:34:53.054366] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-30T17:34:53.466288] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-30T17:34:53.854380] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-30T17:34:54.182000] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-30T17:34:54.654407] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-30T17:34:55.454370] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-30T17:34:55.628029] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T17:34:56.254363] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-30T17:34:56.806970] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T17:34:57.002624] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T17:34:57.054402] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-30T17:34:57.519602] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-30T17:34:57.854379] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-30T17:34:58.654391] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-30T17:34:58.937846] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:34:59.454425] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-30T17:34:59.996110] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-30T17:35:00.254414] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-30T17:35:00.333737] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T17:35:00.715625] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T17:35:01.054393] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-30T17:35:01.854445] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-30T17:35:02.028142] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T17:35:02.654408] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-30T17:35:03.194225] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-30T17:35:03.304353] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:35:03.454377] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-30T17:35:04.130408] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T17:35:04.254367] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-30T17:35:04.772325] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T17:35:04.773763] [INFO ] [REMOTE ] BIPI: Full fetch complete (5146 records). [2025-09-30T17:35:04.773837] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-30T17:35:05.059530] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-30T17:35:05.187868] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-30T17:35:05.187961] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-30T17:35:05.188176] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-30T17:35:05.188249] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-30T17:35:05.189046] [DEBUG] [LOCAL ] BIPI: Trimmed 5146 records to 3193 (keeping 200 days of data) [2025-09-30T17:35:05.213037] [DEBUG] [LOCAL ] BIPI: Primary data saved (3193 records). [2025-09-30T17:35:05.213135] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-30T17:35:05.213303] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPI took 22.6s. Estimated remaining: 4h 20m 31s. Rate: 8.0 symbols/min [2025-09-30T17:35:05.396618] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:05.396845] [DEBUG] [LOCAL ] BJ: No existing data file found in primary storage. [2025-09-30T17:35:05.396886] [WARN ] [MAIN ] BJ: No existing data found, performing full refresh instead. [2025-09-30T17:35:05.397053] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-30T17:35:05.397108] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-30T17:35:05.397153] [DEBUG] [LOCAL ] BJ: No primary data file found to delete. [2025-09-30T17:35:05.397217] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-30T17:35:05.823981] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:05.830375] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-30T17:35:05.832044] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4332 records). [2025-09-30T17:35:05.832180] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-30T17:35:05.832691] [FATAL] [VALIDATOR ] BIPJ: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:35:05.832776] [FATAL] [MAIN ] BIPJ: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:35:05.832821] [WARN ] [MAIN ] BIPJ: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:35:05.832872] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-30T17:35:05.832972] [DEBUG] [LOCAL ] BIPJ: No primary data file found to delete. [2025-09-30T17:35:05.833073] [INFO ] [LOCAL ] BIPJ: Starting deletion of derivative data. [2025-09-30T17:35:05.833429] [DEBUG] [LOCAL ] BIPJ: Deleted derivative data file. [2025-09-30T17:35:05.833699] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPJ took 23.2s. Estimated remaining: 4h 19m 33s. Rate: 8.0 symbols/min [2025-09-30T17:35:05.859523] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-30T17:35:06.052854] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:06.119276] [DEBUG] [LOCAL ] BK: Loaded 53539 existing records from primary storage. [2025-09-30T17:35:06.119663] [INFO ] [MAIN ] BK: Loaded 53539 existing records. [2025-09-30T17:35:06.321425] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:06.321665] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-30T17:35:06.321729] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-30T17:35:06.322120] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-30T17:35:06.322192] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-30T17:35:06.659517] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-30T17:35:06.737409] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:07.028135] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T17:35:07.454367] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-30T17:35:08.043549] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:35:08.254379] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-30T17:35:08.751033] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T17:35:09.054405] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-30T17:35:09.854341] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-30T17:35:09.945784] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T17:35:10.567823] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T17:35:10.654373] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-30T17:35:11.316256] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T17:35:11.454365] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-30T17:35:12.254366] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-30T17:35:12.587544] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T17:35:12.770303] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T17:35:13.054369] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-30T17:35:13.854365] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-30T17:35:14.257352] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T17:35:14.654351] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-30T17:35:14.798814] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T17:35:14.810289] [INFO ] [REMOTE ] BIRK: Full fetch complete (72942 records). [2025-09-30T17:35:14.810467] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-30T17:35:15.268301] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-30T17:35:15.268451] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-30T17:35:15.269627] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-30T17:35:15.269743] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-30T17:35:15.272913] [DEBUG] [LOCAL ] BIRK: Trimmed 72942 records to 50901 (keeping 200 days of data) [2025-09-30T17:35:15.455558] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-30T17:35:15.600666] [DEBUG] [LOCAL ] BIRK: Primary data saved (50901 records). [2025-09-30T17:35:15.600829] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-30T17:35:15.600951] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIRK took 33.0s. Estimated remaining: 4h 19m 43s. Rate: 8.0 symbols/min [2025-09-30T17:35:15.801350] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:15.831754] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-30T17:35:15.883806] [DEBUG] [LOCAL ] BKD: Loaded 50182 existing records from primary storage. [2025-09-30T17:35:15.884153] [INFO ] [MAIN ] BKD: Loaded 50182 existing records. [2025-09-30T17:35:16.081089] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:16.081395] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-30T17:35:16.081533] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-30T17:35:16.081839] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-30T17:35:16.081900] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-30T17:35:16.257685] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-30T17:35:16.420822] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T17:35:16.485073] [INFO ] [REMOTE ] BIT: Full fetch complete (31491 records). [2025-09-30T17:35:16.504515] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-30T17:35:16.528847] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:16.949889] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-30T17:35:16.949990] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-30T17:35:16.950545] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-30T17:35:16.950747] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-30T17:35:16.951875] [DEBUG] [LOCAL ] BIT: Trimmed 31491 records to 22692 (keeping 200 days of data) [2025-09-30T17:35:17.055332] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-30T17:35:17.090194] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:35:17.156968] [DEBUG] [LOCAL ] BIT: Primary data saved (22692 records). [2025-09-30T17:35:17.157134] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-30T17:35:17.157297] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIT took 34.5s. Estimated remaining: 4h 18m 52s. Rate: 8.1 symbols/min [2025-09-30T17:35:17.395091] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:17.440048] [DEBUG] [LOCAL ] BKE: Loaded 34611 existing records from primary storage. [2025-09-30T17:35:17.440340] [INFO ] [MAIN ] BKE: Loaded 34611 existing records. [2025-09-30T17:35:17.632079] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:17.632308] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-30T17:35:17.632367] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-30T17:35:17.632728] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-30T17:35:17.632787] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-30T17:35:17.865473] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-30T17:35:18.040385] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:18.071262] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T17:35:18.654368] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-30T17:35:18.725402] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T17:35:19.459480] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-30T17:35:19.481618] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T17:35:19.992233] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T17:35:20.254410] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-30T17:35:20.614871] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:35:21.054415] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-30T17:35:21.854418] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-30T17:35:22.207755] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T17:35:22.420989] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T17:35:22.654402] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-30T17:35:23.454352] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-30T17:35:23.778953] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T17:35:24.254321] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-30T17:35:24.757142] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-30T17:35:24.977455] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T17:35:25.054396] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-30T17:35:25.854325] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-30T17:35:26.118275] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T17:35:26.654405] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-30T17:35:26.696276] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T17:35:27.454625] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-30T17:35:27.579232] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T17:35:28.001953] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T17:35:28.254383] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-30T17:35:29.054378] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-30T17:35:29.162815] [DEBUG] [REMOTE ] BKE: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-30T17:35:29.163266] [WARN ] [REMOTE ] BKE: No data returned for month 2025-01 [2025-09-30T17:35:29.163439] [FATAL] [REMOTE ] BKE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:35:29.163542] [FATAL] [MAIN ] BKE: Failed to fetch primary data. [2025-09-30T17:35:29.163615] [WARN ] [MAIN ] BKE: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:35:29.163792] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-30T17:35:29.163890] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-09-30T17:35:29.163956] [INFO ] [LOCAL ] BKE: Starting deletion of derivative data. [2025-09-30T17:35:29.164425] [DEBUG] [LOCAL ] BKE: Deleted derivative data file. [2025-09-30T17:35:29.164529] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BKE took 12.0s. Estimated remaining: 4h 19m 18s. Rate: 8.0 symbols/min [2025-09-30T17:35:29.360454] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:29.416883] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T17:35:29.442054] [DEBUG] [LOCAL ] BKH: Loaded 36557 existing records from primary storage. [2025-09-30T17:35:29.442380] [INFO ] [MAIN ] BKH: Loaded 36557 existing records. [2025-09-30T17:35:29.643674] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:29.643894] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-30T17:35:29.643982] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-30T17:35:29.644250] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-30T17:35:29.644309] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-30T17:35:29.860455] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-30T17:35:30.060913] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:30.205314] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T17:35:30.654390] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-30T17:35:31.454321] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-30T17:35:31.717025] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T17:35:31.855695] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T17:35:32.254390] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-30T17:35:33.054335] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-30T17:35:33.227385] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T17:35:33.434532] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T17:35:33.854380] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-30T17:35:34.654385] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-30T17:35:34.860781] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T17:35:34.872983] [INFO ] [REMOTE ] BK: Full fetch complete (77480 records). [2025-09-30T17:35:34.873177] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-30T17:35:35.313383] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-30T17:35:35.313502] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-30T17:35:35.315399] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-30T17:35:35.315486] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-30T17:35:35.355403] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T17:35:35.366379] [DEBUG] [LOCAL ] BK: Trimmed 77480 records to 53538 (keeping 200 days of data) [2025-09-30T17:35:35.470678] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-30T17:35:35.721373] [DEBUG] [LOCAL ] BK: Primary data saved (53538 records). [2025-09-30T17:35:35.721521] [INFO ] [MAIN ] BK: Full history saved. [2025-09-30T17:35:35.722869] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BK took 29.9s. Estimated remaining: 4h 19m 4s. Rate: 8.0 symbols/min [2025-09-30T17:35:35.901468] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:35.943831] [DEBUG] [LOCAL ] BKKT: Loaded 34818 existing records from primary storage. [2025-09-30T17:35:35.944145] [INFO ] [MAIN ] BKKT: Loaded 34818 existing records. [2025-09-30T17:35:36.137631] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:36.137896] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-30T17:35:36.137944] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-30T17:35:36.138311] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-30T17:35:36.138398] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-30T17:35:36.257797] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-30T17:35:36.572051] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:36.595176] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-30T17:35:36.631956] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:35:37.054382] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-30T17:35:37.698802] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T17:35:37.854410] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-30T17:35:38.654320] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-30T17:35:38.702160] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T17:35:39.454401] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-30T17:35:39.534340] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T17:35:40.000569] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T17:35:40.254442] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-30T17:35:41.057779] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-30T17:35:41.060342] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T17:35:41.854395] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-30T17:35:42.014371] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T17:35:42.025942] [INFO ] [REMOTE ] BKD: Full fetch complete (71601 records). [2025-09-30T17:35:42.026109] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-30T17:35:42.471299] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-30T17:35:42.471630] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-30T17:35:42.472585] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-30T17:35:42.472666] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-30T17:35:42.474201] [DEBUG] [LOCAL ] BKD: Trimmed 71601 records to 50188 (keeping 200 days of data) [2025-09-30T17:35:42.675754] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-30T17:35:42.779350] [DEBUG] [LOCAL ] BKD: Primary data saved (50188 records). [2025-09-30T17:35:42.779503] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-30T17:35:42.779607] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BKD took 27.2s. Estimated remaining: 4h 18m 53s. Rate: 8.0 symbols/min [2025-09-30T17:35:42.970922] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:43.008062] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T17:35:43.023629] [DEBUG] [LOCAL ] BKN: Loaded 7759 existing records from primary storage. [2025-09-30T17:35:43.024048] [INFO ] [MAIN ] BKN: Loaded 7759 existing records. [2025-09-30T17:35:43.023839] [INFO ] [REMOTE ] BJ: Full fetch complete (73809 records). [2025-09-30T17:35:43.024175] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-30T17:35:43.454103] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:43.519306] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-30T17:35:43.533859] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-30T17:35:43.594966] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-30T17:35:43.600728] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-30T17:35:43.875439] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T17:35:43.875714] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-30T17:35:43.905888] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-30T17:35:43.912766] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-30T17:35:43.913210] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-30T17:35:43.920080] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-30T17:35:44.010572] [DEBUG] [LOCAL ] BJ: Trimmed 73809 records to 51365 (keeping 200 days of data) [2025-09-30T17:35:44.261500] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T17:35:44.292279] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-30T17:35:44.367052] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:44.593156] [DEBUG] [LOCAL ] BJ: Primary data saved (51365 records). [2025-09-30T17:35:44.593312] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-30T17:35:44.593392] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BJ took 39.4s. Estimated remaining: 4h 18m 5s. Rate: 8.1 symbols/min [2025-09-30T17:35:44.831929] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:35:44.885845] [DEBUG] [LOCAL ] BKSY: Loaded 48195 existing records from primary storage. [2025-09-30T17:35:44.886198] [INFO ] [MAIN ] BKSY: Loaded 48195 existing records. [2025-09-30T17:35:45.061172] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-30T17:35:45.095590] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:35:45.096858] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-30T17:35:45.097052] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-30T17:35:45.097585] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-30T17:35:45.097677] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-30T17:35:45.426764] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T17:35:45.522301] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:35:45.854373] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-30T17:35:45.972770] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T17:35:45.988919] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T17:35:46.654407] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-30T17:35:47.435961] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T17:35:47.454325] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-30T17:35:48.007453] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T17:35:48.254395] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-30T17:35:48.872679] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T17:35:49.054410] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-30T17:35:49.206124] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T17:35:49.651333] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T17:35:49.854396] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-30T17:35:50.592577] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-30T17:35:50.654374] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-30T17:35:51.454397] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-30T17:35:52.006868] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T17:35:52.106625] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T17:35:52.254409] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-30T17:35:53.054532] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-30T17:35:53.854379] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-30T17:35:54.094908] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T17:35:54.493179] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T17:35:54.571626] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T17:35:54.654404] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-30T17:35:55.454395] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-30T17:35:56.254324] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-30T17:35:56.294392] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T17:35:56.967155] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T17:35:57.054399] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-30T17:35:57.854336] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-30T17:35:58.027475] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T17:35:58.448227] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T17:35:58.654370] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-30T17:35:58.687137] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T17:35:59.454403] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-30T17:35:59.855025] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T17:36:00.254365] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-30T17:36:00.854307] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T17:36:00.862750] [INFO ] [REMOTE ] BKH: Full fetch complete (52347 records). [2025-09-30T17:36:00.862913] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-30T17:36:01.059685] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-30T17:36:01.325026] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-30T17:36:01.325138] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-30T17:36:01.325943] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-30T17:36:01.326029] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-30T17:36:01.327468] [DEBUG] [LOCAL ] BKH: Trimmed 52347 records to 36624 (keeping 200 days of data) [2025-09-30T17:36:01.572213] [DEBUG] [LOCAL ] BKH: Primary data saved (36624 records). [2025-09-30T17:36:01.572389] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-30T17:36:01.572482] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKH took 32.4s. Estimated remaining: 4h 19m 6s. Rate: 8.0 symbols/min [2025-09-30T17:36:01.808986] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:01.812095] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T17:36:01.835326] [DEBUG] [LOCAL ] BKT: Loaded 11191 existing records from primary storage. [2025-09-30T17:36:01.835670] [INFO ] [MAIN ] BKT: Loaded 11191 existing records. [2025-09-30T17:36:01.859524] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-30T17:36:02.046254] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:02.046501] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-30T17:36:02.046551] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-30T17:36:02.046774] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-30T17:36:02.046836] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-30T17:36:02.437546] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:02.654378] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-30T17:36:02.695815] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T17:36:03.148085] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-30T17:36:03.454375] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-30T17:36:03.615713] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T17:36:03.853955] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T17:36:04.254355] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-30T17:36:05.054337] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-30T17:36:05.118142] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T17:36:05.121182] [INFO ] [REMOTE ] BKN: Full fetch complete (11911 records). [2025-09-30T17:36:05.121287] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-30T17:36:05.528089] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-30T17:36:05.528177] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-30T17:36:05.528545] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-30T17:36:05.528608] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-30T17:36:05.529103] [DEBUG] [LOCAL ] BKN: Trimmed 11911 records to 7734 (keeping 200 days of data) [2025-09-30T17:36:05.581129] [DEBUG] [LOCAL ] BKN: Primary data saved (7734 records). [2025-09-30T17:36:05.581278] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-30T17:36:05.581366] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKN took 22.8s. Estimated remaining: 4h 18m 34s. Rate: 8.0 symbols/min [2025-09-30T17:36:05.762875] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:05.803550] [DEBUG] [LOCAL ] BKU: Loaded 41557 existing records from primary storage. [2025-09-30T17:36:05.803896] [INFO ] [MAIN ] BKU: Loaded 41557 existing records. [2025-09-30T17:36:05.863000] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-30T17:36:06.000611] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:06.000854] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-30T17:36:06.000905] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-30T17:36:06.001228] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-30T17:36:06.001287] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-30T17:36:06.399435] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:06.654329] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-30T17:36:06.725320] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T17:36:06.924582] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T17:36:07.454368] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-30T17:36:07.925170] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T17:36:08.254358] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-30T17:36:08.581172] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T17:36:08.751565] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-30T17:36:09.054368] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-30T17:36:09.854360] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-30T17:36:10.653851] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T17:36:10.661365] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-30T17:36:11.454374] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-30T17:36:11.981563] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T17:36:11.992215] [INFO ] [REMOTE ] BKKT: Full fetch complete (50182 records). [2025-09-30T17:36:11.992375] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-30T17:36:12.267621] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-30T17:36:12.421712] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-30T17:36:12.421967] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-30T17:36:12.422806] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-30T17:36:12.422890] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-30T17:36:12.424233] [DEBUG] [LOCAL ] BKKT: Trimmed 50182 records to 35076 (keeping 200 days of data) [2025-09-30T17:36:12.570236] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-30T17:36:12.694160] [DEBUG] [LOCAL ] BKKT: Primary data saved (35076 records). [2025-09-30T17:36:12.694331] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-30T17:36:12.695514] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKKT took 37.0s. Estimated remaining: 4h 18m 24s. Rate: 8.0 symbols/min [2025-09-30T17:36:12.878970] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:12.906968] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:36:12.951886] [DEBUG] [LOCAL ] BKV: Loaded 29665 existing records from primary storage. [2025-09-30T17:36:12.952965] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-30T17:36:12.953301] [INFO ] [MAIN ] BKV: Loaded 29665 existing records. [2025-09-30T17:36:13.059565] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-30T17:36:13.170513] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:13.170813] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-30T17:36:13.170898] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-30T17:36:13.172110] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-30T17:36:13.172174] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-30T17:36:13.548155] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:13.854380] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-30T17:36:14.654351] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-30T17:36:14.697145] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T17:36:15.003891] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T17:36:15.454386] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-30T17:36:16.134326] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T17:36:16.254413] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-30T17:36:16.646487] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T17:36:17.054383] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-30T17:36:17.823603] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T17:36:17.859561] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-30T17:36:17.884149] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T17:36:18.654372] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-30T17:36:19.188449] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T17:36:19.454417] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-30T17:36:20.254413] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-30T17:36:20.406633] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-30T17:36:20.800297] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T17:36:20.811505] [INFO ] [REMOTE ] BKSY: Full fetch complete (69513 records). [2025-09-30T17:36:20.811721] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-30T17:36:21.066309] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-30T17:36:21.094528] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T17:36:21.283552] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-30T17:36:21.283691] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-30T17:36:21.284701] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-30T17:36:21.284773] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-30T17:36:21.286350] [DEBUG] [LOCAL ] BKSY: Trimmed 69513 records to 48205 (keeping 200 days of data) [2025-09-30T17:36:21.573951] [DEBUG] [LOCAL ] BKSY: Primary data saved (48205 records). [2025-09-30T17:36:21.574091] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-30T17:36:21.574922] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKSY took 37.0s. Estimated remaining: 4h 18m 27s. Rate: 8.0 symbols/min [2025-09-30T17:36:21.757430] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:21.801167] [DEBUG] [LOCAL ] BLCO: Loaded 35418 existing records from primary storage. [2025-09-30T17:36:21.801570] [INFO ] [MAIN ] BLCO: Loaded 35418 existing records. [2025-09-30T17:36:21.866470] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-30T17:36:21.998235] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:21.998608] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-30T17:36:21.998699] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-30T17:36:21.999873] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-30T17:36:21.999941] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-30T17:36:22.383514] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:22.484193] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T17:36:22.654373] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-30T17:36:23.076639] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T17:36:23.454396] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-30T17:36:23.480502] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T17:36:24.254377] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-30T17:36:24.681203] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T17:36:25.054356] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-30T17:36:25.671031] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T17:36:25.854370] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-30T17:36:26.077428] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T17:36:26.082188] [INFO ] [REMOTE ] BKT: Full fetch complete (15339 records). [2025-09-30T17:36:26.082579] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-30T17:36:26.495335] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-30T17:36:26.495439] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-30T17:36:26.495861] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-30T17:36:26.495962] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-30T17:36:26.496721] [DEBUG] [LOCAL ] BKT: Trimmed 15339 records to 11267 (keeping 200 days of data) [2025-09-30T17:36:26.578130] [DEBUG] [LOCAL ] BKT: Primary data saved (11267 records). [2025-09-30T17:36:26.578371] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-30T17:36:26.578485] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKT took 25.0s. Estimated remaining: 4h 18m 2s. Rate: 8.1 symbols/min [2025-09-30T17:36:26.659551] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-30T17:36:26.770253] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:26.804306] [DEBUG] [LOCAL ] BLD: Loaded 27802 existing records from primary storage. [2025-09-30T17:36:26.804607] [INFO ] [MAIN ] BLD: Loaded 27802 existing records. [2025-09-30T17:36:27.012553] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:27.012885] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-30T17:36:27.012956] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-30T17:36:27.013801] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-30T17:36:27.013870] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-30T17:36:27.359184] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T17:36:27.455323] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:27.455444] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-30T17:36:27.757843] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T17:36:28.254388] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-30T17:36:29.054378] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-30T17:36:29.181110] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:36:29.636023] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:36:29.854385] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-30T17:36:30.087458] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T17:36:30.654354] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-30T17:36:31.239110] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T17:36:31.454329] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-30T17:36:31.637773] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T17:36:32.254409] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-30T17:36:32.909055] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T17:36:33.054375] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-30T17:36:33.854355] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-30T17:36:34.047061] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T17:36:34.216448] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:36:34.654395] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-30T17:36:34.971800] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T17:36:35.454337] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-30T17:36:35.592528] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T17:36:36.254374] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-30T17:36:36.917085] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T17:36:37.054369] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-30T17:36:37.549128] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T17:36:37.854427] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-30T17:36:38.657013] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-30T17:36:38.662377] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T17:36:39.356173] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T17:36:39.454403] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-30T17:36:39.928568] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T17:36:40.254401] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-30T17:36:40.989041] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T17:36:41.054344] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-30T17:36:41.324620] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T17:36:41.854368] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-30T17:36:42.432613] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T17:36:42.654369] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-30T17:36:43.224254] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T17:36:43.230679] [INFO ] [REMOTE ] BKV: Full fetch complete (45068 records). [2025-09-30T17:36:43.230817] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-30T17:36:43.459556] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-30T17:36:43.675886] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-30T17:36:43.675988] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-30T17:36:43.676638] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-30T17:36:43.676735] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-30T17:36:43.677953] [DEBUG] [LOCAL ] BKV: Trimmed 45068 records to 29775 (keeping 200 days of data) [2025-09-30T17:36:43.901381] [DEBUG] [LOCAL ] BKV: Primary data saved (29775 records). [2025-09-30T17:36:43.901537] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-30T17:36:43.901626] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKV took 31.2s. Estimated remaining: 4h 19m 4s. Rate: 8.0 symbols/min [2025-09-30T17:36:44.098855] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:44.126783] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T17:36:44.136079] [INFO ] [REMOTE ] BKU: Full fetch complete (59772 records). [2025-09-30T17:36:44.136272] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-30T17:36:44.256896] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-30T17:36:44.517525] [DEBUG] [LOCAL ] BLDR: Loaded 51635 existing records from primary storage. [2025-09-30T17:36:44.569688] [INFO ] [MAIN ] BLDR: Loaded 51635 existing records. [2025-09-30T17:36:44.681421] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-30T17:36:44.706898] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-30T17:36:44.722498] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-30T17:36:44.747331] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-30T17:36:44.875685] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T17:36:44.873673] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:44.876427] [DEBUG] [LOCAL ] BKU: Trimmed 59772 records to 41483 (keeping 200 days of data) [2025-09-30T17:36:44.883322] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-30T17:36:44.884253] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-30T17:36:44.885167] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-30T17:36:44.885238] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-30T17:36:45.076802] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-30T17:36:45.379607] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:45.419073] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T17:36:45.596125] [DEBUG] [LOCAL ] BKU: Primary data saved (41483 records). [2025-09-30T17:36:45.596269] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-30T17:36:45.596356] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKU took 40.0s. Estimated remaining: 4h 18m 16s. Rate: 8.0 symbols/min [2025-09-30T17:36:45.775094] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:45.796176] [DEBUG] [LOCAL ] BLE: Loaded 14424 existing records from primary storage. [2025-09-30T17:36:45.796438] [INFO ] [MAIN ] BLE: Loaded 14424 existing records. [2025-09-30T17:36:45.860564] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-30T17:36:45.986846] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:45.987081] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-30T17:36:45.987132] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-30T17:36:45.987431] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-30T17:36:45.987494] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-30T17:36:46.373985] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:46.393071] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T17:36:46.654402] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-30T17:36:47.365970] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T17:36:47.454391] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-30T17:36:47.774669] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T17:36:48.254385] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-30T17:36:49.031335] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T17:36:49.054371] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-30T17:36:49.164241] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:36:49.854364] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-30T17:36:50.336815] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T17:36:50.343768] [INFO ] [REMOTE ] BLCO: Full fetch complete (52868 records). [2025-09-30T17:36:50.343919] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-30T17:36:50.659438] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-30T17:36:50.787548] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-30T17:36:50.787825] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-30T17:36:50.788498] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-30T17:36:50.788562] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-30T17:36:50.789820] [DEBUG] [LOCAL ] BLCO: Trimmed 52868 records to 35436 (keeping 200 days of data) [2025-09-30T17:36:51.046413] [DEBUG] [LOCAL ] BLCO: Primary data saved (35436 records). [2025-09-30T17:36:51.046562] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-30T17:36:51.048041] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLCO took 29.5s. Estimated remaining: 4h 17m 55s. Rate: 8.0 symbols/min [2025-09-30T17:36:51.271725] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:51.334152] [DEBUG] [LOCAL ] BLK: Loaded 34520 existing records from primary storage. [2025-09-30T17:36:51.334672] [INFO ] [MAIN ] BLK: Loaded 34520 existing records. [2025-09-30T17:36:51.455371] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-30T17:36:51.588923] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T17:36:51.593587] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:51.600398] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T17:36:51.600821] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-30T17:36:51.600974] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-30T17:36:51.611889] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-30T17:36:51.611967] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-30T17:36:52.023590] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:36:52.254364] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-30T17:36:52.642106] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T17:36:53.054369] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-30T17:36:53.854353] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-30T17:36:54.057214] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T17:36:54.402595] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T17:36:54.594526] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T17:36:54.654370] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-30T17:36:55.454369] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-30T17:36:55.797849] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T17:36:56.254360] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-30T17:36:57.054349] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-30T17:36:57.195420] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T17:36:57.815317] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T17:36:57.854363] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-30T17:36:58.248193] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:36:58.254386] [INFO ] [REMOTE ] BLD: Full fetch complete (40358 records). [2025-09-30T17:36:58.254540] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-30T17:36:58.656681] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-30T17:36:58.656589] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-30T17:36:58.656845] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-30T17:36:58.658521] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-30T17:36:58.658606] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-30T17:36:58.659722] [DEBUG] [LOCAL ] BLD: Trimmed 40358 records to 27707 (keeping 200 days of data) [2025-09-30T17:36:58.857869] [DEBUG] [LOCAL ] BLD: Primary data saved (27707 records). [2025-09-30T17:36:58.858053] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-30T17:36:58.858159] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLD took 32.3s. Estimated remaining: 4h 17m 50s. Rate: 8.0 symbols/min [2025-09-30T17:36:59.059884] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:36:59.113185] [DEBUG] [LOCAL ] BLND: Loaded 49330 existing records from primary storage. [2025-09-30T17:36:59.113521] [INFO ] [MAIN ] BLND: Loaded 49330 existing records. [2025-09-30T17:36:59.323467] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:36:59.323834] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-30T17:36:59.323904] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-30T17:36:59.325234] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-30T17:36:59.325301] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-30T17:36:59.455109] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-30T17:36:59.701510] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T17:36:59.771043] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:00.254365] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-30T17:37:00.403765] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T17:37:00.818854] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T17:37:01.054362] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-30T17:37:01.854433] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-30T17:37:02.137298] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T17:37:02.355631] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T17:37:02.457971] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T17:37:02.654424] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-30T17:37:03.454366] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-30T17:37:03.571493] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T17:37:04.254366] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-30T17:37:04.740020] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T17:37:05.054360] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-30T17:37:05.202683] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T17:37:05.854368] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-30T17:37:06.348305] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T17:37:06.654376] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-30T17:37:07.454391] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-30T17:37:07.863069] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T17:37:08.254484] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-30T17:37:08.341120] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T17:37:08.341482] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T17:37:09.054369] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-30T17:37:09.854375] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-30T17:37:10.072897] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T17:37:10.654384] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-30T17:37:10.695913] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T17:37:10.764013] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T17:37:10.767345] [INFO ] [REMOTE ] BLE: Full fetch complete (20384 records). [2025-09-30T17:37:10.767491] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-30T17:37:11.183908] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-30T17:37:11.184001] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-30T17:37:11.184406] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-30T17:37:11.184479] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-30T17:37:11.185221] [DEBUG] [LOCAL ] BLE: Trimmed 20384 records to 14340 (keeping 200 days of data) [2025-09-30T17:37:11.296727] [DEBUG] [LOCAL ] BLE: Primary data saved (14340 records). [2025-09-30T17:37:11.296913] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-30T17:37:11.297092] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLE took 25.7s. Estimated remaining: 4h 18m 17s. Rate: 8.0 symbols/min [2025-09-30T17:37:11.464699] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-30T17:37:11.495188] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:11.495368] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-30T17:37:11.495405] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-30T17:37:11.495570] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-30T17:37:11.495688] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-30T17:37:11.495749] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-30T17:37:11.495784] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-30T17:37:11.886777] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:12.254466] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-30T17:37:12.441273] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:37:12.441730] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-30T17:37:12.441837] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:37:12.445163] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-09-30T17:37:12.445485] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:37:12.446080] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-30T17:37:12.447733] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T17:37:12.458498] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-30T17:37:12.459095] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-30T17:37:12.459190] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-30T17:37:12.459340] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLSH took 1.2s. Estimated remaining: 4h 17m 25s. Rate: 8.0 symbols/min [2025-09-30T17:37:12.643697] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:12.662145] [DEBUG] [LOCAL ] BLW: Loaded 12943 existing records from primary storage. [2025-09-30T17:37:12.662449] [INFO ] [MAIN ] BLW: Loaded 12943 existing records. [2025-09-30T17:37:12.852781] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:12.853160] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-30T17:37:12.853231] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-30T17:37:12.854076] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-30T17:37:12.854149] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-30T17:37:13.059505] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-30T17:37:13.243941] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T17:37:13.289379] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:13.854407] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-30T17:37:14.654382] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-30T17:37:14.849176] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T17:37:14.894590] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T17:37:15.454360] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-30T17:37:16.254406] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-30T17:37:16.452411] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:37:17.054392] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-30T17:37:17.528180] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-30T17:37:17.854345] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-30T17:37:18.192844] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T17:37:18.582574] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T17:37:18.654346] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-30T17:37:18.728815] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T17:37:19.454384] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-30T17:37:20.065373] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T17:37:20.254414] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-30T17:37:20.434413] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:37:21.054340] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-30T17:37:21.737659] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T17:37:21.854376] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-30T17:37:21.956290] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T17:37:22.654381] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-30T17:37:23.246172] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T17:37:23.254226] [INFO ] [REMOTE ] BLK: Full fetch complete (52751 records). [2025-09-30T17:37:23.254352] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-30T17:37:23.458537] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-30T17:37:23.714399] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-30T17:37:23.715269] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-30T17:37:23.715165] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T17:37:23.716329] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-30T17:37:23.721141] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-30T17:37:23.722584] [DEBUG] [LOCAL ] BLK: Trimmed 52751 records to 34458 (keeping 200 days of data) [2025-09-30T17:37:23.992776] [DEBUG] [LOCAL ] BLK: Primary data saved (34458 records). [2025-09-30T17:37:23.992926] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-30T17:37:23.995321] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLK took 32.9s. Estimated remaining: 4h 17m 46s. Rate: 8.0 symbols/min [2025-09-30T17:37:24.184241] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:24.211120] [DEBUG] [LOCAL ] BLX: Loaded 15569 existing records from primary storage. [2025-09-30T17:37:24.211381] [INFO ] [MAIN ] BLX: Loaded 15569 existing records. [2025-09-30T17:37:24.259483] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-30T17:37:24.404485] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:24.404739] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-30T17:37:24.404819] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-30T17:37:24.405446] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-30T17:37:24.405509] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-30T17:37:24.794159] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:25.054404] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-30T17:37:25.568332] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-30T17:37:25.854341] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-30T17:37:26.138098] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T17:37:26.161736] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-30T17:37:26.654411] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-30T17:37:27.291899] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T17:37:27.461548] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-30T17:37:27.490121] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T17:37:27.502032] [INFO ] [REMOTE ] BLDR: Full fetch complete (74406 records). [2025-09-30T17:37:27.502182] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-30T17:37:27.940527] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-30T17:37:27.940608] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-30T17:37:27.941396] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-30T17:37:27.941495] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-30T17:37:27.943053] [DEBUG] [LOCAL ] BLDR: Trimmed 74406 records to 51633 (keeping 200 days of data) [2025-09-30T17:37:28.254517] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-30T17:37:28.280313] [DEBUG] [LOCAL ] BLDR: Primary data saved (51633 records). [2025-09-30T17:37:28.280443] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-30T17:37:28.284793] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLDR took 44.4s. Estimated remaining: 4h 17m 17s. Rate: 8.0 symbols/min [2025-09-30T17:37:28.418707] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T17:37:28.482865] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:28.518902] [DEBUG] [LOCAL ] BMA: Loaded 35091 existing records from primary storage. [2025-09-30T17:37:28.519205] [INFO ] [MAIN ] BMA: Loaded 35091 existing records. [2025-09-30T17:37:28.701381] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:28.701612] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-30T17:37:28.701695] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-30T17:37:28.702481] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-30T17:37:28.702546] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-30T17:37:29.054390] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-30T17:37:29.081439] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:29.815936] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T17:37:29.854307] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-30T17:37:29.929270] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T17:37:29.943763] [INFO ] [REMOTE ] BLND: Full fetch complete (71898 records). [2025-09-30T17:37:29.943934] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-30T17:37:29.944902] [FATAL] [VALIDATOR ] BLND: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:37:29.945030] [FATAL] [MAIN ] BLND: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:37:29.945113] [WARN ] [MAIN ] BLND: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:37:29.945217] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-30T17:37:29.945307] [DEBUG] [LOCAL ] BLND: No primary data file found to delete. [2025-09-30T17:37:29.945350] [INFO ] [LOCAL ] BLND: Starting deletion of derivative data. [2025-09-30T17:37:29.945693] [DEBUG] [LOCAL ] BLND: Deleted derivative data file. [2025-09-30T17:37:29.945829] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLND took 31.1s. Estimated remaining: 4h 16m 30s. Rate: 8.1 symbols/min [2025-09-30T17:37:30.130913] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:30.142797] [DEBUG] [LOCAL ] BME: Loaded 10831 existing records from primary storage. [2025-09-30T17:37:30.143035] [INFO ] [MAIN ] BME: Loaded 10831 existing records. [2025-09-30T17:37:30.344334] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:30.344633] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-30T17:37:30.344751] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-30T17:37:30.345268] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-30T17:37:30.345357] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-30T17:37:30.661107] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-30T17:37:30.676005] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T17:37:30.812573] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:31.454386] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-30T17:37:32.056613] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T17:37:32.254360] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-30T17:37:32.459182] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T17:37:33.054392] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-30T17:37:33.268954] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T17:37:33.854360] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-30T17:37:34.625583] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T17:37:34.659720] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-30T17:37:34.661333] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T17:37:35.454362] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-30T17:37:35.586526] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T17:37:35.590393] [INFO ] [REMOTE ] BLW: Full fetch complete (19054 records). [2025-09-30T17:37:35.590474] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-30T17:37:35.970699] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-30T17:37:35.970793] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-30T17:37:35.971177] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-30T17:37:35.971274] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-30T17:37:35.972360] [DEBUG] [LOCAL ] BLW: Trimmed 19054 records to 12979 (keeping 200 days of data) [2025-09-30T17:37:36.056164] [DEBUG] [LOCAL ] BLW: Primary data saved (12979 records). [2025-09-30T17:37:36.056304] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-30T17:37:36.056386] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLW took 23.6s. Estimated remaining: 4h 16m 13s. Rate: 8.1 symbols/min [2025-09-30T17:37:36.240110] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:36.255881] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-30T17:37:36.269988] [DEBUG] [LOCAL ] BMEZ: Loaded 26001 existing records from primary storage. [2025-09-30T17:37:36.270445] [INFO ] [MAIN ] BMEZ: Loaded 26001 existing records. [2025-09-30T17:37:36.471208] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:36.471432] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-30T17:37:36.471514] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-30T17:37:36.483407] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-30T17:37:36.484738] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-30T17:37:36.484674] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T17:37:36.889251] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:37.054414] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-30T17:37:37.357510] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T17:37:37.846307] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T17:37:37.854307] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-30T17:37:38.600893] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T17:37:38.654388] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-30T17:37:39.454363] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-30T17:37:39.538687] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T17:37:40.254336] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-30T17:37:40.403600] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T17:37:41.054389] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-30T17:37:41.592429] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T17:37:41.854371] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-30T17:37:41.971415] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T17:37:42.654364] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-30T17:37:43.100474] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T17:37:43.454341] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-30T17:37:43.624033] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T17:37:44.254365] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-30T17:37:44.606667] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T17:37:45.054375] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-30T17:37:45.122279] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T17:37:45.854377] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-30T17:37:46.191771] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T17:37:46.195550] [INFO ] [REMOTE ] BLX: Full fetch complete (22697 records). [2025-09-30T17:37:46.195634] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-30T17:37:46.622734] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-30T17:37:46.623413] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-30T17:37:46.623694] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T17:37:46.624233] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-30T17:37:46.627190] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-30T17:37:46.628418] [DEBUG] [LOCAL ] BLX: Trimmed 22697 records to 15578 (keeping 200 days of data) [2025-09-30T17:37:46.669179] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-30T17:37:46.725327] [DEBUG] [LOCAL ] BLX: Primary data saved (15578 records). [2025-09-30T17:37:46.725481] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-30T17:37:46.725566] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BLX took 22.7s. Estimated remaining: 4h 16m 28s. Rate: 8.1 symbols/min [2025-09-30T17:37:46.901243] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:46.926162] [DEBUG] [LOCAL ] BMI: Loaded 24272 existing records from primary storage. [2025-09-30T17:37:46.926421] [INFO ] [MAIN ] BMI: Loaded 24272 existing records. [2025-09-30T17:37:47.122836] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:47.123073] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-30T17:37:47.123121] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-30T17:37:47.124118] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-30T17:37:47.124181] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-30T17:37:47.473259] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-30T17:37:47.517031] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:47.525921] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T17:37:48.254386] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-30T17:37:48.874222] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T17:37:49.054350] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-30T17:37:49.471897] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T17:37:49.854376] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-30T17:37:50.465854] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T17:37:50.654415] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-30T17:37:50.904290] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T17:37:51.346073] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T17:37:51.454371] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-30T17:37:52.254344] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-30T17:37:52.295799] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T17:37:53.054367] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-30T17:37:53.814464] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T17:37:53.856873] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-30T17:37:53.860689] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T17:37:54.654361] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-30T17:37:55.454451] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-30T17:37:55.720141] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T17:37:55.730384] [INFO ] [REMOTE ] BMA: Full fetch complete (51400 records). [2025-09-30T17:37:55.730563] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-30T17:37:56.041562] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:37:56.263563] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-30T17:37:56.266488] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-30T17:37:56.267530] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-30T17:37:56.268237] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-30T17:37:56.268427] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-30T17:37:56.269705] [DEBUG] [LOCAL ] BMA: Trimmed 51400 records to 35166 (keeping 200 days of data) [2025-09-30T17:37:56.300560] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T17:37:56.607023] [DEBUG] [LOCAL ] BMA: Primary data saved (35166 records). [2025-09-30T17:37:56.607229] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-30T17:37:56.607395] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BMA took 28.3s. Estimated remaining: 4h 16m 37s. Rate: 8.1 symbols/min [2025-09-30T17:37:56.790727] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:37:56.796070] [DEBUG] [LOCAL ] BMN: Loaded 2561 existing records from primary storage. [2025-09-30T17:37:56.796236] [INFO ] [MAIN ] BMN: Loaded 2561 existing records. [2025-09-30T17:37:56.982322] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:37:56.982568] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-30T17:37:56.982615] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-30T17:37:56.983073] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-30T17:37:56.983153] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-30T17:37:57.058454] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-30T17:37:57.376001] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:37:57.392975] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T17:37:57.854365] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-30T17:37:58.200541] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T17:37:58.654360] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-30T17:37:58.827681] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T17:37:59.354177] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T17:37:59.454359] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-30T17:38:00.254417] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-30T17:38:01.054378] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-30T17:38:01.432264] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T17:38:01.854320] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-30T17:38:02.020415] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T17:38:02.127611] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T17:38:02.654345] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-30T17:38:02.927534] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T17:38:03.454330] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-30T17:38:03.774722] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T17:38:04.144026] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T17:38:04.254369] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-30T17:38:05.054337] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-30T17:38:05.157296] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T17:38:05.854358] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-30T17:38:06.052230] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T17:38:06.654363] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-30T17:38:06.911901] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T17:38:06.915147] [INFO ] [REMOTE ] BME: Full fetch complete (16101 records). [2025-09-30T17:38:06.915351] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-30T17:38:07.338816] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-30T17:38:07.338925] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-30T17:38:07.339314] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-30T17:38:07.339362] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-30T17:38:07.339962] [DEBUG] [LOCAL ] BME: Trimmed 16101 records to 10880 (keeping 200 days of data) [2025-09-30T17:38:07.411796] [DEBUG] [LOCAL ] BME: Primary data saved (10880 records). [2025-09-30T17:38:07.411951] [INFO ] [MAIN ] BME: Full history saved. [2025-09-30T17:38:07.412045] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BME took 37.5s. Estimated remaining: 4h 16m 52s. Rate: 8.0 symbols/min [2025-09-30T17:38:07.461870] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-30T17:38:07.620686] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:07.670360] [DEBUG] [LOCAL ] BMO: Loaded 41236 existing records from primary storage. [2025-09-30T17:38:07.670952] [INFO ] [MAIN ] BMO: Loaded 41236 existing records. [2025-09-30T17:38:07.889093] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:07.889360] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-30T17:38:07.895434] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-30T17:38:07.908058] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-30T17:38:07.907982] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T17:38:07.908338] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-30T17:38:08.277638] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-30T17:38:08.364611] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:08.868486] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T17:38:09.054366] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-30T17:38:09.169165] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T17:38:09.854377] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-30T17:38:10.664800] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-30T17:38:10.697143] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T17:38:11.319910] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T17:38:11.326152] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40961 records). [2025-09-30T17:38:11.326260] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-30T17:38:11.459522] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-30T17:38:11.800257] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-30T17:38:11.800455] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-30T17:38:11.801264] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-30T17:38:11.801632] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-30T17:38:11.802909] [DEBUG] [LOCAL ] BMEZ: Trimmed 40961 records to 26164 (keeping 200 days of data) [2025-09-30T17:38:11.931808] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T17:38:12.006898] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26164 records). [2025-09-30T17:38:12.007048] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-30T17:38:12.007141] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMEZ took 36.0s. Estimated remaining: 4h 16m 25s. Rate: 8.0 symbols/min [2025-09-30T17:38:12.189572] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:12.246199] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-30T17:38:12.246587] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-09-30T17:38:12.259581] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-30T17:38:12.454336] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:12.454588] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-30T17:38:12.454639] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-30T17:38:12.457004] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-30T17:38:12.457112] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-30T17:38:12.865532] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:12.972154] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T17:38:12.975585] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T17:38:13.054341] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-30T17:38:13.656840] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T17:38:13.854384] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-30T17:38:14.654375] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-30T17:38:15.341737] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T17:38:15.454358] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-30T17:38:16.254339] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-30T17:38:16.650070] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-30T17:38:16.690292] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-30T17:38:16.981271] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T17:38:16.988045] [INFO ] [REMOTE ] BMI: Full fetch complete (32976 records). [2025-09-30T17:38:16.988179] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-30T17:38:17.063269] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-30T17:38:17.401543] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-30T17:38:17.401638] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-30T17:38:17.402205] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-30T17:38:17.402258] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-30T17:38:17.403315] [DEBUG] [LOCAL ] BMI: Trimmed 32976 records to 24271 (keeping 200 days of data) [2025-09-30T17:38:17.589201] [DEBUG] [LOCAL ] BMI: Primary data saved (24271 records). [2025-09-30T17:38:17.589345] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-30T17:38:17.589433] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMI took 30.9s. Estimated remaining: 4h 16m 5s. Rate: 8.1 symbols/min [2025-09-30T17:38:17.681224] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-30T17:38:17.777438] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:17.834939] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-09-30T17:38:17.835273] [INFO ] [MAIN ] BN: Loaded 52993 existing records. [2025-09-30T17:38:17.859489] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-30T17:38:18.034181] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:18.034436] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-30T17:38:18.034486] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-30T17:38:18.036020] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-30T17:38:18.036088] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-30T17:38:18.415810] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:18.654358] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-30T17:38:19.103809] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T17:38:19.459984] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-30T17:38:19.465710] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T17:38:19.779872] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-30T17:38:20.254377] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-30T17:38:21.054409] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-30T17:38:21.520271] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T17:38:21.854364] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-30T17:38:22.020406] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T17:38:22.318938] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T17:38:22.654364] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-30T17:38:23.454379] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-30T17:38:24.179088] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-30T17:38:24.180700] [INFO ] [REMOTE ] BMN: Full fetch complete (3721 records). [2025-09-30T17:38:24.180782] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-30T17:38:24.181189] [FATAL] [VALIDATOR ] BMN: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:38:24.181276] [FATAL] [MAIN ] BMN: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:38:24.181323] [WARN ] [MAIN ] BMN: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:38:24.181367] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-30T17:38:24.181427] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-09-30T17:38:24.181464] [INFO ] [LOCAL ] BMN: Starting deletion of derivative data. [2025-09-30T17:38:24.181733] [DEBUG] [LOCAL ] BMN: Deleted derivative data file. [2025-09-30T17:38:24.181828] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMN took 27.6s. Estimated remaining: 4h 15m 52s. Rate: 8.1 symbols/min [2025-09-30T17:38:24.259504] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-30T17:38:24.346429] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T17:38:24.441992] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:24.479429] [DEBUG] [LOCAL ] BNED: Loaded 29579 existing records from primary storage. [2025-09-30T17:38:24.479812] [INFO ] [MAIN ] BNED: Loaded 29579 existing records. [2025-09-30T17:38:24.688041] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:24.688344] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-30T17:38:24.688407] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-30T17:38:24.689451] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-30T17:38:24.689521] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-30T17:38:25.063192] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-30T17:38:25.096762] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:25.854338] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-30T17:38:26.109437] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T17:38:26.191534] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T17:38:26.654386] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-30T17:38:27.454420] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-30T17:38:27.923702] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-30T17:38:28.228384] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:38:28.254340] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-30T17:38:29.054616] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-30T17:38:29.055496] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T17:38:29.628716] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T17:38:29.854390] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-30T17:38:30.654388] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-30T17:38:30.865855] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T17:38:31.454340] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-30T17:38:31.490608] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T17:38:31.567510] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T17:38:32.254382] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-30T17:38:33.054329] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-30T17:38:33.168162] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T17:38:33.335811] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T17:38:33.854359] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-30T17:38:34.654389] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-30T17:38:34.789745] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T17:38:35.454330] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-30T17:38:35.800217] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-30T17:38:36.055011] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T17:38:36.254398] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-30T17:38:37.054378] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-30T17:38:37.601403] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-30T17:38:37.854357] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-30T17:38:38.217543] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T17:38:38.300534] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T17:38:38.654344] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-30T17:38:39.454333] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-30T17:38:39.573477] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T17:38:39.917906] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T17:38:40.254368] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-30T17:38:41.054336] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-30T17:38:41.294695] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T17:38:41.635709] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:38:41.854393] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-30T17:38:42.654358] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-30T17:38:43.159879] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T17:38:43.169272] [INFO ] [REMOTE ] BMO: Full fetch complete (59696 records). [2025-09-30T17:38:43.169397] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-30T17:38:43.468759] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-30T17:38:43.588174] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-30T17:38:43.588327] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-30T17:38:43.589050] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-30T17:38:43.589115] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-30T17:38:43.590809] [DEBUG] [LOCAL ] BMO: Trimmed 59696 records to 41237 (keeping 200 days of data) [2025-09-30T17:38:43.864958] [DEBUG] [LOCAL ] BMO: Primary data saved (41237 records). [2025-09-30T17:38:43.865263] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-30T17:38:43.865385] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 36.5s. Estimated remaining: 4h 17m 6s. Rate: 8.0 symbols/min [2025-09-30T17:38:44.062704] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:44.099080] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-30T17:38:44.112853] [DEBUG] [LOCAL ] BNH: Loaded 4916 existing records from primary storage. [2025-09-30T17:38:44.113500] [INFO ] [MAIN ] BNH: Loaded 4916 existing records. [2025-09-30T17:38:44.259470] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-30T17:38:44.322609] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:44.323600] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-30T17:38:44.323703] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-30T17:38:44.323930] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-30T17:38:44.324020] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-30T17:38:44.634777] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-30T17:38:44.818585] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:44.839911] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T17:38:45.054397] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-30T17:38:45.854367] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-30T17:38:46.443306] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T17:38:46.654378] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-30T17:38:46.798353] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T17:38:47.013934] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T17:38:47.454589] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-30T17:38:48.076006] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-30T17:38:48.254442] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-30T17:38:48.449588] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T17:38:49.054395] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-30T17:38:49.521982] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T17:38:49.528162] [INFO ] [REMOTE ] BNED: Full fetch complete (43987 records). [2025-09-30T17:38:49.528336] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-30T17:38:49.859494] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-30T17:38:49.948667] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-30T17:38:49.948761] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-30T17:38:49.949335] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-30T17:38:49.949378] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-30T17:38:49.950411] [DEBUG] [LOCAL ] BNED: Trimmed 43987 records to 29561 (keeping 200 days of data) [2025-09-30T17:38:50.157283] [DEBUG] [LOCAL ] BNED: Primary data saved (29561 records). [2025-09-30T17:38:50.157453] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-30T17:38:50.157546] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BNED took 26.0s. Estimated remaining: 4h 16m 51s. Rate: 8.0 symbols/min [2025-09-30T17:38:50.349090] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:50.354598] [DEBUG] [LOCAL ] BNJ: Loaded 2582 existing records from primary storage. [2025-09-30T17:38:50.354911] [INFO ] [MAIN ] BNJ: Loaded 2582 existing records. [2025-09-30T17:38:50.558048] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:50.558371] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-30T17:38:50.558431] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-30T17:38:50.558600] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-30T17:38:50.558692] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-30T17:38:50.659749] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-30T17:38:51.027318] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:51.054610] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T17:38:51.067551] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-30T17:38:51.070605] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-09-30T17:38:51.070858] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-30T17:38:51.222375] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-30T17:38:51.459561] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-30T17:38:51.621891] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-30T17:38:51.621975] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-30T17:38:51.622944] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-30T17:38:51.623012] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-30T17:38:51.624830] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-09-30T17:38:52.015056] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-09-30T17:38:52.015237] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-30T17:38:52.015340] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BMY took 40.0s. Estimated remaining: 4h 16m 6s. Rate: 8.0 symbols/min [2025-09-30T17:38:52.200526] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:52.251327] [DEBUG] [LOCAL ] BNL: Loaded 46846 existing records from primary storage. [2025-09-30T17:38:52.251629] [INFO ] [MAIN ] BNL: Loaded 46846 existing records. [2025-09-30T17:38:52.262998] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-30T17:38:52.435809] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:52.436010] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-30T17:38:52.436056] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-30T17:38:52.437045] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-30T17:38:52.437107] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-30T17:38:52.798759] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:52.953511] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-30T17:38:53.054398] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-30T17:38:53.671860] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-30T17:38:53.686149] [INFO ] [REMOTE ] BN: Full fetch complete (76661 records). [2025-09-30T17:38:53.686325] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-30T17:38:53.863502] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-30T17:38:54.138705] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-30T17:38:54.138807] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-30T17:38:54.139688] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-30T17:38:54.139756] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-30T17:38:54.141444] [DEBUG] [LOCAL ] BN: Trimmed 76661 records to 52993 (keeping 200 days of data) [2025-09-30T17:38:54.448464] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-30T17:38:54.450269] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T17:38:54.558377] [DEBUG] [LOCAL ] BN: Primary data saved (52993 records). [2025-09-30T17:38:54.558535] [INFO ] [MAIN ] BN: Full history saved. [2025-09-30T17:38:54.558625] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BN took 37.0s. Estimated remaining: 4h 15m 26s. Rate: 8.1 symbols/min [2025-09-30T17:38:54.659671] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-30T17:38:54.763940] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:38:54.815089] [DEBUG] [LOCAL ] BNS: Loaded 51439 existing records from primary storage. [2025-09-30T17:38:54.815445] [INFO ] [MAIN ] BNS: Loaded 51439 existing records. [2025-09-30T17:38:55.016085] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:38:55.016391] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-30T17:38:55.016452] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-30T17:38:55.017886] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-30T17:38:55.017958] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-30T17:38:55.421786] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-30T17:38:55.428684] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:38:55.454334] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-30T17:38:56.159915] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T17:38:56.254421] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-30T17:38:56.872130] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T17:38:57.054363] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-30T17:38:57.635038] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T17:38:57.854366] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-30T17:38:58.557998] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T17:38:58.654360] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-30T17:38:59.454376] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-30T17:38:59.924806] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T17:39:00.254342] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-30T17:39:00.434922] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T17:39:00.951316] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T17:39:00.952985] [INFO ] [REMOTE ] BNH: Full fetch complete (6990 records). [2025-09-30T17:39:00.953059] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-30T17:39:01.059476] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-30T17:39:01.356203] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-30T17:39:01.356283] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-30T17:39:01.356470] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-30T17:39:01.356510] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-30T17:39:01.356945] [DEBUG] [LOCAL ] BNH: Trimmed 6990 records to 5055 (keeping 200 days of data) [2025-09-30T17:39:01.390374] [DEBUG] [LOCAL ] BNH: Primary data saved (5055 records). [2025-09-30T17:39:01.390495] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-30T17:39:01.390612] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNH took 17.5s. Estimated remaining: 4h 15m 15s. Rate: 8.1 symbols/min [2025-09-30T17:39:01.584017] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:01.590351] [DEBUG] [LOCAL ] BNT: Loaded 3382 existing records from primary storage. [2025-09-30T17:39:01.590557] [INFO ] [MAIN ] BNT: Loaded 3382 existing records. [2025-09-30T17:39:01.798540] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:01.798808] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-30T17:39:01.798862] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-30T17:39:01.799377] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-30T17:39:01.799489] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-30T17:39:01.864279] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-30T17:39:02.227328] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:02.449282] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T17:39:02.654368] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-30T17:39:02.819204] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T17:39:03.454368] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-30T17:39:03.930688] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-30T17:39:04.174079] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T17:39:04.254355] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-30T17:39:04.733130] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T17:39:05.054360] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-30T17:39:05.607577] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T17:39:05.854399] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-30T17:39:06.219042] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-30T17:39:06.654347] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-30T17:39:07.213360] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T17:39:07.454407] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-30T17:39:07.898375] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-30T17:39:08.254438] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-30T17:39:08.760789] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-30T17:39:09.054406] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-30T17:39:09.854360] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-30T17:39:10.183105] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-30T17:39:10.463815] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T17:39:10.654341] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-30T17:39:11.454405] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-30T17:39:11.798276] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T17:39:12.254380] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-30T17:39:12.377998] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T17:39:12.528696] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-30T17:39:13.054392] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-30T17:39:13.854378] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-30T17:39:14.654357] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-30T17:39:14.866036] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T17:39:15.318125] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T17:39:15.429842] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T17:39:15.454332] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-30T17:39:16.064334] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T17:39:16.254370] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-30T17:39:17.054367] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-30T17:39:17.637412] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T17:39:17.638789] [INFO ] [REMOTE ] BNJ: Full fetch complete (4398 records). [2025-09-30T17:39:17.638864] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-30T17:39:17.860197] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-30T17:39:18.033937] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-30T17:39:18.034104] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-30T17:39:18.034488] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-30T17:39:18.034598] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-30T17:39:18.035181] [DEBUG] [LOCAL ] BNJ: Trimmed 4398 records to 2607 (keeping 200 days of data) [2025-09-30T17:39:18.080999] [DEBUG] [LOCAL ] BNJ: Primary data saved (2607 records). [2025-09-30T17:39:18.080885] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T17:39:18.081185] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-30T17:39:18.093144] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNJ took 27.9s. Estimated remaining: 4h 16m 8s. Rate: 8.0 symbols/min [2025-09-30T17:39:18.278500] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:18.287802] [DEBUG] [LOCAL ] BNY: Loaded 7148 existing records from primary storage. [2025-09-30T17:39:18.288063] [INFO ] [MAIN ] BNY: Loaded 7148 existing records. [2025-09-30T17:39:18.486077] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:18.486343] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-30T17:39:18.486397] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-30T17:39:18.486874] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-30T17:39:18.486938] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-30T17:39:18.656335] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-30T17:39:18.914118] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:19.331087] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T17:39:19.454352] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-30T17:39:19.617925] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T17:39:19.897659] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T17:39:20.254358] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-30T17:39:21.054405] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-30T17:39:21.854358] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-30T17:39:21.888021] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T17:39:22.613306] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T17:39:22.654338] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-30T17:39:22.761552] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T17:39:23.454403] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-30T17:39:24.254345] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-30T17:39:24.301557] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T17:39:24.336169] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T17:39:25.054370] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-30T17:39:25.736275] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T17:39:25.751154] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T17:39:25.854353] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-30T17:39:26.294080] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T17:39:26.654360] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-30T17:39:27.454404] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-30T17:39:28.110792] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-30T17:39:28.112581] [INFO ] [REMOTE ] BNT: Full fetch complete (4480 records). [2025-09-30T17:39:28.112699] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-30T17:39:28.257440] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-30T17:39:28.578119] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T17:39:28.596439] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-30T17:39:28.597175] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-30T17:39:28.597637] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-30T17:39:28.597744] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-30T17:39:28.598587] [DEBUG] [LOCAL ] BNT: Trimmed 4480 records to 3373 (keeping 200 days of data) [2025-09-30T17:39:28.622563] [DEBUG] [LOCAL ] BNT: Primary data saved (3373 records). [2025-09-30T17:39:28.622756] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-30T17:39:28.622909] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNT took 27.2s. Estimated remaining: 4h 16m 20s. Rate: 8.0 symbols/min [2025-09-30T17:39:28.810321] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:28.834031] [DEBUG] [LOCAL ] BOC: Loaded 18267 existing records from primary storage. [2025-09-30T17:39:28.834284] [INFO ] [MAIN ] BOC: Loaded 18267 existing records. [2025-09-30T17:39:28.946538] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T17:39:29.034817] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:29.035041] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-30T17:39:29.035091] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-30T17:39:29.036488] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-30T17:39:29.036570] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-30T17:39:29.059522] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-30T17:39:29.432466] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:29.854373] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-30T17:39:30.654375] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-30T17:39:30.804958] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T17:39:30.901447] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T17:39:31.454424] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-30T17:39:31.562472] [DEBUG] [REMOTE ] BNL: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-30T17:39:31.562865] [WARN ] [REMOTE ] BNL: No data returned for month 2025-07 [2025-09-30T17:39:31.562955] [FATAL] [REMOTE ] BNL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:39:31.563046] [FATAL] [MAIN ] BNL: Failed to fetch primary data. [2025-09-30T17:39:31.563116] [WARN ] [MAIN ] BNL: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:39:31.563185] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-30T17:39:31.563251] [DEBUG] [LOCAL ] BNL: No primary data file found to delete. [2025-09-30T17:39:31.563288] [INFO ] [LOCAL ] BNL: Starting deletion of derivative data. [2025-09-30T17:39:31.563547] [DEBUG] [LOCAL ] BNL: Deleted derivative data file. [2025-09-30T17:39:31.563688] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNL took 39.5s. Estimated remaining: 4h 15m 43s. Rate: 8.0 symbols/min [2025-09-30T17:39:32.247830] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T17:39:32.257930] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-30T17:39:32.259887] [INFO ] [REMOTE ] BNS: Full fetch complete (73828 records). [2025-09-30T17:39:32.260076] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-30T17:39:32.261121] [FATAL] [VALIDATOR ] BNS: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:39:32.261215] [FATAL] [MAIN ] BNS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:39:32.261285] [WARN ] [MAIN ] BNS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:39:32.261366] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-30T17:39:32.261439] [DEBUG] [LOCAL ] BNS: No primary data file found to delete. [2025-09-30T17:39:32.261477] [INFO ] [LOCAL ] BNS: Starting deletion of derivative data. [2025-09-30T17:39:32.261803] [DEBUG] [LOCAL ] BNS: Deleted derivative data file. [2025-09-30T17:39:32.261939] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNS took 37.7s. Estimated remaining: 4h 14m 52s. Rate: 8.1 symbols/min [2025-09-30T17:39:33.054353] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-30T17:39:33.226520] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T17:39:33.799109] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T17:39:33.854362] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-30T17:39:34.505084] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-30T17:39:34.654390] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-30T17:39:35.454468] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-30T17:39:35.521125] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T17:39:36.155086] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-30T17:39:36.254366] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-30T17:39:37.054457] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-30T17:39:37.250909] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T17:39:37.516597] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-30T17:39:37.854443] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-30T17:39:38.598409] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T17:39:38.654339] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-30T17:39:39.349899] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-30T17:39:39.454438] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-30T17:39:40.254460] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-30T17:39:40.509140] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T17:39:41.054369] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-30T17:39:41.151274] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T17:39:41.153338] [INFO ] [REMOTE ] BNY: Full fetch complete (10417 records). [2025-09-30T17:39:41.153420] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-30T17:39:41.583880] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-30T17:39:41.584005] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-30T17:39:41.584565] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-30T17:39:41.584679] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-30T17:39:41.585431] [DEBUG] [LOCAL ] BNY: Trimmed 10417 records to 7119 (keeping 200 days of data) [2025-09-30T17:39:41.631827] [DEBUG] [LOCAL ] BNY: Primary data saved (7119 records). [2025-09-30T17:39:41.631976] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-30T17:39:41.632067] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNY took 23.5s. Estimated remaining: 4h 14m 57s. Rate: 8.0 symbols/min [2025-09-30T17:39:41.883676] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T17:39:41.887593] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-30T17:39:42.867873] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T17:39:42.872253] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-30T17:39:43.850871] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T17:39:43.856072] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-30T17:39:44.633810] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T17:39:44.639137] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-30T17:39:45.868396] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T17:39:45.872487] [INFO ] [REMOTE ] BOC: Full fetch complete (25791 records). [2025-09-30T17:39:45.872579] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-30T17:39:46.257843] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-30T17:39:46.257933] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-30T17:39:46.258434] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-30T17:39:46.258500] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-30T17:39:46.259294] [DEBUG] [LOCAL ] BOC: Trimmed 25791 records to 18278 (keeping 200 days of data) [2025-09-30T17:39:46.372393] [DEBUG] [LOCAL ] BOC: Primary data saved (18278 records). [2025-09-30T17:39:46.372536] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-30T17:39:46.372617] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 17.7s. Estimated remaining: 4h 14m 32s. Rate: 8.1 symbols/min [2025-09-30T17:39:47.131717] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:47.134983] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:47.165997] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:47.139150] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:39:47.218365] [DEBUG] [LOCAL ] BOE: Loaded 17601 existing records from primary storage. [2025-09-30T17:39:47.226926] [DEBUG] [LOCAL ] BOND: Loaded 32075 existing records from primary storage. [2025-09-30T17:39:47.227412] [INFO ] [MAIN ] BOE: Loaded 17601 existing records. [2025-09-30T17:39:47.239258] [INFO ] [MAIN ] BOND: Loaded 32075 existing records. [2025-09-30T17:39:47.409190] [DEBUG] [LOCAL ] BOH: Loaded 30949 existing records from primary storage. [2025-09-30T17:39:47.461598] [INFO ] [MAIN ] BOH: Loaded 30949 existing records. [2025-09-30T17:39:47.657543] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:47.683701] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-30T17:39:47.706081] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-30T17:39:47.764566] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:47.752692] [DEBUG] [LOCAL ] BOOT: Loaded 40631 existing records from primary storage. [2025-09-30T17:39:47.765074] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-30T17:39:47.765185] [INFO ] [MAIN ] BOOT: Loaded 40631 existing records. [2025-09-30T17:39:47.770488] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-30T17:39:47.775799] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-30T17:39:47.775876] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-30T17:39:48.040596] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:48.000978] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-30T17:39:48.076172] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-30T17:39:48.099279] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-30T17:39:48.122193] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-30T17:39:48.277864] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-30T17:39:48.352827] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-30T17:39:48.390392] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:39:48.560504] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-30T17:39:48.747106] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-30T17:39:48.927404] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-30T17:39:49.022788] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-30T17:39:49.086924] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:49.175302] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:49.215960] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-30T17:39:49.268597] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-30T17:39:49.567889] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:49.598348] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-30T17:39:49.787876] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:39:49.788229] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-30T17:39:50.369942] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T17:39:50.377031] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-30T17:39:50.482561] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T17:39:50.487587] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-30T17:39:50.848618] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T17:39:50.857216] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-30T17:39:51.012360] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T17:39:51.018626] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-30T17:39:51.293869] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T17:39:51.454389] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-30T17:39:51.506840] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T17:39:52.160548] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T17:39:52.222233] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:39:52.254340] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-30T17:39:52.396194] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T17:39:53.054338] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-30T17:39:53.286614] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T17:39:53.854386] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-30T17:39:54.654353] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-30T17:39:54.720179] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T17:39:54.885415] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T17:39:55.454360] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-30T17:39:55.836578] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T17:39:56.254355] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-30T17:39:56.457005] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T17:39:57.054356] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-30T17:39:57.582161] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T17:39:57.854395] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-30T17:39:58.170963] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T17:39:58.654391] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-30T17:39:59.454333] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-30T17:39:59.556049] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T17:39:59.582566] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T17:40:00.254372] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-30T17:40:01.054328] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-30T17:40:01.308776] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T17:40:01.854369] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-30T17:40:02.654337] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-30T17:40:02.792799] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T17:40:02.882402] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-30T17:40:02.959986] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T17:40:03.454354] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-30T17:40:03.956379] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:40:04.081971] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T17:40:04.254330] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-30T17:40:05.054357] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-30T17:40:05.854337] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-30T17:40:06.058961] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:40:06.066304] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T17:40:06.654422] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-30T17:40:07.101337] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T17:40:07.454363] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-30T17:40:07.759504] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:40:08.254325] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-30T17:40:08.366369] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T17:40:09.054404] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-30T17:40:09.601299] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T17:40:09.840743] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T17:40:09.854309] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-30T17:40:10.654477] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-30T17:40:11.166920] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T17:40:11.454422] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-30T17:40:12.072253] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-30T17:40:12.254384] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-30T17:40:13.054461] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-30T17:40:13.324347] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T17:40:13.804747] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T17:40:13.854402] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-30T17:40:14.026528] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T17:40:14.654408] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-30T17:40:15.326474] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T17:40:15.335046] [INFO ] [REMOTE ] BOOT: Full fetch complete (60257 records). [2025-09-30T17:40:15.335368] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-30T17:40:15.459579] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-30T17:40:15.735535] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-30T17:40:15.735717] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-30T17:40:15.736682] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-30T17:40:15.736896] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-30T17:40:15.738865] [DEBUG] [LOCAL ] BOOT: Trimmed 60257 records to 40594 (keeping 200 days of data) [2025-09-30T17:40:16.000402] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T17:40:16.012705] [INFO ] [REMOTE ] BOH: Full fetch complete (44721 records). [2025-09-30T17:40:16.013457] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-30T17:40:16.015126] [FATAL] [VALIDATOR ] BOH: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:40:16.015635] [FATAL] [MAIN ] BOH: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:40:16.015736] [WARN ] [MAIN ] BOH: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:40:16.015787] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-30T17:40:16.016244] [DEBUG] [LOCAL ] BOH: No primary data file found to delete. [2025-09-30T17:40:16.016689] [INFO ] [LOCAL ] BOH: Starting deletion of derivative data. [2025-09-30T17:40:16.017156] [DEBUG] [LOCAL ] BOH: Deleted derivative data file. [2025-09-30T17:40:16.017322] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOH took 29.6s. Estimated remaining: 4h 16m 46s. Rate: 8.0 symbols/min [2025-09-30T17:40:16.208669] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:16.258750] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-30T17:40:16.261520] [DEBUG] [LOCAL ] BOOT: Primary data saved (40594 records). [2025-09-30T17:40:16.261722] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-30T17:40:16.262200] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOOT took 29.9s. Estimated remaining: 4h 15m 53s. Rate: 8.0 symbols/min [2025-09-30T17:40:16.412438] [DEBUG] [LOCAL ] BORR: Loaded 51131 existing records from primary storage. [2025-09-30T17:40:16.426503] [INFO ] [MAIN ] BORR: Loaded 51131 existing records. [2025-09-30T17:40:16.640461] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:16.712531] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:16.713466] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-30T17:40:16.713598] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-30T17:40:16.713995] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-30T17:40:16.714213] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-30T17:40:16.867519] [DEBUG] [LOCAL ] BOW: Loaded 23476 existing records from primary storage. [2025-09-30T17:40:16.889228] [INFO ] [MAIN ] BOW: Loaded 23476 existing records. [2025-09-30T17:40:17.293293] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:17.321951] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-30T17:40:17.361742] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:17.382863] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-30T17:40:17.383266] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-30T17:40:17.384616] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T17:40:17.384725] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-30T17:40:17.391846] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-30T17:40:17.446586] [INFO ] [REMOTE ] BOND: Full fetch complete (46408 records). [2025-09-30T17:40:17.483555] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-30T17:40:18.118378] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:18.139369] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-30T17:40:18.279780] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-30T17:40:18.279867] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-30T17:40:18.280437] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-30T17:40:18.280480] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-30T17:40:18.281688] [DEBUG] [LOCAL ] BOND: Trimmed 46408 records to 32125 (keeping 200 days of data) [2025-09-30T17:40:18.506788] [DEBUG] [LOCAL ] BOND: Primary data saved (32125 records). [2025-09-30T17:40:18.506945] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-30T17:40:18.507033] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOND took 32.1s. Estimated remaining: 4h 15m 12s. Rate: 8.0 symbols/min [2025-09-30T17:40:18.705765] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:18.763095] [DEBUG] [LOCAL ] BOX: Loaded 50244 existing records from primary storage. [2025-09-30T17:40:18.763447] [INFO ] [MAIN ] BOX: Loaded 50244 existing records. [2025-09-30T17:40:19.005957] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:19.006354] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-30T17:40:19.006415] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-30T17:40:19.008365] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-30T17:40:19.008430] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-30T17:40:19.442742] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:19.443317] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-30T17:40:19.498837] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-30T17:40:19.510409] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-30T17:40:20.378700] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (4.12 seconds). [2025-09-30T17:40:20.383536] [INFO ] [REMOTE ] BOE: Full fetch complete (26486 records). [2025-09-30T17:40:20.383690] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-30T17:40:20.384233] [FATAL] [VALIDATOR ] BOE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:40:20.384324] [FATAL] [MAIN ] BOE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:40:20.384384] [WARN ] [MAIN ] BOE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:40:20.384475] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-30T17:40:20.384550] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-09-30T17:40:20.384593] [INFO ] [LOCAL ] BOE: Starting deletion of derivative data. [2025-09-30T17:40:20.384782] [DEBUG] [LOCAL ] BOE: Deleted derivative data file. [2025-09-30T17:40:20.384878] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOE took 34.0s. Estimated remaining: 4h 14m 29s. Rate: 8.0 symbols/min [2025-09-30T17:40:20.582840] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:20.644582] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-30T17:40:20.645050] [INFO ] [MAIN ] BP: Loaded 53711 existing records. [2025-09-30T17:40:20.843896] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:20.844130] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-30T17:40:20.844179] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-30T17:40:20.844448] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-30T17:40:20.844508] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-30T17:40:21.267378] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:21.268740] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-30T17:40:21.285734] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (3.15 seconds). [2025-09-30T17:40:21.290928] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-30T17:40:21.337559] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T17:40:21.854416] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-30T17:40:22.270174] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T17:40:22.330972] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-30T17:40:22.654371] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-30T17:40:23.091977] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T17:40:23.454373] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-30T17:40:23.488410] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T17:40:23.618230] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T17:40:24.254390] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-30T17:40:25.054332] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-30T17:40:25.511544] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-30T17:40:25.512700] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-30T17:40:25.854408] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-30T17:40:26.654325] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-30T17:40:26.852136] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T17:40:27.223403] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T17:40:27.454364] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-30T17:40:28.254345] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-30T17:40:28.387291] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T17:40:29.044719] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T17:40:29.054308] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-30T17:40:29.371154] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T17:40:29.854378] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-30T17:40:30.052280] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T17:40:30.654377] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-30T17:40:31.454380] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-30T17:40:32.098471] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-30T17:40:32.254336] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-30T17:40:32.358286] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T17:40:32.489017] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T17:40:33.054375] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-30T17:40:33.854330] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-30T17:40:33.888131] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:40:34.274453] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T17:40:34.654332] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-30T17:40:35.454382] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-30T17:40:35.847273] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:40:35.853288] [INFO ] [REMOTE ] BOW: Full fetch complete (31272 records). [2025-09-30T17:40:35.853454] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-30T17:40:36.256052] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-30T17:40:36.255849] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-30T17:40:36.257229] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-30T17:40:36.257801] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-30T17:40:36.257898] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-30T17:40:36.259196] [DEBUG] [LOCAL ] BOW: Trimmed 31272 records to 23531 (keeping 200 days of data) [2025-09-30T17:40:36.380240] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-30T17:40:36.462402] [DEBUG] [LOCAL ] BOW: Primary data saved (23531 records). [2025-09-30T17:40:36.462543] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-30T17:40:36.462632] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 20.2s. Estimated remaining: 4h 15m 16s. Rate: 8.0 symbols/min [2025-09-30T17:40:36.651263] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:36.689077] [DEBUG] [LOCAL ] BR: Loaded 34585 existing records from primary storage. [2025-09-30T17:40:36.689490] [INFO ] [MAIN ] BR: Loaded 34585 existing records. [2025-09-30T17:40:36.881257] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:36.881681] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-30T17:40:36.881765] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-30T17:40:36.882934] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-30T17:40:36.882998] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-30T17:40:37.069726] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-30T17:40:37.224788] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T17:40:37.328238] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:37.854331] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-30T17:40:38.208481] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T17:40:38.654370] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-30T17:40:39.160464] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-30T17:40:39.454358] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-30T17:40:39.501564] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:40:40.170049] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T17:40:40.254335] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-30T17:40:41.054354] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-30T17:40:41.510229] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-30T17:40:41.854368] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-30T17:40:41.953487] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:40:42.416398] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T17:40:42.654390] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-30T17:40:43.454346] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-30T17:40:43.599255] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T17:40:43.663065] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T17:40:44.254372] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-30T17:40:45.054381] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-30T17:40:45.293110] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T17:40:45.854367] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-30T17:40:46.472143] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T17:40:46.578750] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-30T17:40:46.654331] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-30T17:40:47.125172] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T17:40:47.454364] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-30T17:40:48.254358] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-30T17:40:48.745191] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T17:40:48.758007] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-09-30T17:40:48.758168] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-30T17:40:49.059439] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-30T17:40:49.223868] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-30T17:40:49.223986] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-30T17:40:49.224967] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-30T17:40:49.225187] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-30T17:40:49.271246] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:40:49.285220] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 53711 (keeping 200 days of data) [2025-09-30T17:40:49.710939] [DEBUG] [LOCAL ] BP: Primary data saved (53711 records). [2025-09-30T17:40:49.711212] [INFO ] [MAIN ] BP: Full history saved. [2025-09-30T17:40:49.711368] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BP took 29.3s. Estimated remaining: 4h 15m 44s. Rate: 8.0 symbols/min [2025-09-30T17:40:49.859531] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-30T17:40:50.071581] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:50.075368] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T17:40:50.159889] [DEBUG] [LOCAL ] BRBR: Loaded 51250 existing records from primary storage. [2025-09-30T17:40:50.160524] [INFO ] [MAIN ] BRBR: Loaded 51250 existing records. [2025-09-30T17:40:50.413539] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:50.414253] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-30T17:40:50.414391] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-30T17:40:50.423867] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-30T17:40:50.440370] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-30T17:40:50.449132] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T17:40:50.668468] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-30T17:40:50.885033] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:51.454345] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-30T17:40:51.533721] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T17:40:52.248051] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T17:40:52.255755] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-30T17:40:53.054350] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-30T17:40:53.101228] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T17:40:53.854423] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-30T17:40:53.901475] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T17:40:53.913326] [INFO ] [REMOTE ] BOX: Full fetch complete (72077 records). [2025-09-30T17:40:53.913510] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-30T17:40:54.345455] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-30T17:40:54.345571] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-30T17:40:54.346482] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-30T17:40:54.346575] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-30T17:40:54.348735] [DEBUG] [LOCAL ] BOX: Trimmed 72077 records to 50231 (keeping 200 days of data) [2025-09-30T17:40:54.478187] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T17:40:54.500744] [INFO ] [REMOTE ] BORR: Full fetch complete (74695 records). [2025-09-30T17:40:54.501703] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-30T17:40:54.656968] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-30T17:40:55.112154] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-30T17:40:55.112912] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-30T17:40:55.114052] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-30T17:40:55.122811] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-30T17:40:55.153861] [DEBUG] [LOCAL ] BORR: Trimmed 74695 records to 51149 (keeping 200 days of data) [2025-09-30T17:40:55.248881] [DEBUG] [LOCAL ] BOX: Primary data saved (50231 records). [2025-09-30T17:40:55.271582] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-30T17:40:55.304889] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BOX took 36.8s. Estimated remaining: 4h 15m 25s. Rate: 8.0 symbols/min [2025-09-30T17:40:55.344712] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:40:55.456353] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-30T17:40:55.529957] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:55.561025] [DEBUG] [LOCAL ] BRC: Loaded 19180 existing records from primary storage. [2025-09-30T17:40:55.562107] [INFO ] [MAIN ] BRC: Loaded 19180 existing records. [2025-09-30T17:40:55.783875] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:55.786342] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-30T17:40:55.786472] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-30T17:40:55.786798] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-30T17:40:55.786862] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-30T17:40:56.331377] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:56.334104] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T17:40:56.334497] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-30T17:40:56.425812] [DEBUG] [LOCAL ] BORR: Primary data saved (51149 records). [2025-09-30T17:40:56.425956] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-30T17:40:56.426931] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BORR took 40.4s. Estimated remaining: 4h 14m 38s. Rate: 8.0 symbols/min [2025-09-30T17:40:56.608746] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:40:56.636011] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T17:40:56.690334] [DEBUG] [LOCAL ] BRCC: Loaded 40218 existing records from primary storage. [2025-09-30T17:40:56.690762] [INFO ] [MAIN ] BRCC: Loaded 40218 existing records. [2025-09-30T17:40:56.920458] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:40:56.920684] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-30T17:40:56.920743] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-30T17:40:56.921540] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-30T17:40:56.921603] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-30T17:40:57.059432] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-30T17:40:57.320303] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:40:57.630000] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T17:40:57.854406] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-30T17:40:58.389721] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T17:40:58.654370] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-30T17:40:59.454377] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-30T17:40:59.503677] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T17:40:59.599050] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T17:41:00.254347] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-30T17:41:00.699732] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T17:41:01.054366] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-30T17:41:01.850463] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T17:41:01.858958] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-30T17:41:02.134252] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T17:41:02.654377] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-30T17:41:03.454390] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-30T17:41:03.624815] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T17:41:04.084384] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T17:41:04.254361] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-30T17:41:04.737841] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T17:41:05.054388] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-30T17:41:05.553664] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T17:41:05.854419] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-30T17:41:06.563415] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T17:41:06.654371] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-30T17:41:07.065909] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T17:41:07.454404] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-30T17:41:08.031132] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T17:41:08.254399] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-30T17:41:09.039560] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T17:41:09.048785] [INFO ] [REMOTE ] BR: Full fetch complete (49177 records). [2025-09-30T17:41:09.048939] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-30T17:41:09.059534] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-30T17:41:09.563057] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T17:41:09.562033] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-30T17:41:09.563206] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-30T17:41:09.568926] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-30T17:41:09.569332] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-30T17:41:09.570449] [DEBUG] [LOCAL ] BR: Trimmed 49177 records to 34609 (keeping 200 days of data) [2025-09-30T17:41:09.812432] [DEBUG] [LOCAL ] BR: Primary data saved (34609 records). [2025-09-30T17:41:09.812582] [INFO ] [MAIN ] BR: Full history saved. [2025-09-30T17:41:09.812692] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BR took 33.3s. Estimated remaining: 4h 15m 7s. Rate: 8.0 symbols/min [2025-09-30T17:41:09.859549] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-30T17:41:10.000777] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:10.055848] [DEBUG] [LOCAL ] BRO: Loaded 51890 existing records from primary storage. [2025-09-30T17:41:10.056196] [INFO ] [MAIN ] BRO: Loaded 51890 existing records. [2025-09-30T17:41:10.296927] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:10.298084] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-30T17:41:10.298189] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-30T17:41:10.298631] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-30T17:41:10.298755] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-30T17:41:10.660034] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-30T17:41:10.758925] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:10.781030] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T17:41:11.454335] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-30T17:41:11.508777] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:41:11.920432] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T17:41:12.254369] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-30T17:41:12.961901] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T17:41:13.054423] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-30T17:41:13.117517] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T17:41:13.854406] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-30T17:41:14.654379] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-30T17:41:14.802582] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T17:41:14.864806] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T17:41:15.454355] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-30T17:41:16.254422] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-30T17:41:16.636694] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-30T17:41:17.059543] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-30T17:41:17.072432] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T17:41:17.796280] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T17:41:17.854419] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-30T17:41:18.387079] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T17:41:18.654445] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-30T17:41:18.961228] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T17:41:18.966046] [INFO ] [REMOTE ] BRC: Full fetch complete (29052 records). [2025-09-30T17:41:18.966190] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-30T17:41:19.372069] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-30T17:41:19.372154] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-30T17:41:19.372666] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-30T17:41:19.372736] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-30T17:41:19.373514] [DEBUG] [LOCAL ] BRC: Trimmed 29052 records to 19102 (keeping 200 days of data) [2025-09-30T17:41:19.462784] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-30T17:41:19.502631] [DEBUG] [LOCAL ] BRC: Primary data saved (19102 records). [2025-09-30T17:41:19.502860] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-30T17:41:19.502965] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRC took 24.2s. Estimated remaining: 4h 15m 13s. Rate: 8.0 symbols/min [2025-09-30T17:41:19.692132] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:19.751975] [DEBUG] [LOCAL ] BROS: Loaded 53289 existing records from primary storage. [2025-09-30T17:41:19.752382] [INFO ] [MAIN ] BROS: Loaded 53289 existing records. [2025-09-30T17:41:19.962592] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:19.962841] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-30T17:41:19.962891] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-30T17:41:19.963181] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-30T17:41:19.963240] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-30T17:41:20.256491] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-30T17:41:20.410312] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:20.498495] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T17:41:21.054348] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-30T17:41:21.158730] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T17:41:21.775236] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T17:41:21.854384] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-30T17:41:22.654406] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-30T17:41:22.877830] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T17:41:23.454332] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-30T17:41:23.864732] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T17:41:23.936699] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-30T17:41:23.948409] [INFO ] [REMOTE ] BRBR: Full fetch complete (71966 records). [2025-09-30T17:41:23.948582] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-30T17:41:24.260885] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-30T17:41:24.375619] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-30T17:41:24.375747] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-30T17:41:24.376521] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-30T17:41:24.376629] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-30T17:41:24.378216] [DEBUG] [LOCAL ] BRBR: Trimmed 71966 records to 51262 (keeping 200 days of data) [2025-09-30T17:41:24.729379] [DEBUG] [LOCAL ] BRBR: Primary data saved (51262 records). [2025-09-30T17:41:24.729943] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-30T17:41:24.730146] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRBR took 35.0s. Estimated remaining: 4h 14m 52s. Rate: 8.0 symbols/min [2025-09-30T17:41:24.914825] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:24.915169] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-30T17:41:24.915293] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-30T17:41:24.915426] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-30T17:41:24.915469] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-30T17:41:24.915518] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-30T17:41:24.915553] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-30T17:41:25.064284] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-30T17:41:25.314919] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:25.351017] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T17:41:25.854420] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-30T17:41:26.364737] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-30T17:41:26.654444] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-30T17:41:26.731911] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T17:41:26.750581] [INFO ] [REMOTE ] BRCC: Full fetch complete (57806 records). [2025-09-30T17:41:26.750812] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-30T17:41:27.180862] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-30T17:41:27.181004] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-30T17:41:27.181803] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-30T17:41:27.181871] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-30T17:41:27.183163] [DEBUG] [LOCAL ] BRCC: Trimmed 57806 records to 40248 (keeping 200 days of data) [2025-09-30T17:41:27.331637] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T17:41:27.454487] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-30T17:41:27.491207] [DEBUG] [LOCAL ] BRCC: Primary data saved (40248 records). [2025-09-30T17:41:27.491338] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-30T17:41:27.492580] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRCC took 31.1s. Estimated remaining: 4h 14m 15s. Rate: 8.0 symbols/min [2025-09-30T17:41:27.667438] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:41:27.686500] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-30T17:41:27.691381] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:27.691613] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:41:27.692403] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-09-30T17:41:27.692483] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:41:27.692557] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-30T17:41:27.692633] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-30T17:41:27.692765] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-30T17:41:27.692846] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-30T17:41:27.692939] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRSL took 3.0s. Estimated remaining: 4h 13m 23s. Rate: 8.0 symbols/min [2025-09-30T17:41:27.896994] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:27.912795] [DEBUG] [LOCAL ] BRSP: Loaded 36849 existing records from primary storage. [2025-09-30T17:41:27.914776] [INFO ] [MAIN ] BRSP: Loaded 36849 existing records. [2025-09-30T17:41:28.000718] [DEBUG] [LOCAL ] BRT: Loaded 4966 existing records from primary storage. [2025-09-30T17:41:28.015262] [INFO ] [MAIN ] BRT: Loaded 4966 existing records. [2025-09-30T17:41:28.273034] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-30T17:41:28.280776] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:28.282151] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-30T17:41:28.282235] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-30T17:41:28.310166] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-30T17:41:28.310350] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-30T17:41:28.372735] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:28.396069] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-30T17:41:28.396188] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-30T17:41:28.425011] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-30T17:41:28.446492] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-30T17:41:29.090288] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:29.102815] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-30T17:41:29.233474] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:29.237430] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-30T17:41:29.809887] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T17:41:29.854412] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-30T17:41:30.146474] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T17:41:30.654366] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-30T17:41:31.454426] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-30T17:41:31.837366] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-30T17:41:31.982236] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T17:41:32.176740] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-30T17:41:32.254400] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-30T17:41:33.054380] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-30T17:41:33.422097] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T17:41:33.854385] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-30T17:41:34.654384] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-30T17:41:35.048126] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T17:41:35.454366] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-30T17:41:35.844854] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T17:41:36.005854] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-30T17:41:36.254395] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-30T17:41:37.054400] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-30T17:41:37.381412] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T17:41:37.854379] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-30T17:41:38.492625] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-30T17:41:38.532565] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T17:41:38.654401] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-30T17:41:39.445272] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T17:41:39.456052] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-30T17:41:39.459042] [INFO ] [REMOTE ] BRO: Full fetch complete (74211 records). [2025-09-30T17:41:39.459237] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-30T17:41:39.954587] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-30T17:41:39.954741] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-30T17:41:39.955667] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-30T17:41:39.955770] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-30T17:41:39.960695] [DEBUG] [LOCAL ] BRO: Trimmed 74211 records to 51886 (keeping 200 days of data) [2025-09-30T17:41:40.275225] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-30T17:41:40.334878] [DEBUG] [LOCAL ] BRO: Primary data saved (51886 records). [2025-09-30T17:41:40.335026] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-30T17:41:40.335255] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRO took 30.5s. Estimated remaining: 4h 13m 47s. Rate: 8.0 symbols/min [2025-09-30T17:41:40.532098] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:40.554935] [DEBUG] [LOCAL ] BRW: Loaded 19790 existing records from primary storage. [2025-09-30T17:41:40.555200] [INFO ] [MAIN ] BRW: Loaded 19790 existing records. [2025-09-30T17:41:40.756689] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:40.757780] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-30T17:41:40.762846] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-30T17:41:40.763557] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T17:41:40.763767] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-30T17:41:40.765735] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-30T17:41:40.905421] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:41:41.005637] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-30T17:41:41.059404] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-30T17:41:41.255365] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:41.854424] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-30T17:41:42.654888] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-30T17:41:42.708116] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T17:41:43.141494] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T17:41:43.454388] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-30T17:41:44.233116] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T17:41:44.235351] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T17:41:44.254328] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-30T17:41:45.054373] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-30T17:41:45.655579] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T17:41:45.854347] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-30T17:41:46.255317] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T17:41:46.654404] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-30T17:41:46.769699] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T17:41:47.454410] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-30T17:41:47.464050] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T17:41:48.254388] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-30T17:41:48.717491] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T17:41:48.977070] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T17:41:49.054390] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-30T17:41:49.620768] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T17:41:49.854405] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-30T17:41:50.426685] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T17:41:50.654386] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-30T17:41:51.454375] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-30T17:41:52.153860] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T17:41:52.254400] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-30T17:41:52.435045] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:41:53.054372] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-30T17:41:53.854329] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-30T17:41:54.183447] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T17:41:54.537523] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T17:41:54.563237] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T17:41:54.571557] [INFO ] [REMOTE ] BRSP: Full fetch complete (54182 records). [2025-09-30T17:41:54.571795] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-30T17:41:54.659543] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-30T17:41:54.999900] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-30T17:41:55.000042] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-30T17:41:55.000771] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-30T17:41:55.000856] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-30T17:41:55.002258] [DEBUG] [LOCAL ] BRSP: Trimmed 54182 records to 36799 (keeping 200 days of data) [2025-09-30T17:41:55.220031] [DEBUG] [LOCAL ] BRSP: Primary data saved (36799 records). [2025-09-30T17:41:55.220184] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-30T17:41:55.220834] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRSP took 27.7s. Estimated remaining: 4h 14m 25s. Rate: 8.0 symbols/min [2025-09-30T17:41:55.420406] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:55.460456] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-30T17:41:55.483629] [DEBUG] [LOCAL ] BRX: Loaded 51703 existing records from primary storage. [2025-09-30T17:41:55.484025] [INFO ] [MAIN ] BRX: Loaded 51703 existing records. [2025-09-30T17:41:55.686398] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:55.686809] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-30T17:41:55.686911] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-30T17:41:55.688426] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-30T17:41:55.688488] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-30T17:41:55.838859] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T17:41:56.107047] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:56.160068] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T17:41:56.161895] [INFO ] [REMOTE ] BRT: Full fetch complete (6797 records). [2025-09-30T17:41:56.161988] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-30T17:41:56.259553] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-30T17:41:56.592971] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-30T17:41:56.593063] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-30T17:41:56.593325] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-30T17:41:56.593398] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-30T17:41:56.593897] [DEBUG] [LOCAL ] BRT: Trimmed 6797 records to 4982 (keeping 200 days of data) [2025-09-30T17:41:56.625627] [DEBUG] [LOCAL ] BRT: Primary data saved (4982 records). [2025-09-30T17:41:56.625749] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-30T17:41:56.625853] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRT took 28.9s. Estimated remaining: 4h 13m 40s. Rate: 8.0 symbols/min [2025-09-30T17:41:56.841764] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:41:56.883758] [DEBUG] [LOCAL ] BSAC: Loaded 32849 existing records from primary storage. [2025-09-30T17:41:56.884050] [INFO ] [MAIN ] BSAC: Loaded 32849 existing records. [2025-09-30T17:41:57.054519] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-30T17:41:57.081074] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:41:57.081481] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-30T17:41:57.081532] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-30T17:41:57.081936] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-30T17:41:57.081999] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-30T17:41:57.461834] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:41:57.857808] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-30T17:41:57.862194] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T17:41:58.075292] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T17:41:58.654370] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-30T17:41:58.983437] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T17:41:59.454415] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-30T17:41:59.900956] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T17:42:00.254344] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-30T17:42:00.397890] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T17:42:01.054407] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-30T17:42:01.854342] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-30T17:42:02.095691] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T17:42:02.303509] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-30T17:42:02.321676] [INFO ] [REMOTE ] BROS: Full fetch complete (77015 records). [2025-09-30T17:42:02.321895] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-30T17:42:02.658627] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-30T17:42:02.778614] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-30T17:42:02.778804] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-30T17:42:02.779700] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-30T17:42:02.779765] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-30T17:42:02.781392] [DEBUG] [LOCAL ] BROS: Trimmed 77015 records to 53289 (keeping 200 days of data) [2025-09-30T17:42:02.807141] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T17:42:03.187705] [DEBUG] [LOCAL ] BROS: Primary data saved (53289 records). [2025-09-30T17:42:03.187971] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-30T17:42:03.189738] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BROS took 43.7s. Estimated remaining: 4h 13m 27s. Rate: 8.0 symbols/min [2025-09-30T17:42:03.405167] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:03.447579] [DEBUG] [LOCAL ] BSBR: Loaded 35252 existing records from primary storage. [2025-09-30T17:42:03.448001] [INFO ] [MAIN ] BSBR: Loaded 35252 existing records. [2025-09-30T17:42:03.459611] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-30T17:42:03.649412] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:03.649713] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-30T17:42:03.649774] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-30T17:42:03.650858] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-30T17:42:03.650948] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-30T17:42:04.067117] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T17:42:04.071312] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:04.254377] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-30T17:42:05.054395] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-30T17:42:05.209899] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T17:42:05.276835] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T17:42:05.854412] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-30T17:42:06.421507] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T17:42:06.654404] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-30T17:42:07.119585] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T17:42:07.454376] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-30T17:42:08.064958] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T17:42:08.254399] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-30T17:42:08.337097] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T17:42:09.054382] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-30T17:42:09.854379] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-30T17:42:10.180211] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T17:42:10.218984] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T17:42:10.654417] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-30T17:42:11.232221] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:42:11.454394] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-30T17:42:11.949042] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T17:42:12.254398] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-30T17:42:12.364431] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T17:42:13.054411] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-30T17:42:13.388488] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T17:42:13.854371] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-30T17:42:14.084885] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T17:42:14.654429] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-30T17:42:14.865014] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T17:42:15.454379] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-30T17:42:16.157544] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T17:42:16.254414] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-30T17:42:17.054355] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-30T17:42:17.100960] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:42:17.484040] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T17:42:17.854367] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-30T17:42:18.144343] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T17:42:18.654427] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-30T17:42:19.463033] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-30T17:42:19.469074] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T17:42:19.802749] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-30T17:42:19.809799] [INFO ] [REMOTE ] BRW: Full fetch complete (30038 records). [2025-09-30T17:42:19.809929] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-30T17:42:20.206927] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-30T17:42:20.207004] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-30T17:42:20.207423] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-30T17:42:20.207467] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-30T17:42:20.208192] [DEBUG] [LOCAL ] BRW: Trimmed 30038 records to 19912 (keeping 200 days of data) [2025-09-30T17:42:20.257973] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-30T17:42:20.341407] [DEBUG] [LOCAL ] BRW: Primary data saved (19912 records). [2025-09-30T17:42:20.341905] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-30T17:42:20.342062] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRW took 40.0s. Estimated remaining: 4h 14m 18s. Rate: 8.0 symbols/min [2025-09-30T17:42:20.533561] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:20.547356] [DEBUG] [LOCAL ] BSL: Loaded 8156 existing records from primary storage. [2025-09-30T17:42:20.547637] [INFO ] [MAIN ] BSL: Loaded 8156 existing records. [2025-09-30T17:42:20.755910] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:20.756116] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-30T17:42:20.756164] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-30T17:42:20.756751] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-30T17:42:20.756812] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-30T17:42:21.055270] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-30T17:42:21.188832] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:21.191482] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T17:42:21.199341] [INFO ] [REMOTE ] BSAC: Full fetch complete (43794 records). [2025-09-30T17:42:21.199497] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-30T17:42:21.696986] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-30T17:42:21.697197] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-30T17:42:21.698126] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-30T17:42:21.698818] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-30T17:42:21.700221] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:42:21.712726] [DEBUG] [LOCAL ] BSAC: Trimmed 43794 records to 32974 (keeping 200 days of data) [2025-09-30T17:42:21.877136] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-30T17:42:21.926081] [DEBUG] [LOCAL ] BSAC: Primary data saved (32974 records). [2025-09-30T17:42:21.926242] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-30T17:42:21.926333] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BSAC took 25.3s. Estimated remaining: 4h 13m 35s. Rate: 8.0 symbols/min [2025-09-30T17:42:22.118592] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:22.158512] [DEBUG] [LOCAL ] BSM: Loaded 32184 existing records from primary storage. [2025-09-30T17:42:22.158850] [INFO ] [MAIN ] BSM: Loaded 32184 existing records. [2025-09-30T17:42:22.358928] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:22.359166] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-30T17:42:22.359213] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-30T17:42:22.359604] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-30T17:42:22.359700] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-30T17:42:22.654777] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-30T17:42:22.775070] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:22.782848] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T17:42:22.985730] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T17:42:23.454409] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-30T17:42:24.119031] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T17:42:24.254399] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-30T17:42:24.814381] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T17:42:24.902266] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T17:42:25.054361] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-30T17:42:25.854384] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-30T17:42:26.335048] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-30T17:42:26.654405] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-30T17:42:27.351517] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T17:42:27.454378] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-30T17:42:27.579631] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T17:42:28.254398] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-30T17:42:29.052579] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T17:42:29.062960] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-30T17:42:29.251848] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T17:42:29.854348] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-30T17:42:30.573148] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T17:42:30.581918] [INFO ] [REMOTE ] BSBR: Full fetch complete (50673 records). [2025-09-30T17:42:30.582074] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-30T17:42:30.659487] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-30T17:42:30.991554] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-30T17:42:30.991666] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-30T17:42:30.992276] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-30T17:42:30.992321] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-30T17:42:30.993518] [DEBUG] [LOCAL ] BSBR: Trimmed 50673 records to 35311 (keeping 200 days of data) [2025-09-30T17:42:31.260190] [DEBUG] [LOCAL ] BSBR: Primary data saved (35311 records). [2025-09-30T17:42:31.260377] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-30T17:42:31.260471] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BSBR took 28.1s. Estimated remaining: 4h 13m 39s. Rate: 8.0 symbols/min [2025-09-30T17:42:31.449096] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:31.454332] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-30T17:42:31.475988] [DEBUG] [LOCAL ] BST: Loaded 18957 existing records from primary storage. [2025-09-30T17:42:31.476389] [INFO ] [MAIN ] BST: Loaded 18957 existing records. [2025-09-30T17:42:31.621840] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T17:42:31.701381] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:31.701980] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-30T17:42:31.702114] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-30T17:42:31.702980] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-30T17:42:31.703075] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-30T17:42:31.962428] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T17:42:32.058056] [INFO ] [REMOTE ] BRX: Full fetch complete (74905 records). [2025-09-30T17:42:32.078024] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-30T17:42:32.265703] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-30T17:42:32.303185] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:32.622294] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-30T17:42:32.622470] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-30T17:42:32.623573] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-30T17:42:32.623711] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-30T17:42:32.626447] [DEBUG] [LOCAL ] BRX: Trimmed 74905 records to 51710 (keeping 200 days of data) [2025-09-30T17:42:32.783282] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T17:42:32.899181] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T17:42:33.027969] [DEBUG] [LOCAL ] BRX: Primary data saved (51710 records). [2025-09-30T17:42:33.028140] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-30T17:42:33.028818] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BRX took 37.8s. Estimated remaining: 4h 12m 57s. Rate: 8.0 symbols/min [2025-09-30T17:42:33.060237] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-30T17:42:33.227975] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:33.262425] [DEBUG] [LOCAL ] BSTZ: Loaded 24704 existing records from primary storage. [2025-09-30T17:42:33.262754] [INFO ] [MAIN ] BSTZ: Loaded 24704 existing records. [2025-09-30T17:42:33.460061] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:33.460322] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-30T17:42:33.460372] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-30T17:42:33.461187] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-30T17:42:33.461249] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-30T17:42:33.837102] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:33.854327] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-30T17:42:34.211000] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T17:42:34.654392] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-30T17:42:34.901995] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T17:42:35.454407] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-30T17:42:36.191329] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T17:42:36.255277] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-30T17:42:36.259581] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T17:42:37.054418] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-30T17:42:37.630275] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:42:37.805147] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T17:42:37.854350] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-30T17:42:38.654388] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-30T17:42:39.229779] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T17:42:39.454337] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-30T17:42:39.817268] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:42:40.254384] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-30T17:42:40.918162] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T17:42:41.039451] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T17:42:41.054313] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-30T17:42:41.854389] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-30T17:42:42.504487] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T17:42:42.512302] [INFO ] [REMOTE ] BSM: Full fetch complete (47576 records). [2025-09-30T17:42:42.512418] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-30T17:42:42.663755] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-30T17:42:42.948179] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T17:42:42.952420] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-30T17:42:42.952769] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-30T17:42:42.953699] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-30T17:42:42.954155] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-30T17:42:42.955162] [DEBUG] [LOCAL ] BSM: Trimmed 47576 records to 32206 (keeping 200 days of data) [2025-09-30T17:42:43.162705] [DEBUG] [LOCAL ] BSM: Primary data saved (32206 records). [2025-09-30T17:42:43.162855] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-30T17:42:43.162947] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSM took 21.2s. Estimated remaining: 4h 13m 5s. Rate: 8.0 symbols/min [2025-09-30T17:42:43.344447] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:43.407354] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-30T17:42:43.407833] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-09-30T17:42:43.459525] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-30T17:42:43.637360] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:43.638312] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-30T17:42:43.639253] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:42:43.638412] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-30T17:42:43.646127] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-30T17:42:43.646199] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-30T17:42:44.020606] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:44.254333] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-30T17:42:44.417997] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T17:42:45.054377] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-30T17:42:45.854340] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-30T17:42:46.112152] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T17:42:46.342964] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T17:42:46.654367] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-30T17:42:47.133636] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T17:42:47.454375] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-30T17:42:47.681539] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T17:42:48.254332] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-30T17:42:48.417582] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T17:42:49.027674] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T17:42:49.054319] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-30T17:42:49.854375] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-30T17:42:50.222702] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T17:42:50.592198] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T17:42:50.654362] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-30T17:42:51.454327] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-30T17:42:51.729701] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T17:42:52.254355] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-30T17:42:53.054328] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-30T17:42:53.115621] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T17:42:53.320507] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T17:42:53.854350] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-30T17:42:54.135951] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T17:42:54.654377] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-30T17:42:55.454349] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-30T17:42:55.549437] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T17:42:55.571398] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T17:42:56.254362] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-30T17:42:56.516610] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T17:42:56.524237] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36642 records). [2025-09-30T17:42:56.524438] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-30T17:42:56.951501] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-30T17:42:56.951736] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-30T17:42:56.952415] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-30T17:42:56.952575] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-30T17:42:56.973883] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-30T17:42:56.976608] [DEBUG] [LOCAL ] BSTZ: Trimmed 36642 records to 24736 (keeping 200 days of data) [2025-09-30T17:42:57.059466] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-30T17:42:57.173221] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24736 records). [2025-09-30T17:42:57.173384] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-30T17:42:57.173476] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BSTZ took 24.1s. Estimated remaining: 4h 13m 36s. Rate: 8.0 symbols/min [2025-09-30T17:42:57.362245] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:57.369858] [DEBUG] [LOCAL ] BTA: Loaded 5413 existing records from primary storage. [2025-09-30T17:42:57.370041] [INFO ] [MAIN ] BTA: Loaded 5413 existing records. [2025-09-30T17:42:57.556177] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:57.556393] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-30T17:42:57.556448] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-30T17:42:57.556756] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-30T17:42:57.556820] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-30T17:42:57.862534] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-30T17:42:57.963100] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:42:58.654345] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-30T17:42:58.840392] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T17:42:58.933714] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T17:42:58.939168] [INFO ] [REMOTE ] BST: Full fetch complete (28798 records). [2025-09-30T17:42:58.939318] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-30T17:42:59.266253] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T17:42:59.358038] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-30T17:42:59.358135] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-30T17:42:59.358615] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-30T17:42:59.358705] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-30T17:42:59.359512] [DEBUG] [LOCAL ] BST: Trimmed 28798 records to 19010 (keeping 200 days of data) [2025-09-30T17:42:59.454838] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-30T17:42:59.482117] [DEBUG] [LOCAL ] BST: Primary data saved (19010 records). [2025-09-30T17:42:59.482283] [INFO ] [MAIN ] BST: Full history saved. [2025-09-30T17:42:59.482421] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BST took 28.2s. Estimated remaining: 4h 12m 58s. Rate: 8.0 symbols/min [2025-09-30T17:42:59.678145] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:42:59.696228] [DEBUG] [LOCAL ] BTCM: Loaded 15156 existing records from primary storage. [2025-09-30T17:42:59.696507] [INFO ] [MAIN ] BTCM: Loaded 15156 existing records. [2025-09-30T17:42:59.886017] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:42:59.886231] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-30T17:42:59.886279] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-30T17:42:59.886543] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-30T17:42:59.886605] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-30T17:43:00.260903] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-30T17:43:00.294790] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:00.302349] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T17:43:01.054370] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-30T17:43:01.738069] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T17:43:01.854382] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-30T17:43:02.298760] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-30T17:43:02.362177] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-30T17:43:02.654402] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-30T17:43:03.454595] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-30T17:43:04.162190] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T17:43:04.254379] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-30T17:43:04.539899] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T17:43:05.054409] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-30T17:43:05.279423] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T17:43:05.282591] [INFO ] [REMOTE ] BSL: Full fetch complete (12709 records). [2025-09-30T17:43:05.282730] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-30T17:43:05.641542] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T17:43:05.733818] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-30T17:43:05.733934] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-30T17:43:05.734458] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-30T17:43:05.734504] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-30T17:43:05.735473] [DEBUG] [LOCAL ] BSL: Trimmed 12709 records to 8187 (keeping 200 days of data) [2025-09-30T17:43:05.794399] [DEBUG] [LOCAL ] BSL: Primary data saved (8187 records). [2025-09-30T17:43:05.794558] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-30T17:43:05.794674] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BSL took 45.5s. Estimated remaining: 4h 12m 44s. Rate: 8.0 symbols/min [2025-09-30T17:43:05.861231] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-30T17:43:06.013224] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:06.085069] [DEBUG] [LOCAL ] BTE: Loaded 52726 existing records from primary storage. [2025-09-30T17:43:06.085547] [INFO ] [MAIN ] BTE: Loaded 52726 existing records. [2025-09-30T17:43:06.334840] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:43:06.335057] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-30T17:43:06.335107] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-30T17:43:06.337066] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-30T17:43:06.337131] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-30T17:43:06.660443] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-30T17:43:06.750150] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:07.392666] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T17:43:07.454319] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-30T17:43:07.813132] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T17:43:08.254402] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-30T17:43:08.929542] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T17:43:09.054391] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-30T17:43:09.617207] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-30T17:43:09.841920] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:43:09.854318] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-30T17:43:10.550915] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-30T17:43:10.654402] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-30T17:43:11.383727] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T17:43:11.454359] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-30T17:43:12.078944] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-30T17:43:12.254398] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-30T17:43:13.054402] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-30T17:43:13.854363] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-30T17:43:14.072228] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T17:43:14.454175] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T17:43:14.654341] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-30T17:43:14.828516] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T17:43:15.454402] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-30T17:43:16.051800] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T17:43:16.254332] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-30T17:43:16.428162] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T17:43:16.440029] [INFO ] [REMOTE ] BSX: Full fetch complete (77695 records). [2025-09-30T17:43:16.440281] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-30T17:43:16.875772] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-30T17:43:16.875894] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-30T17:43:16.876822] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-30T17:43:16.876894] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-30T17:43:16.878586] [DEBUG] [LOCAL ] BSX: Trimmed 77695 records to 53688 (keeping 200 days of data) [2025-09-30T17:43:17.067408] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-30T17:43:17.109911] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T17:43:17.236908] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-09-30T17:43:17.237059] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-30T17:43:17.237193] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BSX took 34.1s. Estimated remaining: 4h 12m 60s. Rate: 8.0 symbols/min [2025-09-30T17:43:17.428224] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:17.484317] [DEBUG] [LOCAL ] BTI: Loaded 53554 existing records from primary storage. [2025-09-30T17:43:17.484743] [INFO ] [MAIN ] BTI: Loaded 53554 existing records. [2025-09-30T17:43:17.716535] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:43:17.717590] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-30T17:43:17.717700] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-30T17:43:17.718126] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T17:43:17.720580] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-30T17:43:17.721300] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-30T17:43:17.859737] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-30T17:43:18.116363] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:18.654326] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-30T17:43:18.785386] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T17:43:18.787362] [INFO ] [REMOTE ] BTA: Full fetch complete (9584 records). [2025-09-30T17:43:18.787435] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-30T17:43:19.193299] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-30T17:43:19.193380] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-30T17:43:19.193667] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-30T17:43:19.193730] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-30T17:43:19.194163] [DEBUG] [LOCAL ] BTA: Trimmed 9584 records to 5400 (keeping 200 days of data) [2025-09-30T17:43:19.229816] [DEBUG] [LOCAL ] BTA: Primary data saved (5400 records). [2025-09-30T17:43:19.229940] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-30T17:43:19.230029] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BTA took 22.1s. Estimated remaining: 4h 12m 20s. Rate: 8.0 symbols/min [2025-09-30T17:43:19.412147] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:19.423721] [DEBUG] [LOCAL ] BTO: Loaded 8806 existing records from primary storage. [2025-09-30T17:43:19.423979] [INFO ] [MAIN ] BTO: Loaded 8806 existing records. [2025-09-30T17:43:19.459523] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-30T17:43:19.633246] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:43:19.633483] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-30T17:43:19.633539] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-30T17:43:19.633799] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-30T17:43:19.633861] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-30T17:43:20.018838] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:20.254398] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-30T17:43:20.449706] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:43:20.737995] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-30T17:43:21.054381] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-30T17:43:21.854396] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-30T17:43:21.968195] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:43:22.600748] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:43:22.654346] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-30T17:43:22.816782] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T17:43:23.454410] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-30T17:43:23.980018] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T17:43:24.254368] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-30T17:43:25.054356] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-30T17:43:25.219133] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-30T17:43:25.426444] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T17:43:25.854383] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-30T17:43:26.458030] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T17:43:26.654415] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-30T17:43:26.794157] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T17:43:27.454391] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-30T17:43:28.254389] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-30T17:43:28.406921] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T17:43:29.054402] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-30T17:43:29.487625] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-30T17:43:29.785236] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T17:43:29.804632] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T17:43:29.854385] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-30T17:43:30.654402] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-30T17:43:31.454414] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-30T17:43:31.773543] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T17:43:31.866535] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T17:43:31.927249] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-30T17:43:32.254370] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-30T17:43:33.054418] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-30T17:43:33.680499] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T17:43:33.854329] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-30T17:43:33.944106] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T17:43:34.654393] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-30T17:43:35.454337] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-30T17:43:35.551564] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:43:36.254329] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-30T17:43:36.356924] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T17:43:36.723036] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T17:43:37.054382] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-30T17:43:37.859469] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-30T17:43:37.881479] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T17:43:37.899741] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T17:43:38.654375] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-30T17:43:39.137455] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T17:43:39.454384] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-30T17:43:39.775077] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T17:43:39.976975] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T17:43:40.254374] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-30T17:43:40.990900] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T17:43:41.054363] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-30T17:43:41.854383] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-30T17:43:41.870911] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T17:43:41.873290] [INFO ] [REMOTE ] BTO: Full fetch complete (13309 records). [2025-09-30T17:43:41.873371] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-30T17:43:42.280624] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-30T17:43:42.280737] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-30T17:43:42.281066] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-30T17:43:42.281110] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-30T17:43:42.281602] [DEBUG] [LOCAL ] BTO: Trimmed 13309 records to 8761 (keeping 200 days of data) [2025-09-30T17:43:42.337813] [DEBUG] [LOCAL ] BTO: Primary data saved (8761 records). [2025-09-30T17:43:42.337939] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-30T17:43:42.338027] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTO took 23.1s. Estimated remaining: 4h 13m 43s. Rate: 8.0 symbols/min [2025-09-30T17:43:42.522997] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:42.523160] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-09-30T17:43:42.523199] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-09-30T17:43:42.523343] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-30T17:43:42.523412] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-30T17:43:42.523465] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-09-30T17:43:42.523540] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-30T17:43:42.659427] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-30T17:43:42.922732] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:43.454365] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-30T17:43:43.843357] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T17:43:44.263445] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-30T17:43:44.273508] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T17:43:44.287370] [INFO ] [REMOTE ] BTE: Full fetch complete (76024 records). [2025-09-30T17:43:44.287565] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-30T17:43:44.753314] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-30T17:43:44.753443] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-30T17:43:44.759563] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-30T17:43:44.768146] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-30T17:43:44.771334] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T17:43:44.777629] [INFO ] [REMOTE ] BTCM: Full fetch complete (19301 records). [2025-09-30T17:43:44.777943] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-30T17:43:44.778484] [DEBUG] [LOCAL ] BTE: Trimmed 76024 records to 52722 (keeping 200 days of data) [2025-09-30T17:43:45.055854] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-30T17:43:45.490173] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T17:43:45.490381] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-30T17:43:45.496679] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-30T17:43:45.498088] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-30T17:43:45.499204] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-30T17:43:45.503311] [DEBUG] [LOCAL ] BTCM: Trimmed 19301 records to 15242 (keeping 200 days of data) [2025-09-30T17:43:45.611846] [DEBUG] [LOCAL ] BTCM: Primary data saved (15242 records). [2025-09-30T17:43:45.613398] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-30T17:43:45.613542] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTCM took 46.1s. Estimated remaining: 4h 13m 11s. Rate: 8.0 symbols/min [2025-09-30T17:43:45.834483] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:45.874427] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-30T17:43:45.943447] [DEBUG] [LOCAL ] BTE: Primary data saved (52722 records). [2025-09-30T17:43:45.943608] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-30T17:43:45.943729] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTE took 40.1s. Estimated remaining: 4h 12m 22s. Rate: 8.0 symbols/min [2025-09-30T17:43:46.086900] [DEBUG] [LOCAL ] BTU: Loaded 53306 existing records from primary storage. [2025-09-30T17:43:46.108410] [INFO ] [MAIN ] BTU: Loaded 53306 existing records. [2025-09-30T17:43:46.288626] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:46.299831] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-30T17:43:46.305101] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-30T17:43:46.315596] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-30T17:43:46.320849] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-30T17:43:46.344159] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-30T17:43:46.353500] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-30T17:43:46.422582] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:43:46.457179] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-30T17:43:46.465340] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-30T17:43:46.512076] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-30T17:43:46.517537] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-30T17:43:46.771084] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T17:43:46.864102] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-30T17:43:47.057944] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:47.273153] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:47.306426] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-30T17:43:47.454361] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-30T17:43:47.926889] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:43:47.927281] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-30T17:43:47.927385] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:43:47.927446] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-09-30T17:43:47.927516] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:43:47.927597] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-30T17:43:47.927788] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-30T17:43:47.927848] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-30T17:43:47.928032] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-30T17:43:47.938481] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T17:43:47.938035] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTX took 2.0s. Estimated remaining: 4h 11m 43s. Rate: 8.0 symbols/min [2025-09-30T17:43:48.135293] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:43:48.164735] [DEBUG] [LOCAL ] BTZ: Loaded 22647 existing records from primary storage. [2025-09-30T17:43:48.165084] [INFO ] [MAIN ] BTZ: Loaded 22647 existing records. [2025-09-30T17:43:48.259421] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-30T17:43:48.361634] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:43:48.361839] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-30T17:43:48.361899] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-30T17:43:48.362290] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-30T17:43:48.362351] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-30T17:43:48.755128] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:43:49.054335] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-30T17:43:49.209125] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T17:43:49.854353] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-30T17:43:50.654374] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-30T17:43:50.844705] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T17:43:51.009874] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T17:43:51.454381] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-30T17:43:51.662702] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T17:43:52.254434] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-30T17:43:53.006394] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T17:43:53.054319] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-30T17:43:53.211829] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T17:43:53.854412] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-30T17:43:54.505704] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T17:43:54.660889] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-30T17:43:54.665159] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T17:43:55.454407] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-30T17:43:55.548938] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T17:43:56.254381] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-30T17:43:57.054345] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-30T17:43:57.120478] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:43:57.312117] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T17:43:57.854363] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-30T17:43:58.654383] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-30T17:43:58.987772] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T17:43:59.006382] [INFO ] [REMOTE ] BTI: Full fetch complete (77437 records). [2025-09-30T17:43:59.006593] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-30T17:43:59.469856] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-30T17:43:59.465770] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-30T17:43:59.470416] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-30T17:43:59.472333] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-30T17:43:59.474345] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-30T17:43:59.480118] [DEBUG] [LOCAL ] BTI: Trimmed 77437 records to 53556 (keeping 200 days of data) [2025-09-30T17:43:59.592762] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T17:43:59.647398] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T17:43:59.911539] [DEBUG] [LOCAL ] BTI: Primary data saved (53556 records). [2025-09-30T17:43:59.911909] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-30T17:43:59.912039] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTI took 42.7s. Estimated remaining: 4h 12m 1s. Rate: 8.0 symbols/min [2025-09-30T17:44:00.095846] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:00.152228] [DEBUG] [LOCAL ] BUD: Loaded 52720 existing records from primary storage. [2025-09-30T17:44:00.152595] [INFO ] [MAIN ] BUD: Loaded 52720 existing records. [2025-09-30T17:44:00.254971] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-30T17:44:00.358383] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:00.358827] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-30T17:44:00.358984] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-30T17:44:00.366323] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-30T17:44:00.371607] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-30T17:44:00.445340] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:44:00.788919] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:01.054402] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-30T17:44:01.854344] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-30T17:44:01.994717] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T17:44:02.291714] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T17:44:02.654410] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-30T17:44:03.454336] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-30T17:44:03.802154] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T17:44:03.868157] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T17:44:04.254377] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-30T17:44:04.501072] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T17:44:04.505291] [INFO ] [REMOTE ] BTT: Full fetch complete (24233 records). [2025-09-30T17:44:04.505385] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-30T17:44:04.930597] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-30T17:44:04.930704] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-30T17:44:04.931129] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-30T17:44:04.931172] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-30T17:44:04.931852] [DEBUG] [LOCAL ] BTT: Trimmed 24233 records to 15894 (keeping 200 days of data) [2025-09-30T17:44:05.034020] [DEBUG] [LOCAL ] BTT: Primary data saved (15894 records). [2025-09-30T17:44:05.034175] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-30T17:44:05.034276] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTT took 22.7s. Estimated remaining: 4h 11m 40s. Rate: 8.0 symbols/min [2025-09-30T17:44:05.059570] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-30T17:44:05.240925] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:05.254457] [DEBUG] [LOCAL ] BUI: Loaded 11526 existing records from primary storage. [2025-09-30T17:44:05.254747] [INFO ] [MAIN ] BUI: Loaded 11526 existing records. [2025-09-30T17:44:05.464484] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:05.464769] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-30T17:44:05.464834] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-30T17:44:05.465282] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-30T17:44:05.465344] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-30T17:44:05.859506] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-30T17:44:05.937362] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:06.050116] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T17:44:06.652774] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T17:44:06.663334] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-30T17:44:06.688480] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T17:44:07.454404] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-30T17:44:08.254869] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-30T17:44:08.426396] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T17:44:08.980592] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-30T17:44:09.054369] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-30T17:44:09.465915] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T17:44:09.854396] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-30T17:44:10.654407] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-30T17:44:10.768364] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T17:44:10.956308] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T17:44:11.454392] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-30T17:44:12.247426] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:44:12.254315] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-30T17:44:12.539406] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T17:44:13.016347] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T17:44:13.054367] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-30T17:44:13.838137] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T17:44:13.854333] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-30T17:44:14.654401] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-30T17:44:14.712060] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T17:44:15.454407] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-30T17:44:16.254414] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-30T17:44:16.803996] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T17:44:16.818248] [INFO ] [REMOTE ] BTU: Full fetch complete (76886 records). [2025-09-30T17:44:16.818581] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-30T17:44:17.057398] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-30T17:44:17.112545] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T17:44:17.293933] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-30T17:44:17.294054] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-30T17:44:17.295018] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-30T17:44:17.295102] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-30T17:44:17.297815] [DEBUG] [LOCAL ] BTU: Trimmed 76886 records to 53307 (keeping 200 days of data) [2025-09-30T17:44:17.439077] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T17:44:17.710487] [DEBUG] [LOCAL ] BTU: Primary data saved (53307 records). [2025-09-30T17:44:17.710691] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-30T17:44:17.710828] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTU took 32.1s. Estimated remaining: 4h 12m 2s. Rate: 8.0 symbols/min [2025-09-30T17:44:17.856677] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-30T17:44:17.957497] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:17.957745] [DEBUG] [LOCAL ] BUR: No existing data file found in primary storage. [2025-09-30T17:44:17.957811] [WARN ] [MAIN ] BUR: No existing data found, performing full refresh instead. [2025-09-30T17:44:17.957931] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-30T17:44:17.958016] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-30T17:44:17.958088] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-09-30T17:44:17.958143] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-30T17:44:18.390034] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:18.440291] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T17:44:18.654409] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-30T17:44:19.454346] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-30T17:44:19.827806] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-30T17:44:20.133157] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:44:20.255425] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-30T17:44:20.259438] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T17:44:20.265245] [INFO ] [REMOTE ] BTZ: Full fetch complete (33662 records). [2025-09-30T17:44:20.265441] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-30T17:44:20.690069] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-30T17:44:20.690218] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-30T17:44:20.690908] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-30T17:44:20.690988] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-30T17:44:20.691947] [DEBUG] [LOCAL ] BTZ: Trimmed 33662 records to 22619 (keeping 200 days of data) [2025-09-30T17:44:20.841684] [DEBUG] [LOCAL ] BTZ: Primary data saved (22619 records). [2025-09-30T17:44:20.841823] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-30T17:44:20.841940] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BTZ took 32.9s. Estimated remaining: 4h 11m 30s. Rate: 8.0 symbols/min [2025-09-30T17:44:21.028521] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:21.061226] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-30T17:44:21.087940] [DEBUG] [LOCAL ] BURL: Loaded 46116 existing records from primary storage. [2025-09-30T17:44:21.088263] [INFO ] [MAIN ] BURL: Loaded 46116 existing records. [2025-09-30T17:44:21.294612] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:21.294878] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-30T17:44:21.294952] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-30T17:44:21.297080] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-30T17:44:21.297146] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-30T17:44:21.426263] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T17:44:21.717028] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:21.854368] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-30T17:44:22.399842] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T17:44:22.654364] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-30T17:44:23.454383] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-30T17:44:23.554272] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T17:44:24.163769] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T17:44:24.254435] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-30T17:44:25.054344] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-30T17:44:25.327115] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T17:44:25.754395] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T17:44:25.854386] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-30T17:44:25.974027] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T17:44:26.654424] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-30T17:44:27.333744] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T17:44:27.454388] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-30T17:44:28.149733] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T17:44:28.254363] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-30T17:44:29.002225] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:44:29.054390] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-30T17:44:29.420109] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T17:44:29.854367] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-30T17:44:30.549001] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:44:30.654362] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-30T17:44:31.050402] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T17:44:31.054489] [INFO ] [REMOTE ] BUI: Full fetch complete (16299 records). [2025-09-30T17:44:31.054594] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-30T17:44:31.459745] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-30T17:44:31.512207] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-30T17:44:31.512282] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-30T17:44:31.512601] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-30T17:44:31.512731] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-30T17:44:31.513292] [DEBUG] [LOCAL ] BUI: Trimmed 16299 records to 11559 (keeping 200 days of data) [2025-09-30T17:44:31.590972] [DEBUG] [LOCAL ] BUI: Primary data saved (11559 records). [2025-09-30T17:44:31.591119] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-30T17:44:31.591204] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BUI took 26.6s. Estimated remaining: 4h 11m 41s. Rate: 8.0 symbols/min [2025-09-30T17:44:31.788471] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:31.806988] [DEBUG] [LOCAL ] BUXX: Loaded 15148 existing records from primary storage. [2025-09-30T17:44:31.807277] [INFO ] [MAIN ] BUXX: Loaded 15148 existing records. [2025-09-30T17:44:32.011867] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:32.012116] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-30T17:44:32.012168] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-30T17:44:32.012749] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-30T17:44:32.012812] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-30T17:44:32.266768] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-30T17:44:32.453967] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:32.488748] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T17:44:33.054400] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-30T17:44:33.342088] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T17:44:33.687563] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T17:44:33.854403] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-30T17:44:33.946162] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T17:44:34.654361] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-30T17:44:35.455019] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-30T17:44:35.458256] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T17:44:36.254371] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-30T17:44:36.643385] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T17:44:37.054359] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-30T17:44:37.447302] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T17:44:37.463141] [INFO ] [REMOTE ] BUD: Full fetch complete (76483 records). [2025-09-30T17:44:37.463358] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-30T17:44:37.768914] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T17:44:37.814176] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T17:44:37.857203] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-30T17:44:38.139169] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-30T17:44:38.139347] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-30T17:44:38.140859] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-30T17:44:38.140954] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-30T17:44:38.143154] [DEBUG] [LOCAL ] BUD: Trimmed 76483 records to 52713 (keeping 200 days of data) [2025-09-30T17:44:38.581802] [DEBUG] [LOCAL ] BUD: Primary data saved (52713 records). [2025-09-30T17:44:38.582119] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-30T17:44:38.582239] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUD took 38.7s. Estimated remaining: 4h 11m 31s. Rate: 8.0 symbols/min [2025-09-30T17:44:38.654426] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-30T17:44:39.454352] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-30T17:44:39.477892] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T17:44:39.656328] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:44:40.254372] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-30T17:44:41.054406] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-30T17:44:41.090244] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T17:44:41.798315] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T17:44:41.854351] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-30T17:44:41.901738] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T17:44:42.654405] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-30T17:44:43.395930] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T17:44:43.454342] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-30T17:44:43.619808] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T17:44:44.254392] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-30T17:44:44.991047] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T17:44:45.000843] [INFO ] [REMOTE ] BUR: Full fetch complete (63493 records). [2025-09-30T17:44:45.001028] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-30T17:44:45.059494] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-30T17:44:45.367354] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T17:44:45.465568] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-30T17:44:45.465693] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-30T17:44:45.466431] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-30T17:44:45.466479] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-30T17:44:45.468139] [DEBUG] [LOCAL ] BUR: Trimmed 63493 records to 45112 (keeping 200 days of data) [2025-09-30T17:44:45.761500] [DEBUG] [LOCAL ] BUR: Primary data saved (45112 records). [2025-09-30T17:44:45.761703] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-30T17:44:45.761852] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUR took 28.1s. Estimated remaining: 4h 11m 22s. Rate: 8.0 symbols/min [2025-09-30T17:44:45.854380] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-30T17:44:46.793594] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T17:44:46.804620] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-30T17:44:46.979060] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T17:44:47.454361] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-30T17:44:48.228438] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T17:44:48.254376] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-30T17:44:48.503392] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T17:44:49.054451] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-30T17:44:49.073874] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T17:44:49.854380] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-30T17:44:50.813989] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T17:44:50.824836] [INFO ] [REMOTE ] BURL: Full fetch complete (65715 records). [2025-09-30T17:44:50.825029] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-30T17:44:50.954006] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T17:44:50.993758] [INFO ] [REMOTE ] BUXX: Full fetch complete (20378 records). [2025-09-30T17:44:51.004805] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-30T17:44:51.454024] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-30T17:44:51.492691] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-30T17:44:51.542146] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-30T17:44:51.553767] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-30T17:44:51.627486] [DEBUG] [LOCAL ] BURL: Trimmed 65715 records to 46056 (keeping 200 days of data) [2025-09-30T17:44:51.724038] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-30T17:44:51.733082] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-30T17:44:51.760841] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-30T17:44:51.761910] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-30T17:44:51.765912] [DEBUG] [LOCAL ] BUXX: Trimmed 20378 records to 15166 (keeping 200 days of data) [2025-09-30T17:44:52.010915] [DEBUG] [LOCAL ] BUXX: Primary data saved (15166 records). [2025-09-30T17:44:52.011583] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-30T17:44:52.012093] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUXX took 20.4s. Estimated remaining: 4h 11m 7s. Rate: 8.0 symbols/min [2025-09-30T17:44:52.079872] [DEBUG] [LOCAL ] BURL: Primary data saved (46056 records). [2025-09-30T17:44:52.080023] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-30T17:44:52.080110] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 31.2s. Estimated remaining: 4h 10m 18s. Rate: 8.0 symbols/min [2025-09-30T17:44:52.747667] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:52.840507] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:52.847490] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:52.847614] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-09-30T17:44:52.873639] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:44:52.873829] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-09-30T17:44:52.874618] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-30T17:44:52.874726] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-30T17:44:52.874785] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-09-30T17:44:52.874820] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-30T17:44:53.055525] [DEBUG] [LOCAL ] BW: Loaded 39676 existing records from primary storage. [2025-09-30T17:44:53.117232] [INFO ] [MAIN ] BW: Loaded 39676 existing records. [2025-09-30T17:44:53.218353] [DEBUG] [LOCAL ] BVN: Loaded 43956 existing records from primary storage. [2025-09-30T17:44:53.296744] [INFO ] [MAIN ] BVN: Loaded 43956 existing records. [2025-09-30T17:44:53.494670] [DEBUG] [LOCAL ] BWA: Loaded 52193 existing records from primary storage. [2025-09-30T17:44:53.500726] [INFO ] [MAIN ] BWA: Loaded 52193 existing records. [2025-09-30T17:44:53.792019] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:53.850279] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-30T17:44:54.025880] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:54.077533] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:54.119805] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-30T17:44:54.104065] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-30T17:44:54.149916] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-30T17:44:54.164738] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-30T17:44:54.164665] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:44:54.164913] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-30T17:44:54.158603] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-30T17:44:54.170385] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-30T17:44:54.177839] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-30T17:44:54.178057] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-30T17:44:54.198868] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-30T17:44:54.238710] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-30T17:44:54.303827] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-30T17:44:55.251742] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:55.299008] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-30T17:44:55.332111] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:55.380439] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-30T17:44:55.429120] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:44:55.429546] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-30T17:44:55.451731] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T17:44:55.460487] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-30T17:44:56.664411] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T17:44:56.671003] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-30T17:44:56.975206] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T17:44:56.985773] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-30T17:44:57.067762] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T17:44:57.080064] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-30T17:44:57.108760] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T17:44:57.119187] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-30T17:44:57.797149] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T17:44:57.854340] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-30T17:44:58.132361] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T17:44:58.609382] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T17:44:58.654345] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-30T17:44:58.740993] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T17:44:59.454356] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-30T17:44:59.527839] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:45:00.035399] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T17:45:00.254377] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-30T17:45:01.054372] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-30T17:45:01.174979] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T17:45:01.854350] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-30T17:45:02.264337] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-30T17:45:02.627508] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T17:45:02.654381] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-30T17:45:03.454333] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-30T17:45:03.839971] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T17:45:04.159014] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T17:45:04.254414] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-30T17:45:05.000744] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T17:45:05.054385] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-30T17:45:05.655759] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T17:45:05.854396] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-30T17:45:06.654351] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-30T17:45:06.683941] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T17:45:07.313862] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T17:45:07.454372] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-30T17:45:08.153685] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T17:45:08.254392] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-30T17:45:08.661985] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T17:45:09.054375] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-30T17:45:09.854347] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-30T17:45:09.960036] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T17:45:10.164763] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T17:45:10.654402] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-30T17:45:11.421939] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:45:11.454315] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-30T17:45:12.168408] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T17:45:12.254422] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-30T17:45:12.942267] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T17:45:13.054402] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-30T17:45:13.854364] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-30T17:45:13.939989] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T17:45:14.588248] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T17:45:14.597716] [INFO ] [REMOTE ] BV: Full fetch complete (53663 records). [2025-09-30T17:45:14.597927] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-30T17:45:14.599030] [FATAL] [VALIDATOR ] BV: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:45:14.599135] [FATAL] [MAIN ] BV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:45:14.599182] [WARN ] [MAIN ] BV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:45:14.599224] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-30T17:45:14.599286] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-09-30T17:45:14.599324] [INFO ] [LOCAL ] BV: Starting deletion of derivative data. [2025-09-30T17:45:14.599383] [DEBUG] [LOCAL ] BV: No derivative data file found to delete. [2025-09-30T17:45:14.599468] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BV took 22.5s. Estimated remaining: 4h 11m 35s. Rate: 8.0 symbols/min [2025-09-30T17:45:14.666783] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-30T17:45:14.827977] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:14.843963] [DEBUG] [LOCAL ] BWG: Loaded 12382 existing records from primary storage. [2025-09-30T17:45:14.844240] [INFO ] [MAIN ] BWG: Loaded 12382 existing records. [2025-09-30T17:45:15.068357] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:45:15.068790] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-30T17:45:15.068865] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-30T17:45:15.069487] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-30T17:45:15.069551] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-30T17:45:15.352787] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T17:45:15.459441] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-30T17:45:15.520389] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:15.943829] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T17:45:16.254373] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-30T17:45:16.483012] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T17:45:17.054431] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-30T17:45:17.854356] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-30T17:45:18.099445] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T17:45:18.351021] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T17:45:18.654365] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-30T17:45:19.340058] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T17:45:19.454372] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-30T17:45:20.254324] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-30T17:45:20.308358] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T17:45:20.323757] [INFO ] [REMOTE ] BW: Full fetch complete (58833 records). [2025-09-30T17:45:20.323973] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-30T17:45:20.810085] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-30T17:45:20.810266] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-30T17:45:20.811737] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-30T17:45:20.811815] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-30T17:45:20.813386] [DEBUG] [LOCAL ] BW: Trimmed 58833 records to 39796 (keeping 200 days of data) [2025-09-30T17:45:21.054603] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-30T17:45:21.087523] [DEBUG] [LOCAL ] BW: Primary data saved (39796 records). [2025-09-30T17:45:21.087706] [INFO ] [MAIN ] BW: Full history saved. [2025-09-30T17:45:21.087816] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BW took 29.0s. Estimated remaining: 4h 11m 21s. Rate: 8.0 symbols/min [2025-09-30T17:45:21.322702] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:21.325446] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T17:45:21.370789] [DEBUG] [LOCAL ] BWLP: Loaded 32466 existing records from primary storage. [2025-09-30T17:45:21.371128] [INFO ] [MAIN ] BWLP: Loaded 32466 existing records. [2025-09-30T17:45:21.575034] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:45:21.575289] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-30T17:45:21.575351] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-30T17:45:21.576539] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-30T17:45:21.576604] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-30T17:45:21.858005] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-30T17:45:21.948255] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T17:45:22.017366] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:22.051911] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T17:45:22.654395] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-30T17:45:23.454332] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-30T17:45:23.642099] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T17:45:23.656041] [INFO ] [REMOTE ] BVN: Full fetch complete (62892 records). [2025-09-30T17:45:23.656239] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-30T17:45:23.817867] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:45:24.118773] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-30T17:45:24.118872] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-30T17:45:24.119727] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-30T17:45:24.119800] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-30T17:45:24.121531] [DEBUG] [LOCAL ] BVN: Trimmed 62892 records to 43983 (keeping 200 days of data) [2025-09-30T17:45:24.300268] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-30T17:45:24.406443] [DEBUG] [LOCAL ] BVN: Primary data saved (43983 records). [2025-09-30T17:45:24.406628] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-30T17:45:24.406751] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BVN took 32.3s. Estimated remaining: 4h 10m 51s. Rate: 8.0 symbols/min [2025-09-30T17:45:24.605547] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:24.615760] [DEBUG] [LOCAL ] BWMX: Loaded 7635 existing records from primary storage. [2025-09-30T17:45:24.616038] [INFO ] [MAIN ] BWMX: Loaded 7635 existing records. [2025-09-30T17:45:24.808703] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:45:24.809091] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-30T17:45:24.809153] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-30T17:45:24.809694] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-30T17:45:24.809758] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-30T17:45:25.065675] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-30T17:45:25.242276] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:25.245168] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T17:45:25.256947] [INFO ] [REMOTE ] BWA: Full fetch complete (75714 records). [2025-09-30T17:45:25.257136] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-30T17:45:25.697938] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-30T17:45:25.698134] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-30T17:45:25.699208] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-30T17:45:25.699369] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-30T17:45:25.697814] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T17:45:25.704592] [DEBUG] [LOCAL ] BWA: Trimmed 75714 records to 52185 (keeping 200 days of data) [2025-09-30T17:45:25.732614] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T17:45:25.854414] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-30T17:45:26.082324] [DEBUG] [LOCAL ] BWA: Primary data saved (52185 records). [2025-09-30T17:45:26.082478] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-30T17:45:26.082578] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BWA took 34.0s. Estimated remaining: 4h 10m 11s. Rate: 8.0 symbols/min [2025-09-30T17:45:26.267923] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:26.268146] [DEBUG] [LOCAL ] BWNB: No existing data file found in primary storage. [2025-09-30T17:45:26.268196] [WARN ] [MAIN ] BWNB: No existing data found, performing full refresh instead. [2025-09-30T17:45:26.268406] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-30T17:45:26.268473] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-30T17:45:26.268537] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-09-30T17:45:26.268589] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-30T17:45:26.673396] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-30T17:45:26.699607] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:26.700744] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T17:45:27.454378] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-30T17:45:27.547900] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T17:45:28.254394] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-30T17:45:28.856051] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T17:45:28.869258] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T17:45:29.054399] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-30T17:45:29.690364] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T17:45:29.854369] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-30T17:45:30.419872] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T17:45:30.654431] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-30T17:45:31.453384] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T17:45:31.454838] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-30T17:45:32.183140] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T17:45:32.254391] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-30T17:45:32.902773] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-30T17:45:33.054419] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-30T17:45:33.854399] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-30T17:45:33.958764] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-30T17:45:34.195316] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-30T17:45:34.654369] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-30T17:45:35.037520] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-30T17:45:35.454394] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-30T17:45:36.254362] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-30T17:45:36.796981] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T17:45:36.895229] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T17:45:37.054378] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-30T17:45:37.854406] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-30T17:45:37.880811] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T17:45:38.654398] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-30T17:45:38.966461] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T17:45:39.454376] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-30T17:45:39.479224] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T17:45:39.988325] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-30T17:45:40.254363] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-30T17:45:40.923027] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T17:45:41.054358] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-30T17:45:41.854365] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-30T17:45:42.133527] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:45:42.623309] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T17:45:42.654339] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-30T17:45:43.454404] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-30T17:45:43.919677] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T17:45:44.118060] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T17:45:44.254392] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-30T17:45:44.918884] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T17:45:45.054383] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-30T17:45:45.854399] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-30T17:45:46.060430] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T17:45:46.654419] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-30T17:45:47.051535] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T17:45:47.077393] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T17:45:47.454379] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-30T17:45:48.254402] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-30T17:45:48.358891] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T17:45:49.054402] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-30T17:45:49.613688] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T17:45:49.854334] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-30T17:45:49.897432] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T17:45:50.654375] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-30T17:45:51.092431] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T17:45:51.354845] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T17:45:51.356743] [INFO ] [REMOTE ] BWMX: Full fetch complete (10016 records). [2025-09-30T17:45:51.356836] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-30T17:45:51.357327] [FATAL] [VALIDATOR ] BWMX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:45:51.357416] [FATAL] [MAIN ] BWMX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:45:51.357462] [WARN ] [MAIN ] BWMX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:45:51.357528] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-30T17:45:51.357595] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-09-30T17:45:51.357633] [INFO ] [LOCAL ] BWMX: Starting deletion of derivative data. [2025-09-30T17:45:51.358047] [DEBUG] [LOCAL ] BWMX: Deleted derivative data file. [2025-09-30T17:45:51.358166] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWMX took 27.0s. Estimated remaining: 4h 11m 41s. Rate: 8.0 symbols/min [2025-09-30T17:45:51.459544] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-30T17:45:51.556869] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:51.557115] [DEBUG] [LOCAL ] BWSN: No existing data file found in primary storage. [2025-09-30T17:45:51.557169] [WARN ] [MAIN ] BWSN: No existing data found, performing full refresh instead. [2025-09-30T17:45:51.557285] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-30T17:45:51.557328] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-30T17:45:51.557370] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-30T17:45:51.557404] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-30T17:45:51.982099] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:52.129585] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T17:45:52.130952] [INFO ] [REMOTE ] BWNB: Full fetch complete (5753 records). [2025-09-30T17:45:52.131026] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-30T17:45:52.259490] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-30T17:45:52.539069] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-30T17:45:52.539152] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-30T17:45:52.539336] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-30T17:45:52.539375] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-30T17:45:52.539843] [DEBUG] [LOCAL ] BWNB: Trimmed 5753 records to 4448 (keeping 200 days of data) [2025-09-30T17:45:52.570830] [DEBUG] [LOCAL ] BWNB: Primary data saved (4448 records). [2025-09-30T17:45:52.570940] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-30T17:45:52.571010] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWNB took 26.5s. Estimated remaining: 4h 10m 59s. Rate: 8.0 symbols/min [2025-09-30T17:45:52.756189] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:52.803806] [DEBUG] [LOCAL ] BWXT: Loaded 46789 existing records from primary storage. [2025-09-30T17:45:52.804181] [INFO ] [MAIN ] BWXT: Loaded 46789 existing records. [2025-09-30T17:45:52.987286] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T17:45:53.012622] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:45:53.012907] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-30T17:45:53.012959] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-30T17:45:53.014459] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-30T17:45:53.014528] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-30T17:45:53.059616] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-30T17:45:53.404413] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:53.854384] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-30T17:45:54.312051] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T17:45:54.318811] [INFO ] [REMOTE ] BWLP: Full fetch complete (48047 records). [2025-09-30T17:45:54.318937] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-30T17:45:54.319742] [FATAL] [VALIDATOR ] BWLP: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:45:54.319853] [FATAL] [MAIN ] BWLP: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:45:54.319923] [WARN ] [MAIN ] BWLP: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:45:54.320025] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-30T17:45:54.320322] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-09-30T17:45:54.320361] [INFO ] [LOCAL ] BWLP: Starting deletion of derivative data. [2025-09-30T17:45:54.320611] [DEBUG] [LOCAL ] BWLP: Deleted derivative data file. [2025-09-30T17:45:54.321478] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWLP took 33.2s. Estimated remaining: 4h 10m 20s. Rate: 8.0 symbols/min [2025-09-30T17:45:54.519494] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-30T17:45:54.523958] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:45:54.588967] [DEBUG] [LOCAL ] BX: Loaded 53489 existing records from primary storage. [2025-09-30T17:45:54.589321] [INFO ] [MAIN ] BX: Loaded 53489 existing records. [2025-09-30T17:45:54.659461] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-30T17:45:54.793035] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:45:54.793259] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-30T17:45:54.793308] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-30T17:45:54.794831] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-30T17:45:54.794895] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-30T17:45:55.361166] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:45:55.454374] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-30T17:45:56.254384] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-30T17:45:56.410364] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T17:45:57.054406] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-30T17:45:57.227269] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T17:45:57.854457] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-30T17:45:58.087635] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T17:45:58.266731] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-30T17:45:58.654390] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-30T17:45:58.794919] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T17:45:59.011359] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-30T17:45:59.454391] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-30T17:46:00.046386] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T17:46:00.254408] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-30T17:46:01.054393] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-30T17:46:01.622514] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T17:46:01.854376] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-30T17:46:01.978154] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T17:46:02.629551] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T17:46:02.654377] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-30T17:46:03.454387] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-30T17:46:03.896406] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-30T17:46:04.207352] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T17:46:04.254428] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-30T17:46:04.935194] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T17:46:05.054414] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-30T17:46:05.854385] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-30T17:46:06.660979] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-30T17:46:06.666991] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T17:46:07.454432] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-30T17:46:07.665165] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T17:46:07.791701] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T17:46:07.795234] [INFO ] [REMOTE ] BWG: Full fetch complete (17735 records). [2025-09-30T17:46:07.795332] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-30T17:46:07.796038] [FATAL] [VALIDATOR ] BWG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:46:07.796124] [FATAL] [MAIN ] BWG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:46:07.796182] [WARN ] [MAIN ] BWG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:46:07.796243] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-30T17:46:07.796303] [DEBUG] [LOCAL ] BWG: No primary data file found to delete. [2025-09-30T17:46:07.796393] [INFO ] [LOCAL ] BWG: Starting deletion of derivative data. [2025-09-30T17:46:07.796689] [DEBUG] [LOCAL ] BWG: Deleted derivative data file. [2025-09-30T17:46:07.796806] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWG took 53.2s. Estimated remaining: 4h 10m 45s. Rate: 8.0 symbols/min [2025-09-30T17:46:08.005810] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:08.009902] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-30T17:46:08.011520] [INFO ] [REMOTE ] BWSN: Full fetch complete (6144 records). [2025-09-30T17:46:08.011612] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-30T17:46:08.163424] [DEBUG] [LOCAL ] BXC: Loaded 13669 existing records from primary storage. [2025-09-30T17:46:08.189814] [INFO ] [MAIN ] BXC: Loaded 13669 existing records. [2025-09-30T17:46:08.277283] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-30T17:46:08.575825] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:46:08.615988] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-30T17:46:08.644779] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-30T17:46:08.645042] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-30T17:46:08.645182] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-30T17:46:08.645433] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-30T17:46:08.645516] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-30T17:46:08.645754] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-30T17:46:08.646394] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-30T17:46:08.646551] [DEBUG] [LOCAL ] BWSN: Trimmed 6144 records to 5105 (keeping 200 days of data) [2025-09-30T17:46:09.056741] [DEBUG] [LOCAL ] BWSN: Primary data saved (5105 records). [2025-09-30T17:46:09.056616] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-30T17:46:09.101725] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:09.097098] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-30T17:46:09.103245] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWSN took 17.7s. Estimated remaining: 4h 10m 4s. Rate: 8.0 symbols/min [2025-09-30T17:46:09.300555] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:09.350230] [DEBUG] [LOCAL ] BXMT: Loaded 47211 existing records from primary storage. [2025-09-30T17:46:09.350585] [INFO ] [MAIN ] BXMT: Loaded 47211 existing records. [2025-09-30T17:46:09.554493] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:46:09.554829] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-30T17:46:09.554937] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-30T17:46:09.557012] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-30T17:46:09.557077] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-30T17:46:09.858463] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-30T17:46:09.951215] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:10.199388] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T17:46:10.448022] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-30T17:46:10.654369] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-30T17:46:11.085826] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-30T17:46:11.439689] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:46:11.454346] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-30T17:46:12.227224] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T17:46:12.254314] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-30T17:46:12.877525] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T17:46:13.054397] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-30T17:46:13.854418] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-30T17:46:14.624313] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T17:46:14.654329] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-30T17:46:15.118235] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T17:46:15.196720] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-30T17:46:15.454407] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-30T17:46:16.254387] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-30T17:46:16.294089] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T17:46:17.054379] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-30T17:46:17.854346] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-30T17:46:18.067525] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T17:46:18.258425] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-30T17:46:18.654404] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-30T17:46:19.298281] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T17:46:19.454358] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-30T17:46:20.142618] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T17:46:20.254378] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-30T17:46:21.054391] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-30T17:46:21.267702] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T17:46:21.854402] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-30T17:46:22.250240] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-30T17:46:22.382854] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T17:46:22.457433] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-30T17:46:22.654353] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-30T17:46:23.454407] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-30T17:46:24.266378] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-30T17:46:24.295241] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T17:46:25.054355] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-30T17:46:25.101103] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T17:46:25.234733] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T17:46:25.237914] [INFO ] [REMOTE ] BXC: Full fetch complete (17760 records). [2025-09-30T17:46:25.238053] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-30T17:46:25.238726] [FATAL] [VALIDATOR ] BXC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:46:25.238838] [FATAL] [MAIN ] BXC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:46:25.238917] [WARN ] [MAIN ] BXC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:46:25.238995] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-30T17:46:25.239106] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-09-30T17:46:25.239173] [INFO ] [LOCAL ] BXC: Starting deletion of derivative data. [2025-09-30T17:46:25.239496] [DEBUG] [LOCAL ] BXC: Deleted derivative data file. [2025-09-30T17:46:25.239679] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BXC took 17.4s. Estimated remaining: 4h 10m 43s. Rate: 8.0 symbols/min [2025-09-30T17:46:25.427320] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:25.453052] [DEBUG] [LOCAL ] BXMX: Loaded 19482 existing records from primary storage. [2025-09-30T17:46:25.453408] [INFO ] [MAIN ] BXMX: Loaded 19482 existing records. [2025-09-30T17:46:25.662718] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:46:25.662962] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-30T17:46:25.663014] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-30T17:46:25.663849] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-30T17:46:25.663913] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-30T17:46:25.858952] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-30T17:46:26.065057] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:26.654410] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-30T17:46:27.303669] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-30T17:46:27.454360] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-30T17:46:27.515206] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T17:46:27.770330] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T17:46:28.254365] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-30T17:46:29.054371] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-30T17:46:29.373002] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T17:46:29.799778] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T17:46:29.854348] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-30T17:46:30.036700] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T17:46:30.654375] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-30T17:46:31.454344] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-30T17:46:31.549687] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T17:46:32.254418] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-30T17:46:32.551840] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T17:46:32.567341] [INFO ] [REMOTE ] BWXT: Full fetch complete (67399 records). [2025-09-30T17:46:32.567584] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-30T17:46:32.734877] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-30T17:46:33.054410] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-30T17:46:33.054581] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-30T17:46:33.054703] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-30T17:46:33.057343] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-30T17:46:33.057559] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-30T17:46:33.062718] [DEBUG] [LOCAL ] BWXT: Trimmed 67399 records to 46809 (keeping 200 days of data) [2025-09-30T17:46:33.380275] [DEBUG] [LOCAL ] BWXT: Primary data saved (46809 records). [2025-09-30T17:46:33.380448] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-30T17:46:33.380587] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BWXT took 40.8s. Estimated remaining: 4h 10m 39s. Rate: 8.0 symbols/min [2025-09-30T17:46:33.565598] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:33.565840] [DEBUG] [LOCAL ] BXP: No existing data file found in primary storage. [2025-09-30T17:46:33.565909] [WARN ] [MAIN ] BXP: No existing data found, performing full refresh instead. [2025-09-30T17:46:33.566035] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-30T17:46:33.566078] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-30T17:46:33.566148] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-09-30T17:46:33.566219] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-30T17:46:33.858480] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-30T17:46:33.948031] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:34.302114] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-30T17:46:34.313483] [INFO ] [REMOTE ] BX: Full fetch complete (77012 records). [2025-09-30T17:46:34.313636] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-30T17:46:34.317171] [FATAL] [VALIDATOR ] BX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:46:34.317274] [FATAL] [MAIN ] BX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:46:34.317346] [WARN ] [MAIN ] BX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:46:34.317423] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-30T17:46:34.317493] [DEBUG] [LOCAL ] BX: No primary data file found to delete. [2025-09-30T17:46:34.317533] [INFO ] [LOCAL ] BX: Starting deletion of derivative data. [2025-09-30T17:46:34.317876] [DEBUG] [LOCAL ] BX: Deleted derivative data file. [2025-09-30T17:46:34.319798] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BX took 40.0s. Estimated remaining: 4h 9m 56s. Rate: 8.0 symbols/min [2025-09-30T17:46:34.512697] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:34.574147] [DEBUG] [LOCAL ] BXSL: Loaded 47578 existing records from primary storage. [2025-09-30T17:46:34.574582] [INFO ] [MAIN ] BXSL: Loaded 47578 existing records. [2025-09-30T17:46:34.659425] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-30T17:46:34.808966] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T17:46:34.838988] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:46:34.850175] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:46:34.850363] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-30T17:46:34.855950] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-30T17:46:34.858939] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-30T17:46:34.859007] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-30T17:46:35.266333] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:35.454353] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-30T17:46:36.254365] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-30T17:46:36.503462] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T17:46:36.567902] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T17:46:37.054378] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-30T17:46:37.697962] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:46:37.854327] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-30T17:46:37.997032] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T17:46:38.654357] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-30T17:46:39.454338] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-30T17:46:39.532212] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T17:46:39.705061] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T17:46:40.254427] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-30T17:46:41.054352] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-30T17:46:41.202228] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T17:46:41.417253] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:46:41.854351] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-30T17:46:42.083079] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T17:46:42.654363] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-30T17:46:43.394689] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T17:46:43.454367] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-30T17:46:43.835969] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T17:46:44.254372] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-30T17:46:45.061371] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-30T17:46:45.067119] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T17:46:45.077880] [INFO ] [REMOTE ] BXMT: Full fetch complete (69262 records). [2025-09-30T17:46:45.078069] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-30T17:46:45.079169] [FATAL] [VALIDATOR ] BXMT: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:46:45.079297] [FATAL] [MAIN ] BXMT: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:46:45.079351] [WARN ] [MAIN ] BXMT: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:46:45.079424] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-30T17:46:45.079567] [DEBUG] [LOCAL ] BXMT: No primary data file found to delete. [2025-09-30T17:46:45.079626] [INFO ] [LOCAL ] BXMT: Starting deletion of derivative data. [2025-09-30T17:46:45.079932] [DEBUG] [LOCAL ] BXMT: Deleted derivative data file. [2025-09-30T17:46:45.080041] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BXMT took 36.0s. Estimated remaining: 4h 10m 6s. Rate: 8.0 symbols/min [2025-09-30T17:46:45.222636] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T17:46:45.279508] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:45.303196] [DEBUG] [LOCAL ] BY: Loaded 21703 existing records from primary storage. [2025-09-30T17:46:45.303685] [INFO ] [MAIN ] BY: Loaded 21703 existing records. [2025-09-30T17:46:45.499558] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:46:45.499828] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-30T17:46:45.499880] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-30T17:46:45.500703] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-30T17:46:45.500765] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-30T17:46:45.859555] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-30T17:46:45.936493] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:46.654352] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-30T17:46:47.064950] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T17:46:47.070806] [INFO ] [REMOTE ] BXMX: Full fetch complete (28702 records). [2025-09-30T17:46:47.071010] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-30T17:46:47.071887] [FATAL] [VALIDATOR ] BXMX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:46:47.071995] [FATAL] [MAIN ] BXMX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:46:47.072040] [WARN ] [MAIN ] BXMX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:46:47.072090] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-30T17:46:47.072150] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-09-30T17:46:47.072188] [INFO ] [LOCAL ] BXMX: Starting deletion of derivative data. [2025-09-30T17:46:47.072691] [DEBUG] [LOCAL ] BXMX: Deleted derivative data file. [2025-09-30T17:46:47.072808] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 21.8s. Estimated remaining: 4h 9m 29s. Rate: 8.0 symbols/min [2025-09-30T17:46:47.300213] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:46:47.323149] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-30T17:46:47.391414] [DEBUG] [LOCAL ] BYD: Loaded 45040 existing records from primary storage. [2025-09-30T17:46:47.391788] [INFO ] [MAIN ] BYD: Loaded 45040 existing records. [2025-09-30T17:46:47.467874] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-30T17:46:47.601896] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:46:47.602216] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-30T17:46:47.602356] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-30T17:46:47.608773] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-30T17:46:47.616265] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-30T17:46:47.641956] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T17:46:48.009374] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:46:48.254359] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-30T17:46:49.054349] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-30T17:46:49.127548] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T17:46:49.854327] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-30T17:46:49.943422] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T17:46:50.068391] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T17:46:50.654393] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-30T17:46:51.454331] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-30T17:46:51.649382] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T17:46:52.200206] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T17:46:52.254347] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-30T17:46:52.654804] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T17:46:53.054398] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-30T17:46:53.850279] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T17:46:53.854927] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-30T17:46:53.934485] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T17:46:54.654430] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-30T17:46:54.863012] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T17:46:55.454361] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-30T17:46:56.254424] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-30T17:46:56.713920] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-30T17:46:56.742237] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T17:46:57.054368] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-30T17:46:57.854370] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-30T17:46:58.044748] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T17:46:58.122047] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T17:46:58.654394] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-30T17:46:59.454420] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-30T17:46:59.522637] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T17:47:00.263804] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-30T17:47:00.295431] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T17:47:00.529501] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T17:47:01.054411] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-30T17:47:01.706989] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:47:01.854366] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-30T17:47:02.539966] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:47:02.654319] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-30T17:47:03.264511] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T17:47:03.454358] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-30T17:47:03.994598] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T17:47:04.254407] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-30T17:47:05.054373] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-30T17:47:05.192874] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T17:47:05.778578] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T17:47:05.854389] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-30T17:47:06.310777] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T17:47:06.654405] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-30T17:47:07.454382] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-30T17:47:07.936929] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-30T17:47:07.948475] [INFO ] [REMOTE ] BXSL: Full fetch complete (69403 records). [2025-09-30T17:47:07.948667] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-30T17:47:08.256507] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-30T17:47:08.361773] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-30T17:47:08.362010] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-30T17:47:08.362972] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-30T17:47:08.363160] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-30T17:47:08.364992] [DEBUG] [LOCAL ] BXSL: Trimmed 69403 records to 47607 (keeping 200 days of data) [2025-09-30T17:47:08.518028] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T17:47:08.730075] [DEBUG] [LOCAL ] BXSL: Primary data saved (47607 records). [2025-09-30T17:47:08.730284] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-30T17:47:08.731137] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXSL took 34.4s. Estimated remaining: 4h 10m 37s. Rate: 8.0 symbols/min [2025-09-30T17:47:08.965055] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:08.980177] [DEBUG] [LOCAL ] BYM: Loaded 12098 existing records from primary storage. [2025-09-30T17:47:08.980435] [INFO ] [MAIN ] BYM: Loaded 12098 existing records. [2025-09-30T17:47:09.055555] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-30T17:47:09.170443] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:47:09.171253] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-30T17:47:09.171341] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-30T17:47:09.185792] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-30T17:47:09.197175] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-30T17:47:09.238818] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T17:47:09.353536] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T17:47:09.629579] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:09.854400] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-30T17:47:10.654326] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-30T17:47:10.869953] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T17:47:11.095720] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T17:47:11.107260] [INFO ] [REMOTE ] BXP: Full fetch complete (71417 records). [2025-09-30T17:47:11.107437] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-30T17:47:11.459503] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-30T17:47:11.565863] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-30T17:47:11.566002] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-30T17:47:11.567159] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-30T17:47:11.567244] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-30T17:47:11.569366] [DEBUG] [LOCAL ] BXP: Trimmed 71417 records to 49851 (keeping 200 days of data) [2025-09-30T17:47:11.853231] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T17:47:11.941899] [DEBUG] [LOCAL ] BXP: Primary data saved (49851 records). [2025-09-30T17:47:11.942045] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-30T17:47:11.942124] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXP took 38.6s. Estimated remaining: 4h 10m 7s. Rate: 8.0 symbols/min [2025-09-30T17:47:12.141017] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:12.174608] [DEBUG] [LOCAL ] BZH: Loaded 32490 existing records from primary storage. [2025-09-30T17:47:12.174946] [INFO ] [MAIN ] BZH: Loaded 32490 existing records. [2025-09-30T17:47:12.259498] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-30T17:47:12.367026] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:47:12.367331] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-30T17:47:12.367390] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-30T17:47:12.368771] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-30T17:47:12.368835] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-30T17:47:12.735263] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:13.054394] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-30T17:47:13.201260] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T17:47:13.381169] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T17:47:13.742165] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T17:47:13.854380] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-30T17:47:14.654404] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-30T17:47:15.465867] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-30T17:47:15.473163] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T17:47:15.492627] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T17:47:16.254431] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-30T17:47:16.635883] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T17:47:16.644377] [INFO ] [REMOTE ] BY: Full fetch complete (29477 records). [2025-09-30T17:47:16.644613] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-30T17:47:17.059688] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-30T17:47:17.245122] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-30T17:47:17.245247] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-30T17:47:17.245878] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-30T17:47:17.245946] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-30T17:47:17.247085] [DEBUG] [LOCAL ] BY: Trimmed 29477 records to 21722 (keeping 200 days of data) [2025-09-30T17:47:17.416794] [DEBUG] [LOCAL ] BY: Primary data saved (21722 records). [2025-09-30T17:47:17.416969] [INFO ] [MAIN ] BY: Full history saved. [2025-09-30T17:47:17.417070] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BY took 32.3s. Estimated remaining: 4h 9m 48s. Rate: 8.0 symbols/min [2025-09-30T17:47:17.612216] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:17.675864] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-30T17:47:17.676268] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-09-30T17:47:17.855419] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-30T17:47:17.891798] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:47:17.893626] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-30T17:47:17.893894] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-30T17:47:17.904142] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-30T17:47:17.909526] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-30T17:47:18.006688] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T17:47:18.073851] [INFO ] [REMOTE ] BYD: Full fetch complete (64984 records). [2025-09-30T17:47:18.103248] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-30T17:47:18.350414] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T17:47:18.666203] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:18.674829] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-30T17:47:18.827933] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-30T17:47:18.828092] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-30T17:47:18.828908] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-30T17:47:18.828982] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-30T17:47:18.830425] [DEBUG] [LOCAL ] BYD: Trimmed 64984 records to 45002 (keeping 200 days of data) [2025-09-30T17:47:19.085106] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T17:47:19.147888] [DEBUG] [LOCAL ] BYD: Primary data saved (45002 records). [2025-09-30T17:47:19.148023] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-30T17:47:19.148117] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BYD took 32.1s. Estimated remaining: 4h 9m 10s. Rate: 8.0 symbols/min [2025-09-30T17:47:19.328878] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:19.349946] [DEBUG] [LOCAL ] CAAP: Loaded 19823 existing records from primary storage. [2025-09-30T17:47:19.350200] [INFO ] [MAIN ] CAAP: Loaded 19823 existing records. [2025-09-30T17:47:19.459503] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-30T17:47:19.549093] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:47:19.549367] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-30T17:47:19.549480] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-30T17:47:19.550471] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-30T17:47:19.550539] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-30T17:47:19.767384] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T17:47:20.032729] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:20.254364] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-30T17:47:20.781124] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T17:47:21.054364] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-30T17:47:21.399494] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T17:47:21.854363] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-30T17:47:22.654364] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-30T17:47:22.988457] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T17:47:23.189676] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-30T17:47:23.454365] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-30T17:47:23.931853] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T17:47:24.254572] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-30T17:47:24.756177] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T17:47:24.840807] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T17:47:25.054373] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-30T17:47:25.854362] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-30T17:47:26.635066] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T17:47:26.654324] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-30T17:47:26.902020] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T17:47:27.449073] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T17:47:27.454314] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-30T17:47:28.254368] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-30T17:47:28.429000] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T17:47:28.432403] [INFO ] [REMOTE ] BYM: Full fetch complete (18047 records). [2025-09-30T17:47:28.432501] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-30T17:47:28.824778] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-30T17:47:28.824867] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-30T17:47:28.825277] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-30T17:47:28.825321] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-30T17:47:28.826175] [DEBUG] [LOCAL ] BYM: Trimmed 18047 records to 12028 (keeping 200 days of data) [2025-09-30T17:47:28.907778] [DEBUG] [LOCAL ] BYM: Primary data saved (12028 records). [2025-09-30T17:47:28.907929] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-30T17:47:28.908018] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYM took 20.2s. Estimated remaining: 4h 9m 15s. Rate: 8.0 symbols/min [2025-09-30T17:47:29.064920] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-30T17:47:29.101492] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:29.101712] [DEBUG] [LOCAL ] CABO: No existing data file found in primary storage. [2025-09-30T17:47:29.101776] [WARN ] [MAIN ] CABO: No existing data found, performing full refresh instead. [2025-09-30T17:47:29.101922] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-30T17:47:29.101972] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-30T17:47:29.102016] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-09-30T17:47:29.102107] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-30T17:47:29.274041] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T17:47:29.524270] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:29.854373] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-30T17:47:30.654375] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-30T17:47:30.948687] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-30T17:47:31.312861] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T17:47:31.454368] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-30T17:47:31.499462] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T17:47:32.254360] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-30T17:47:32.894549] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T17:47:33.054319] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-30T17:47:33.140134] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T17:47:33.854357] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-30T17:47:34.227566] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T17:47:34.654362] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-30T17:47:35.454331] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-30T17:47:35.515207] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T17:47:35.749547] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T17:47:36.254376] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-30T17:47:36.519278] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T17:47:37.018718] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T17:47:37.054400] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-30T17:47:37.854358] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-30T17:47:37.921539] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T17:47:38.654321] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-30T17:47:39.078896] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T17:47:39.454370] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-30T17:47:39.483678] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T17:47:40.254418] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-30T17:47:40.750630] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:47:41.054391] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-30T17:47:41.854337] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-30T17:47:41.994770] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T17:47:42.489791] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-30T17:47:42.654387] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-30T17:47:42.994868] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-30T17:47:43.454350] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-30T17:47:44.199322] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T17:47:44.254399] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-30T17:47:45.054321] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-30T17:47:45.365564] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:47:45.602933] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-30T17:47:45.854373] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-30T17:47:45.988968] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T17:47:46.635690] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T17:47:46.654337] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-30T17:47:47.402795] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:47:47.454377] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-30T17:47:48.254393] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-30T17:47:48.863363] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T17:47:48.871434] [INFO ] [REMOTE ] BZH: Full fetch complete (46938 records). [2025-09-30T17:47:48.871568] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-30T17:47:49.055312] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-30T17:47:49.354003] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-30T17:47:49.359776] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-30T17:47:49.370591] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-30T17:47:49.371402] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-30T17:47:49.372185] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T17:47:49.378957] [INFO ] [REMOTE ] CAAP: Full fetch complete (27999 records). [2025-09-30T17:47:49.379316] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-30T17:47:49.415444] [DEBUG] [LOCAL ] BZH: Trimmed 46938 records to 32445 (keeping 200 days of data) [2025-09-30T17:47:49.867224] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-30T17:47:49.929391] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-30T17:47:49.929560] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-30T17:47:49.933763] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-30T17:47:49.971778] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-30T17:47:49.998033] [DEBUG] [LOCAL ] CAAP: Trimmed 27999 records to 19924 (keeping 200 days of data) [2025-09-30T17:47:50.100933] [DEBUG] [LOCAL ] BZH: Primary data saved (32445 records). [2025-09-30T17:47:50.104693] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-30T17:47:50.104853] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 38.2s. Estimated remaining: 4h 10m 19s. Rate: 8.0 symbols/min [2025-09-30T17:47:50.308108] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:50.309079] [DEBUG] [LOCAL ] CACI: No existing data file found in primary storage. [2025-09-30T17:47:50.309211] [WARN ] [MAIN ] CACI: No existing data found, performing full refresh instead. [2025-09-30T17:47:50.310443] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-30T17:47:50.318208] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-30T17:47:50.327951] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-09-30T17:47:50.328864] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-30T17:47:50.332939] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T17:47:50.347105] [DEBUG] [LOCAL ] CAAP: Primary data saved (19924 records). [2025-09-30T17:47:50.362579] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-30T17:47:50.400936] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. CAAP took 31.3s. Estimated remaining: 4h 9m 34s. Rate: 8.0 symbols/min [2025-09-30T17:47:50.658144] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-30T17:47:50.706946] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:50.761722] [DEBUG] [LOCAL ] CADE: No existing data file found in primary storage. [2025-09-30T17:47:50.767456] [WARN ] [MAIN ] CADE: No existing data found, performing full refresh instead. [2025-09-30T17:47:50.774960] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-30T17:47:50.803737] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-30T17:47:50.810979] [DEBUG] [LOCAL ] CADE: No primary data file found to delete. [2025-09-30T17:47:50.823117] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-30T17:47:51.067440] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:51.338735] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:51.454331] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-30T17:47:51.530745] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T17:47:51.749512] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:47:52.254382] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-30T17:47:53.054332] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-30T17:47:53.193131] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T17:47:53.283339] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T17:47:53.854412] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-30T17:47:54.067617] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-30T17:47:54.072856] [INFO ] [REMOTE ] CABO: Full fetch complete (23109 records). [2025-09-30T17:47:54.073056] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-30T17:47:54.488385] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-30T17:47:54.488500] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-30T17:47:54.489074] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-30T17:47:54.489142] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-30T17:47:54.489922] [DEBUG] [LOCAL ] CABO: Trimmed 23109 records to 17138 (keeping 200 days of data) [2025-09-30T17:47:54.607929] [DEBUG] [LOCAL ] CABO: Primary data saved (17138 records). [2025-09-30T17:47:54.608183] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-30T17:47:54.608328] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CABO took 25.7s. Estimated remaining: 4h 9m 9s. Rate: 8.0 symbols/min [2025-09-30T17:47:54.659696] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-30T17:47:54.803580] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:47:54.851054] [DEBUG] [LOCAL ] CAE: Loaded 38991 existing records from primary storage. [2025-09-30T17:47:54.851479] [INFO ] [MAIN ] CAE: Loaded 38991 existing records. [2025-09-30T17:47:55.036488] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:47:55.036838] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-30T17:47:55.036905] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-30T17:47:55.038144] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-30T17:47:55.038209] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-30T17:47:55.413059] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:47:55.454382] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-30T17:47:55.805154] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T17:47:56.149134] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-30T17:47:56.254386] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-30T17:47:57.033979] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T17:47:57.054361] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-30T17:47:57.403105] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T17:47:57.854377] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-30T17:47:58.406739] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T17:47:58.654368] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-30T17:47:59.018850] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:47:59.454388] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-30T17:48:00.108505] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T17:48:00.254386] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-30T17:48:00.784296] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T17:48:01.054400] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-30T17:48:01.624757] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T17:48:01.854389] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-30T17:48:02.654393] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-30T17:48:02.731483] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T17:48:03.030190] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T17:48:03.454400] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-30T17:48:04.210950] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T17:48:04.254375] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-30T17:48:04.696507] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T17:48:05.054398] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-30T17:48:05.791006] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T17:48:05.854344] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-30T17:48:06.174813] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T17:48:06.654412] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-30T17:48:07.454418] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-30T17:48:07.744890] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T17:48:08.254369] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-30T17:48:08.324265] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T17:48:08.544319] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:48:09.054376] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-30T17:48:09.854385] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-30T17:48:10.397681] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-30T17:48:10.410437] [INFO ] [REMOTE ] C: Full fetch complete (77785 records). [2025-09-30T17:48:10.410669] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-30T17:48:10.666073] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-30T17:48:10.864487] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-30T17:48:10.864731] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-30T17:48:10.865905] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-30T17:48:10.866006] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-30T17:48:10.897684] [DEBUG] [LOCAL ] C: Trimmed 77785 records to 53741 (keeping 200 days of data) [2025-09-30T17:48:10.899003] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T17:48:11.162870] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-30T17:48:11.171131] [INFO ] [REMOTE ] CACI: Full fetch complete (39008 records). [2025-09-30T17:48:11.174122] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-30T17:48:11.456807] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-30T17:48:11.653501] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-09-30T17:48:11.663972] [INFO ] [MAIN ] C: Full history saved. [2025-09-30T17:48:11.664148] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. C took 54.2s. Estimated remaining: 4h 9m 51s. Rate: 8.0 symbols/min [2025-09-30T17:48:11.833273] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-30T17:48:11.866324] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-30T17:48:11.888238] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-30T17:48:11.888851] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-30T17:48:11.950387] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:11.951624] [DEBUG] [LOCAL ] CAF: No existing data file found in primary storage. [2025-09-30T17:48:11.951737] [WARN ] [MAIN ] CAF: No existing data found, performing full refresh instead. [2025-09-30T17:48:11.951895] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-30T17:48:11.951964] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-30T17:48:11.951505] [DEBUG] [LOCAL ] CACI: Trimmed 39008 records to 24598 (keeping 200 days of data) [2025-09-30T17:48:11.952128] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-09-30T17:48:11.952617] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-30T17:48:12.364023] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T17:48:12.429589] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-30T17:48:12.524717] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:12.567789] [DEBUG] [LOCAL ] CACI: Primary data saved (24598 records). [2025-09-30T17:48:12.567930] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-30T17:48:12.568011] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CACI took 22.5s. Estimated remaining: 4h 9m 9s. Rate: 8.0 symbols/min [2025-09-30T17:48:12.762411] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:12.829012] [DEBUG] [LOCAL ] CAG: Loaded 53660 existing records from primary storage. [2025-09-30T17:48:12.829746] [INFO ] [MAIN ] CAG: Loaded 53660 existing records. [2025-09-30T17:48:13.032149] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:48:13.032484] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-30T17:48:13.032575] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-30T17:48:13.034096] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-30T17:48:13.034159] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-30T17:48:13.065293] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-30T17:48:13.405751] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:13.532280] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-30T17:48:13.854445] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-30T17:48:13.970440] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T17:48:14.269323] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T17:48:14.654366] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-30T17:48:15.287758] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T17:48:15.454415] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-30T17:48:15.939616] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-30T17:48:16.086454] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T17:48:16.254370] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-30T17:48:16.825078] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T17:48:17.054362] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-30T17:48:17.667271] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T17:48:17.854376] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-30T17:48:18.418786] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-30T17:48:18.654372] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-30T17:48:19.153717] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-30T17:48:19.454361] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-30T17:48:19.912509] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-30T17:48:20.254367] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-30T17:48:20.653610] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T17:48:21.054382] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-30T17:48:21.854383] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-30T17:48:22.654362] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-30T17:48:22.709047] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:48:23.454353] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-30T17:48:23.575516] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T17:48:24.014727] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-30T17:48:24.154030] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T17:48:24.155524] [INFO ] [REMOTE ] CAF: Full fetch complete (5525 records). [2025-09-30T17:48:24.155599] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-30T17:48:24.156139] [FATAL] [VALIDATOR ] CAF: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:48:24.156282] [FATAL] [MAIN ] CAF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:48:24.156337] [WARN ] [MAIN ] CAF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:48:24.156417] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-30T17:48:24.156503] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-09-30T17:48:24.156543] [INFO ] [LOCAL ] CAF: Starting deletion of derivative data. [2025-09-30T17:48:24.156613] [DEBUG] [LOCAL ] CAF: No derivative data file found to delete. [2025-09-30T17:48:24.156748] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAF took 12.5s. Estimated remaining: 4h 9m 22s. Rate: 8.0 symbols/min [2025-09-30T17:48:24.259474] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-30T17:48:24.352460] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:24.410694] [DEBUG] [LOCAL ] CAH: Loaded 51421 existing records from primary storage. [2025-09-30T17:48:24.411051] [INFO ] [MAIN ] CAH: Loaded 51421 existing records. [2025-09-30T17:48:24.606315] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:48:24.606549] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-30T17:48:24.606597] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-30T17:48:24.608065] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-30T17:48:24.608129] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-30T17:48:25.003835] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:25.054354] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-30T17:48:25.854382] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-30T17:48:26.112037] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-30T17:48:26.470784] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T17:48:26.654440] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-30T17:48:27.260921] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T17:48:27.272161] [INFO ] [REMOTE ] CADE: Full fetch complete (69817 records). [2025-09-30T17:48:27.272393] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-30T17:48:27.455887] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-30T17:48:27.723054] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-30T17:48:27.723165] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-30T17:48:27.724116] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-30T17:48:27.724195] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-30T17:48:27.726217] [DEBUG] [LOCAL ] CADE: Trimmed 69817 records to 48810 (keeping 200 days of data) [2025-09-30T17:48:28.046599] [DEBUG] [LOCAL ] CADE: Primary data saved (48810 records). [2025-09-30T17:48:28.046849] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-30T17:48:28.046975] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CADE took 37.6s. Estimated remaining: 4h 8m 56s. Rate: 8.0 symbols/min [2025-09-30T17:48:28.261866] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-30T17:48:28.283247] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:28.283606] [DEBUG] [LOCAL ] CAL: No existing data file found in primary storage. [2025-09-30T17:48:28.283693] [WARN ] [MAIN ] CAL: No existing data found, performing full refresh instead. [2025-09-30T17:48:28.283885] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-30T17:48:28.284054] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-30T17:48:28.284562] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-09-30T17:48:28.285022] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-30T17:48:28.292240] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T17:48:28.686103] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:29.049066] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T17:48:29.062891] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-30T17:48:29.854360] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-30T17:48:30.026530] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T17:48:30.654380] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-30T17:48:30.704447] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T17:48:31.353240] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T17:48:31.454353] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-30T17:48:32.254346] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-30T17:48:32.444116] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T17:48:33.054332] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-30T17:48:33.336311] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T17:48:33.708244] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:48:33.854346] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-30T17:48:34.374961] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T17:48:34.654395] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-30T17:48:35.454323] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-30T17:48:35.735060] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T17:48:36.122162] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T17:48:36.254361] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-30T17:48:37.025297] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T17:48:37.054315] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-30T17:48:37.854341] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-30T17:48:37.975226] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T17:48:38.524986] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T17:48:38.536353] [INFO ] [REMOTE ] CAE: Full fetch complete (55885 records). [2025-09-30T17:48:38.536586] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-30T17:48:38.659684] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-30T17:48:39.025736] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-30T17:48:39.025947] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-30T17:48:39.026664] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-30T17:48:39.026728] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-30T17:48:39.028199] [DEBUG] [LOCAL ] CAE: Trimmed 55885 records to 39024 (keeping 200 days of data) [2025-09-30T17:48:39.264916] [DEBUG] [LOCAL ] CAE: Primary data saved (39024 records). [2025-09-30T17:48:39.265073] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-30T17:48:39.265882] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAE took 44.7s. Estimated remaining: 4h 9m 8s. Rate: 8.0 symbols/min [2025-09-30T17:48:39.449938] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:39.450154] [DEBUG] [LOCAL ] CALX: No existing data file found in primary storage. [2025-09-30T17:48:39.450224] [WARN ] [MAIN ] CALX: No existing data found, performing full refresh instead. [2025-09-30T17:48:39.450417] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-30T17:48:39.450509] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-30T17:48:39.450563] [DEBUG] [LOCAL ] CALX: No primary data file found to delete. [2025-09-30T17:48:39.450597] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-30T17:48:39.488203] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-30T17:48:39.839344] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:40.003752] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-30T17:48:40.254385] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-30T17:48:41.054407] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-30T17:48:41.096373] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-30T17:48:41.470282] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T17:48:41.754056] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T17:48:41.854414] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-30T17:48:42.080895] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T17:48:42.654424] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-30T17:48:43.454354] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-30T17:48:43.691007] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T17:48:44.254367] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-30T17:48:44.827568] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:48:44.867144] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-30T17:48:44.878966] [INFO ] [REMOTE ] CAG: Full fetch complete (77651 records). [2025-09-30T17:48:44.879203] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-30T17:48:45.059925] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-30T17:48:45.332228] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-30T17:48:45.332326] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-30T17:48:45.333281] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-30T17:48:45.333351] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-30T17:48:45.335065] [DEBUG] [LOCAL ] CAG: Trimmed 77651 records to 53661 (keeping 200 days of data) [2025-09-30T17:48:45.674880] [DEBUG] [LOCAL ] CAG: Primary data saved (53661 records). [2025-09-30T17:48:45.675040] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-30T17:48:45.675128] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAG took 33.1s. Estimated remaining: 4h 8m 54s. Rate: 8.0 symbols/min [2025-09-30T17:48:45.877404] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:45.873699] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-30T17:48:45.905327] [DEBUG] [LOCAL ] CANG: Loaded 26896 existing records from primary storage. [2025-09-30T17:48:45.905623] [INFO ] [MAIN ] CANG: Loaded 26896 existing records. [2025-09-30T17:48:46.131088] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:48:46.131881] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-30T17:48:46.132018] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-30T17:48:46.144280] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-30T17:48:46.149517] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-30T17:48:46.234337] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T17:48:46.568199] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:46.654320] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-30T17:48:46.834921] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T17:48:46.905041] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T17:48:47.454361] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-30T17:48:48.254341] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-30T17:48:48.310469] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T17:48:49.025893] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T17:48:49.054329] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-30T17:48:49.854314] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-30T17:48:50.129083] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T17:48:50.186515] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T17:48:50.654359] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-30T17:48:51.060617] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T17:48:51.454396] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-30T17:48:51.942160] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T17:48:52.254388] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-30T17:48:53.028416] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T17:48:53.054359] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-30T17:48:53.854332] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-30T17:48:54.133059] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T17:48:54.544615] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T17:48:54.654342] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-30T17:48:55.454351] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-30T17:48:55.617726] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:48:56.252495] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T17:48:56.261001] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-30T17:48:56.266713] [INFO ] [REMOTE ] CAL: Full fetch complete (61507 records). [2025-09-30T17:48:56.266859] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-30T17:48:56.268068] [FATAL] [VALIDATOR ] CAL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:48:56.268205] [FATAL] [MAIN ] CAL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:48:56.268305] [WARN ] [MAIN ] CAL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:48:56.268386] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-30T17:48:56.268457] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-09-30T17:48:56.268510] [INFO ] [LOCAL ] CAL: Starting deletion of derivative data. [2025-09-30T17:48:56.268595] [DEBUG] [LOCAL ] CAL: No derivative data file found to delete. [2025-09-30T17:48:56.268727] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAL took 28.2s. Estimated remaining: 4h 9m 2s. Rate: 8.0 symbols/min [2025-09-30T17:48:56.459722] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:56.459975] [DEBUG] [LOCAL ] CAPL: No existing data file found in primary storage. [2025-09-30T17:48:56.460098] [WARN ] [MAIN ] CAPL: No existing data found, performing full refresh instead. [2025-09-30T17:48:56.460190] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-30T17:48:56.460229] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-30T17:48:56.460271] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-09-30T17:48:56.460304] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-30T17:48:56.868303] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:56.972189] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T17:48:56.984101] [INFO ] [REMOTE ] CAH: Full fetch complete (74610 records). [2025-09-30T17:48:56.984323] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-30T17:48:57.059461] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-30T17:48:57.433084] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-30T17:48:57.433188] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-30T17:48:57.434101] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-30T17:48:57.434170] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-30T17:48:57.435817] [DEBUG] [LOCAL ] CAH: Trimmed 74610 records to 51417 (keeping 200 days of data) [2025-09-30T17:48:57.821809] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T17:48:57.833432] [DEBUG] [LOCAL ] CAH: Primary data saved (51417 records). [2025-09-30T17:48:57.833943] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-30T17:48:57.834129] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAH took 33.7s. Estimated remaining: 4h 8m 24s. Rate: 8.0 symbols/min [2025-09-30T17:48:57.859447] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-30T17:48:58.038026] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:48:58.056950] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T17:48:58.119269] [DEBUG] [LOCAL ] CARR: Loaded 53594 existing records from primary storage. [2025-09-30T17:48:58.119745] [INFO ] [MAIN ] CARR: Loaded 53594 existing records. [2025-09-30T17:48:58.314165] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:48:58.314456] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-30T17:48:58.314513] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-30T17:48:58.315632] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-30T17:48:58.315738] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-30T17:48:58.659513] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-30T17:48:58.730740] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:48:58.782691] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T17:48:59.454402] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-30T17:49:00.036633] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T17:49:00.185091] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T17:49:00.254374] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-30T17:49:00.724152] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T17:49:01.054377] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-30T17:49:01.854360] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-30T17:49:02.087808] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T17:49:02.654385] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-30T17:49:03.201939] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T17:49:03.454428] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-30T17:49:03.541500] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T17:49:04.254363] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-30T17:49:04.957049] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-30T17:49:05.034049] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:49:05.054316] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-30T17:49:05.854361] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T17:49:05.854444] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-30T17:49:06.654357] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-30T17:49:07.454361] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-30T17:49:07.683614] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T17:49:08.146852] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T17:49:08.254326] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-30T17:49:08.724686] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-30T17:49:09.054352] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-30T17:49:09.741590] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T17:49:09.749253] [INFO ] [REMOTE ] CALX: Full fetch complete (54105 records). [2025-09-30T17:49:09.749364] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-30T17:49:09.863104] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-30T17:49:09.927160] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T17:49:10.187019] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-30T17:49:10.187106] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-30T17:49:10.187756] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-30T17:49:10.187820] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-30T17:49:10.189026] [DEBUG] [LOCAL ] CALX: Trimmed 54105 records to 37984 (keeping 200 days of data) [2025-09-30T17:49:10.430201] [DEBUG] [LOCAL ] CALX: Primary data saved (37984 records). [2025-09-30T17:49:10.430366] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-30T17:49:10.430459] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CALX took 31.2s. Estimated remaining: 4h 8m 43s. Rate: 8.0 symbols/min [2025-09-30T17:49:10.615296] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:49:10.658146] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-30T17:49:10.660108] [DEBUG] [LOCAL ] CARS: Loaded 39894 existing records from primary storage. [2025-09-30T17:49:10.660530] [INFO ] [MAIN ] CARS: Loaded 39894 existing records. [2025-09-30T17:49:10.866788] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:49:10.867068] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-30T17:49:10.867137] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-30T17:49:10.867615] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-30T17:49:10.867787] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-30T17:49:11.175177] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T17:49:11.262112] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:49:11.454370] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-30T17:49:11.767954] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-30T17:49:12.179984] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T17:49:12.254348] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-30T17:49:12.824842] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-30T17:49:12.826814] [INFO ] [REMOTE ] CAPL: Full fetch complete (8858 records). [2025-09-30T17:49:12.826925] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-30T17:49:13.059543] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-30T17:49:13.227510] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-30T17:49:13.227604] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-30T17:49:13.227918] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-30T17:49:13.227993] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-30T17:49:13.228522] [DEBUG] [LOCAL ] CAPL: Trimmed 8858 records to 5788 (keeping 200 days of data) [2025-09-30T17:49:13.268965] [DEBUG] [LOCAL ] CAPL: Primary data saved (5788 records). [2025-09-30T17:49:13.269125] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-30T17:49:13.269211] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CAPL took 17.0s. Estimated remaining: 4h 8m 11s. Rate: 8.0 symbols/min [2025-09-30T17:49:13.475171] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:49:13.541741] [DEBUG] [LOCAL ] CAT: Loaded 52915 existing records from primary storage. [2025-09-30T17:49:13.542158] [INFO ] [MAIN ] CAT: Loaded 52915 existing records. [2025-09-30T17:49:13.745699] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:49:13.745948] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-30T17:49:13.745999] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-30T17:49:13.747592] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-30T17:49:13.747683] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-30T17:49:13.859551] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-30T17:49:14.149538] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:49:14.517963] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T17:49:14.654364] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-30T17:49:15.335528] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T17:49:15.454374] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-30T17:49:16.254339] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-30T17:49:16.520510] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T17:49:16.678179] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T17:49:17.054387] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-30T17:49:17.696786] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T17:49:17.854416] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-30T17:49:18.654432] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-30T17:49:18.948963] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T17:49:19.259596] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-30T17:49:19.454427] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-30T17:49:19.642309] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T17:49:20.254396] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-30T17:49:21.054380] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-30T17:49:21.639155] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-30T17:49:21.828942] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T17:49:21.854320] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-30T17:49:22.654386] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-30T17:49:23.054177] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T17:49:23.092865] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T17:49:23.454432] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-30T17:49:24.168164] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T17:49:24.176541] [INFO ] [REMOTE ] CANG: Full fetch complete (40620 records). [2025-09-30T17:49:24.176732] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-30T17:49:24.259559] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-30T17:49:24.633557] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-30T17:49:24.633694] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-30T17:49:24.634378] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-30T17:49:24.634447] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-30T17:49:24.635688] [DEBUG] [LOCAL ] CANG: Trimmed 40620 records to 27013 (keeping 200 days of data) [2025-09-30T17:49:24.807546] [DEBUG] [LOCAL ] CANG: Primary data saved (27013 records). [2025-09-30T17:49:24.807720] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-30T17:49:24.807816] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CANG took 39.1s. Estimated remaining: 4h 8m 24s. Rate: 8.0 symbols/min [2025-09-30T17:49:25.016625] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:49:25.027088] [DEBUG] [LOCAL ] CATO: Loaded 7098 existing records from primary storage. [2025-09-30T17:49:25.027335] [INFO ] [MAIN ] CATO: Loaded 7098 existing records. [2025-09-30T17:49:25.063086] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-30T17:49:25.229886] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:49:25.230282] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-30T17:49:25.230439] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-30T17:49:25.230864] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-30T17:49:25.230992] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-30T17:49:25.614084] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-30T17:49:25.701614] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:49:25.854358] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-30T17:49:26.002830] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T17:49:26.441748] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T17:49:26.654358] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-30T17:49:26.706179] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T17:49:27.454355] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-30T17:49:28.040024] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T17:49:28.254357] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-30T17:49:29.054359] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-30T17:49:29.232373] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T17:49:29.854341] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-30T17:49:30.540428] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-30T17:49:30.575536] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T17:49:30.654377] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-30T17:49:31.221745] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T17:49:31.307388] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T17:49:31.454406] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-30T17:49:32.254401] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-30T17:49:32.992288] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T17:49:33.054333] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-30T17:49:33.854367] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-30T17:49:34.264334] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T17:49:34.599555] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T17:49:34.605782] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T17:49:34.617185] [INFO ] [REMOTE ] CARS: Full fetch complete (55372 records). [2025-09-30T17:49:34.617354] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-30T17:49:34.659520] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-30T17:49:35.072403] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-30T17:49:35.072606] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-30T17:49:35.073339] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-30T17:49:35.073443] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-30T17:49:35.074753] [DEBUG] [LOCAL ] CARS: Trimmed 55372 records to 39829 (keeping 200 days of data) [2025-09-30T17:49:35.319975] [DEBUG] [LOCAL ] CARS: Primary data saved (39829 records). [2025-09-30T17:49:35.320137] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-30T17:49:35.320871] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CARS took 24.9s. Estimated remaining: 4h 8m 31s. Rate: 8.0 symbols/min [2025-09-30T17:49:35.457863] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-30T17:49:35.512500] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:49:35.538803] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T17:49:35.583842] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-09-30T17:49:35.584214] [INFO ] [MAIN ] CAVA: Loaded 53552 existing records. [2025-09-30T17:49:35.776757] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:49:35.777099] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-30T17:49:35.777158] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-30T17:49:35.778851] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-30T17:49:35.778913] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-30T17:49:36.158959] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:49:36.254343] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-30T17:49:37.054390] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-30T17:49:37.783184] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-30T17:49:37.854351] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-30T17:49:37.966333] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T17:49:38.280119] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-30T17:49:38.654383] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-30T17:49:39.256117] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T17:49:39.454361] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-30T17:49:39.839069] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-30T17:49:40.254387] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-30T17:49:40.915632] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T17:49:41.054352] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-30T17:49:41.660976] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T17:49:41.854321] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-30T17:49:42.210087] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-30T17:49:42.541703] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-30T17:49:42.654393] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-30T17:49:43.214635] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T17:49:43.454404] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-30T17:49:44.254363] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-30T17:49:44.373692] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T17:49:44.376342] [INFO ] [REMOTE ] CATO: Full fetch complete (11609 records). [2025-09-30T17:49:44.376435] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-30T17:49:44.797515] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-30T17:49:44.797855] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-30T17:49:44.798209] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-30T17:49:44.798299] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-30T17:49:44.798824] [DEBUG] [LOCAL ] CATO: Trimmed 11609 records to 7042 (keeping 200 days of data) [2025-09-30T17:49:44.841606] [DEBUG] [LOCAL ] CATO: Primary data saved (7042 records). [2025-09-30T17:49:44.841779] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-30T17:49:44.841885] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CATO took 20.0s. Estimated remaining: 4h 8m 34s. Rate: 7.9 symbols/min [2025-09-30T17:49:45.032494] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:49:45.065576] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-30T17:49:45.088056] [DEBUG] [LOCAL ] CB: Loaded 49973 existing records from primary storage. [2025-09-30T17:49:45.088468] [INFO ] [MAIN ] CB: Loaded 49973 existing records. [2025-09-30T17:49:45.288424] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:49:45.288696] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-30T17:49:45.288760] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-30T17:49:45.290236] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-30T17:49:45.290302] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-30T17:49:45.697243] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:49:45.854359] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-30T17:49:46.427256] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T17:49:46.443260] [INFO ] [REMOTE ] CARR: Full fetch complete (77606 records). [2025-09-30T17:49:46.443453] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-30T17:49:46.659466] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-30T17:49:46.880328] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-30T17:49:46.880522] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-30T17:49:46.881527] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-30T17:49:46.881599] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-30T17:49:46.883377] [DEBUG] [LOCAL ] CARR: Trimmed 77606 records to 53594 (keeping 200 days of data) [2025-09-30T17:49:47.226268] [DEBUG] [LOCAL ] CARR: Primary data saved (53594 records). [2025-09-30T17:49:47.226573] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-30T17:49:47.226739] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CARR took 49.4s. Estimated remaining: 4h 8m 0s. Rate: 8.0 symbols/min [2025-09-30T17:49:47.446497] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-30T17:49:47.467388] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:49:47.468120] [DEBUG] [LOCAL ] CBAN: No existing data file found in primary storage. [2025-09-30T17:49:47.468183] [WARN ] [MAIN ] CBAN: No existing data found, performing full refresh instead. [2025-09-30T17:49:47.468384] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-30T17:49:47.468818] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-30T17:49:47.468999] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-30T17:49:47.469111] [DEBUG] [LOCAL ] CBAN: No primary data file found to delete. [2025-09-30T17:49:47.469164] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-30T17:49:47.922862] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:49:47.955429] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-30T17:49:48.254333] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-30T17:49:48.368420] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:49:48.775832] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-30T17:49:49.054369] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-30T17:49:49.694146] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-30T17:49:49.854378] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-30T17:49:50.654375] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-30T17:49:50.942792] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T17:49:51.454365] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-30T17:49:51.597724] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T17:49:52.019863] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T17:49:52.032067] [INFO ] [REMOTE ] CAT: Full fetch complete (76664 records). [2025-09-30T17:49:52.032232] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-30T17:49:52.259523] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-30T17:49:52.454755] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-30T17:49:52.454852] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-30T17:49:52.455679] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-30T17:49:52.455744] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-30T17:49:52.459143] [DEBUG] [LOCAL ] CAT: Trimmed 76664 records to 52912 (keeping 200 days of data) [2025-09-30T17:49:52.803468] [DEBUG] [LOCAL ] CAT: Primary data saved (52912 records). [2025-09-30T17:49:52.803632] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-30T17:49:52.803759] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CAT took 39.5s. Estimated remaining: 4h 7m 43s. Rate: 8.0 symbols/min [2025-09-30T17:49:53.054328] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-30T17:49:53.518308] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T17:49:53.785789] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T17:49:53.854360] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-30T17:49:53.867144] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T17:49:54.654352] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-30T17:49:55.454435] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-30T17:49:55.915226] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-30T17:49:56.254337] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-30T17:49:56.288786] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:49:56.441170] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:49:57.054352] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-30T17:49:57.854348] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-30T17:49:58.176962] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T17:49:58.651533] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T17:49:58.661978] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-30T17:49:58.769293] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T17:49:59.454364] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-30T17:50:00.202527] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T17:50:00.254354] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-30T17:50:01.062084] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-30T17:50:01.087138] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-30T17:50:01.224861] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T17:50:01.854368] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-30T17:50:02.654350] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-30T17:50:03.172911] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T17:50:03.330565] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-30T17:50:03.454359] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-30T17:50:03.824742] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T17:50:04.254368] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-30T17:50:05.054352] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-30T17:50:05.245169] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T17:50:05.808975] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:50:05.854378] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-30T17:50:06.389770] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-30T17:50:06.605589] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-30T17:50:06.608161] [INFO ] [REMOTE ] CBAN: Full fetch complete (16133 records). [2025-09-30T17:50:06.608271] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-30T17:50:06.659474] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-30T17:50:07.013661] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-30T17:50:07.013753] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-30T17:50:07.014124] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-30T17:50:07.014165] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-30T17:50:07.014809] [DEBUG] [LOCAL ] CBAN: Trimmed 16133 records to 10891 (keeping 200 days of data) [2025-09-30T17:50:07.083229] [DEBUG] [LOCAL ] CBAN: Primary data saved (10891 records). [2025-09-30T17:50:07.083371] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-30T17:50:07.083448] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CBAN took 19.9s. Estimated remaining: 4h 8m 9s. Rate: 8.0 symbols/min [2025-09-30T17:50:07.454360] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-30T17:50:08.422389] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T17:50:08.434222] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-30T17:50:09.724365] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-30T17:50:09.737008] [INFO ] [REMOTE ] CAVA: Full fetch complete (77287 records). [2025-09-30T17:50:09.737283] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-30T17:50:10.183745] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-30T17:50:10.183893] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-30T17:50:10.184990] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-30T17:50:10.185150] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-30T17:50:10.187191] [DEBUG] [LOCAL ] CAVA: Trimmed 77287 records to 53552 (keeping 200 days of data) [2025-09-30T17:50:10.459582] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-30T17:50:10.480189] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-30T17:50:10.597327] [DEBUG] [LOCAL ] CAVA: Primary data saved (53552 records). [2025-09-30T17:50:10.597526] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-30T17:50:10.598221] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CAVA took 35.3s. Estimated remaining: 4h 7m 42s. Rate: 8.0 symbols/min [2025-09-30T17:50:12.215433] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T17:50:12.226515] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-30T17:50:16.884726] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (4.66 seconds). [2025-09-30T17:50:16.896147] [INFO ] [REMOTE ] CB: Full fetch complete (72679 records). [2025-09-30T17:50:16.896381] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-30T17:50:17.334545] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-30T17:50:17.334638] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-30T17:50:17.335516] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-30T17:50:17.335565] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-30T17:50:17.337256] [DEBUG] [LOCAL ] CB: Trimmed 72679 records to 49964 (keeping 200 days of data) [2025-09-30T17:50:17.672181] [DEBUG] [LOCAL ] CB: Primary data saved (49964 records). [2025-09-30T17:50:17.672330] [INFO ] [MAIN ] CB: Full history saved. [2025-09-30T17:50:17.672417] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CB took 32.8s. Estimated remaining: 4h 7m 32s. Rate: 8.0 symbols/min [2025-09-30T17:50:18.333703] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:18.445392] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:18.503293] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:18.532304] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:18.535074] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-30T17:50:18.535165] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-30T17:50:18.535412] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-30T17:50:18.535578] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-30T17:50:18.538135] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-30T17:50:18.538396] [DEBUG] [LOCAL ] CBNA: Loaded 2901 existing records from primary storage. [2025-09-30T17:50:18.538975] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-30T17:50:18.560840] [INFO ] [MAIN ] CBNA: Loaded 2901 existing records. [2025-09-30T17:50:18.746987] [DEBUG] [LOCAL ] CBL: Loaded 16397 existing records from primary storage. [2025-09-30T17:50:18.763499] [INFO ] [MAIN ] CBL: Loaded 16397 existing records. [2025-09-30T17:50:19.103986] [DEBUG] [LOCAL ] CBRE: Loaded 50596 existing records from primary storage. [2025-09-30T17:50:19.161666] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:19.167201] [INFO ] [MAIN ] CBRE: Loaded 50596 existing records. [2025-09-30T17:50:19.186673] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-30T17:50:19.263335] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-30T17:50:19.418765] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:19.438614] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-30T17:50:19.450216] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-30T17:50:19.466053] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-30T17:50:19.593140] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-30T17:50:19.739258] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-30T17:50:19.716461] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:19.766427] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-30T17:50:19.766494] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-30T17:50:19.773387] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:19.816501] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-30T17:50:19.821806] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-30T17:50:19.851170] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-30T17:50:19.881555] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-30T17:50:20.541339] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:20.626408] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-30T17:50:20.762754] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:50:20.827784] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:20.833876] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-30T17:50:20.833384] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-30T17:50:20.846963] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:50:20.851726] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-09-30T17:50:20.851845] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:50:20.851920] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-30T17:50:20.852297] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-30T17:50:20.852359] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-30T17:50:20.894708] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-30T17:50:20.916003] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 3.2s. Estimated remaining: 4h 7m 3s. Rate: 8.0 symbols/min [2025-09-30T17:50:20.939489] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:21.006502] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-30T17:50:21.125061] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:21.159452] [DEBUG] [LOCAL ] CBT: Loaded 30857 existing records from primary storage. [2025-09-30T17:50:21.159779] [INFO ] [MAIN ] CBT: Loaded 30857 existing records. [2025-09-30T17:50:21.341167] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:21.341402] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-30T17:50:21.341448] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-30T17:50:21.342329] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-30T17:50:21.342391] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-30T17:50:21.646538] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T17:50:21.654434] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-30T17:50:21.735975] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:21.736294] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-30T17:50:22.036087] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T17:50:22.041329] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-30T17:50:22.302796] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T17:50:22.304709] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-30T17:50:22.698204] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-30T17:50:22.699888] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-30T17:50:22.890398] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T17:50:22.912804] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-30T17:50:22.918192] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T17:50:22.929487] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-30T17:50:23.014961] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-30T17:50:23.016732] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-30T17:50:23.030087] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-30T17:50:23.034984] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-30T17:50:23.547021] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-30T17:50:23.548560] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-30T17:50:24.193425] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T17:50:24.198040] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-30T17:50:24.239279] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T17:50:24.252830] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-30T17:50:24.255828] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T17:50:24.266229] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-30T17:50:24.356105] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T17:50:24.366956] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-30T17:50:24.845912] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T17:50:25.054374] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-30T17:50:25.203748] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T17:50:25.331733] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T17:50:25.501748] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T17:50:25.559606] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T17:50:25.854359] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-30T17:50:26.654382] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-30T17:50:26.901135] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T17:50:27.200484] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-30T17:50:27.454354] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-30T17:50:28.254379] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-30T17:50:28.783095] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T17:50:28.829632] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T17:50:28.830823] [INFO ] [REMOTE ] CBNA: Full fetch complete (4613 records). [2025-09-30T17:50:28.830896] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-30T17:50:28.831310] [FATAL] [VALIDATOR ] CBNA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:50:28.831415] [FATAL] [MAIN ] CBNA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:50:28.831492] [WARN ] [MAIN ] CBNA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:50:28.831567] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-30T17:50:28.831698] [DEBUG] [LOCAL ] CBNA: No primary data file found to delete. [2025-09-30T17:50:28.831753] [INFO ] [LOCAL ] CBNA: Starting deletion of derivative data. [2025-09-30T17:50:28.832087] [DEBUG] [LOCAL ] CBNA: Deleted derivative data file. [2025-09-30T17:50:28.832213] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBNA took 11.2s. Estimated remaining: 4h 6m 58s. Rate: 8.0 symbols/min [2025-09-30T17:50:29.017464] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:29.042332] [DEBUG] [LOCAL ] CBU: Loaded 22640 existing records from primary storage. [2025-09-30T17:50:29.042602] [INFO ] [MAIN ] CBU: Loaded 22640 existing records. [2025-09-30T17:50:29.063913] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-30T17:50:29.240880] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:29.241124] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-30T17:50:29.241173] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-30T17:50:29.241936] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-30T17:50:29.242032] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-30T17:50:29.617177] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:29.854374] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-30T17:50:30.115180] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T17:50:30.654344] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-30T17:50:30.979216] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T17:50:31.454387] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-30T17:50:32.254379] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-30T17:50:32.529750] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T17:50:32.568449] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T17:50:33.054327] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-30T17:50:33.116463] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T17:50:33.854391] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-30T17:50:34.055592] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T17:50:34.654347] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-30T17:50:34.801808] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T17:50:35.454405] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-30T17:50:35.820090] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T17:50:36.254352] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-30T17:50:36.397533] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T17:50:37.054399] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-30T17:50:37.854343] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-30T17:50:37.953194] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T17:50:37.956908] [INFO ] [REMOTE ] CBL: Full fetch complete (25506 records). [2025-09-30T17:50:37.956986] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-30T17:50:38.354736] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-30T17:50:38.412569] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-30T17:50:38.412687] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-30T17:50:38.413208] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-30T17:50:38.413290] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-30T17:50:38.414332] [DEBUG] [LOCAL ] CBL: Trimmed 25506 records to 16317 (keeping 200 days of data) [2025-09-30T17:50:38.518026] [DEBUG] [LOCAL ] CBL: Primary data saved (16317 records). [2025-09-30T17:50:38.518171] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-30T17:50:38.518306] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBL took 20.8s. Estimated remaining: 4h 7m 1s. Rate: 8.0 symbols/min [2025-09-30T17:50:38.659490] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-30T17:50:38.719221] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:38.719703] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-30T17:50:38.719804] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-30T17:50:38.719956] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-30T17:50:38.720053] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-30T17:50:38.720123] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-30T17:50:38.720160] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-30T17:50:39.124114] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T17:50:39.147502] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:39.454405] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-30T17:50:39.658346] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:50:39.658666] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-30T17:50:39.658752] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:50:39.658800] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-09-30T17:50:39.658863] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:50:39.658938] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-30T17:50:39.659005] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-30T17:50:39.659043] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-30T17:50:39.659084] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-30T17:50:39.659132] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBX took 1.1s. Estimated remaining: 4h 6m 22s. Rate: 8.0 symbols/min [2025-09-30T17:50:39.848303] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:39.883565] [DEBUG] [LOCAL ] CBZ: Loaded 33640 existing records from primary storage. [2025-09-30T17:50:39.883900] [INFO ] [MAIN ] CBZ: Loaded 33640 existing records. [2025-09-30T17:50:40.075760] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:40.076137] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-30T17:50:40.076229] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-30T17:50:40.077185] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-30T17:50:40.077250] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-30T17:50:40.270381] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-30T17:50:40.458805] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T17:50:40.510886] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:41.054357] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-30T17:50:41.262827] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:50:41.854353] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-30T17:50:42.121526] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T17:50:42.654392] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-30T17:50:43.274098] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T17:50:43.454413] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-30T17:50:44.254420] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-30T17:50:44.326852] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T17:50:44.477289] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T17:50:44.841053] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T17:50:45.054404] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-30T17:50:45.854372] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-30T17:50:46.315126] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T17:50:46.654372] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-30T17:50:46.968402] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T17:50:47.454406] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-30T17:50:47.838531] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T17:50:48.254397] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-30T17:50:49.054347] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-30T17:50:49.237789] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T17:50:49.383278] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T17:50:49.854399] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-30T17:50:50.288200] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T17:50:50.654379] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-30T17:50:51.454361] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-30T17:50:51.539353] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T17:50:51.571504] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T17:50:52.254386] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-30T17:50:52.593302] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T17:50:52.600368] [INFO ] [REMOTE ] CBT: Full fetch complete (45779 records). [2025-09-30T17:50:52.600531] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-30T17:50:53.025857] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-30T17:50:53.025974] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-30T17:50:53.026694] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-30T17:50:53.026769] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-30T17:50:53.027968] [DEBUG] [LOCAL ] CBT: Trimmed 45779 records to 30830 (keeping 200 days of data) [2025-09-30T17:50:53.092348] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-30T17:50:53.236435] [DEBUG] [LOCAL ] CBT: Primary data saved (30830 records). [2025-09-30T17:50:53.236580] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-30T17:50:53.237217] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBT took 32.3s. Estimated remaining: 4h 6m 44s. Rate: 8.0 symbols/min [2025-09-30T17:50:53.425061] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:53.482565] [DEBUG] [LOCAL ] CC: Loaded 53007 existing records from primary storage. [2025-09-30T17:50:53.482942] [INFO ] [MAIN ] CC: Loaded 53007 existing records. [2025-09-30T17:50:53.747069] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:53.747441] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-30T17:50:53.747503] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-30T17:50:53.748882] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-30T17:50:53.748949] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-30T17:50:53.861960] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-30T17:50:54.157827] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:54.187880] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T17:50:54.199004] [INFO ] [REMOTE ] CBRE: Full fetch complete (73978 records). [2025-09-30T17:50:54.199154] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-30T17:50:54.655935] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-30T17:50:54.656345] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-30T17:50:54.657579] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-30T17:50:54.657707] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-30T17:50:54.656206] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-30T17:50:54.679633] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T17:50:54.687201] [DEBUG] [LOCAL ] CBRE: Trimmed 73978 records to 50590 (keeping 200 days of data) [2025-09-30T17:50:54.830123] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T17:50:55.039878] [DEBUG] [LOCAL ] CBRE: Primary data saved (50590 records). [2025-09-30T17:50:55.040066] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-30T17:50:55.040179] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBRE took 37.4s. Estimated remaining: 4h 6m 9s. Rate: 8.0 symbols/min [2025-09-30T17:50:55.224060] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:55.277047] [DEBUG] [LOCAL ] CCI: Loaded 53143 existing records from primary storage. [2025-09-30T17:50:55.277416] [INFO ] [MAIN ] CCI: Loaded 53143 existing records. [2025-09-30T17:50:55.463576] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-30T17:50:55.470609] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:50:55.471958] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-30T17:50:55.472012] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-30T17:50:55.473135] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-30T17:50:55.473203] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-30T17:50:55.897860] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:50:56.262287] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-30T17:50:56.282282] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:50:56.492705] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T17:50:57.054371] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-30T17:50:57.854355] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-30T17:50:57.982527] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T17:50:58.616993] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T17:50:58.654344] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-30T17:50:59.059336] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T17:50:59.065890] [INFO ] [REMOTE ] CBU: Full fetch complete (32259 records). [2025-09-30T17:50:59.066053] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-30T17:50:59.460372] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-30T17:50:59.462427] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-30T17:50:59.462559] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-30T17:50:59.464109] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-30T17:50:59.464180] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-30T17:50:59.465252] [DEBUG] [LOCAL ] CBU: Trimmed 32259 records to 22647 (keeping 200 days of data) [2025-09-30T17:50:59.610078] [DEBUG] [LOCAL ] CBU: Primary data saved (22647 records). [2025-09-30T17:50:59.610251] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-30T17:50:59.610339] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBU took 30.8s. Estimated remaining: 4h 5m 47s. Rate: 8.0 symbols/min [2025-09-30T17:50:59.795450] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:50:59.795611] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-30T17:50:59.795679] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-30T17:50:59.795802] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-30T17:50:59.795845] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-30T17:50:59.795887] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-30T17:50:59.795920] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-30T17:51:00.191387] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:00.263020] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-30T17:51:00.284097] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:51:00.657865] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T17:51:01.054367] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-30T17:51:01.854366] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-30T17:51:02.227728] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-30T17:51:02.654396] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-30T17:51:02.856466] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T17:51:02.991635] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T17:51:03.454418] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-30T17:51:04.254429] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-30T17:51:04.480334] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T17:51:04.706496] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-30T17:51:04.802376] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T17:51:05.054368] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-30T17:51:05.399901] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-30T17:51:05.854400] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-30T17:51:06.200064] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-30T17:51:06.654379] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-30T17:51:07.454367] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-30T17:51:07.786867] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-30T17:51:08.254353] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-30T17:51:08.609255] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T17:51:09.054364] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-30T17:51:09.725214] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T17:51:09.854352] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-30T17:51:10.267243] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-30T17:51:10.654369] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-30T17:51:10.855156] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:51:11.454398] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-30T17:51:12.254361] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-30T17:51:12.706821] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-30T17:51:12.911958] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T17:51:12.925418] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T17:51:12.925260] [INFO ] [REMOTE ] CBZ: Full fetch complete (45296 records). [2025-09-30T17:51:12.925589] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-30T17:51:13.064594] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-30T17:51:13.366938] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-30T17:51:13.367055] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-30T17:51:13.367792] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-30T17:51:13.367874] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-30T17:51:13.372812] [DEBUG] [LOCAL ] CBZ: Trimmed 45296 records to 33660 (keeping 200 days of data) [2025-09-30T17:51:13.580520] [DEBUG] [LOCAL ] CBZ: Primary data saved (33660 records). [2025-09-30T17:51:13.580696] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-30T17:51:13.580860] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CBZ took 33.9s. Estimated remaining: 4h 6m 11s. Rate: 8.0 symbols/min [2025-09-30T17:51:13.771756] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:13.792150] [DEBUG] [LOCAL ] CCIF: Loaded 15655 existing records from primary storage. [2025-09-30T17:51:13.792497] [INFO ] [MAIN ] CCIF: Loaded 15655 existing records. [2025-09-30T17:51:13.864242] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-30T17:51:14.013864] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:51:14.014197] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-30T17:51:14.014262] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-30T17:51:14.015047] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-30T17:51:14.015137] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-30T17:51:14.409105] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:14.654632] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-30T17:51:14.698594] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T17:51:15.360891] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T17:51:15.454345] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-30T17:51:15.609759] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T17:51:16.254395] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-30T17:51:17.054391] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-30T17:51:17.264594] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T17:51:17.486240] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-30T17:51:17.854379] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-30T17:51:18.202411] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-30T17:51:18.204547] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-30T17:51:18.654362] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-30T17:51:19.454354] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-30T17:51:20.254377] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-30T17:51:20.455842] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T17:51:20.524920] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T17:51:20.600278] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-30T17:51:21.054356] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-30T17:51:21.854385] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-30T17:51:21.881628] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T17:51:22.415339] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-30T17:51:22.416776] [INFO ] [REMOTE ] CCIA: Full fetch complete (2056 records). [2025-09-30T17:51:22.416969] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-30T17:51:22.635369] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T17:51:22.635573] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:51:22.635670] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:51:22.635745] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-30T17:51:22.635815] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-30T17:51:22.635866] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-30T17:51:22.635951] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-30T17:51:22.636061] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CCIA took 23.0s. Estimated remaining: 4h 6m 10s. Rate: 8.0 symbols/min [2025-09-30T17:51:22.659440] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-30T17:51:22.832035] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:22.892015] [DEBUG] [LOCAL ] CCJ: Loaded 53673 existing records from primary storage. [2025-09-30T17:51:22.892377] [INFO ] [MAIN ] CCJ: Loaded 53673 existing records. [2025-09-30T17:51:23.087535] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:51:23.087801] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-30T17:51:23.087852] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-30T17:51:23.089761] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-30T17:51:23.089841] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-30T17:51:23.483836] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-30T17:51:23.490054] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:24.254367] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-30T17:51:24.475301] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:51:24.641183] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T17:51:25.054355] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-30T17:51:25.854349] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-30T17:51:26.041159] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T17:51:26.063820] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T17:51:26.654410] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-30T17:51:27.454355] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-30T17:51:27.713909] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T17:51:27.819171] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T17:51:28.254365] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-30T17:51:29.054364] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-30T17:51:29.423572] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T17:51:29.435897] [INFO ] [REMOTE ] CC: Full fetch complete (75589 records). [2025-09-30T17:51:29.436067] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-30T17:51:29.866343] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-30T17:51:29.862483] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-30T17:51:29.866548] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-30T17:51:29.867550] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-30T17:51:29.868567] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-30T17:51:29.870982] [DEBUG] [LOCAL ] CC: Trimmed 75589 records to 53006 (keeping 200 days of data) [2025-09-30T17:51:30.012504] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T17:51:30.267879] [DEBUG] [LOCAL ] CC: Primary data saved (53006 records). [2025-09-30T17:51:30.268043] [INFO ] [MAIN ] CC: Full history saved. [2025-09-30T17:51:30.268904] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CC took 37.0s. Estimated remaining: 4h 6m 3s. Rate: 8.0 symbols/min [2025-09-30T17:51:30.467022] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:30.522682] [DEBUG] [LOCAL ] CCK: Loaded 46287 existing records from primary storage. [2025-09-30T17:51:30.523074] [INFO ] [MAIN ] CCK: Loaded 46287 existing records. [2025-09-30T17:51:30.658805] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-30T17:51:30.741409] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:51:30.742289] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-30T17:51:30.742523] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-30T17:51:30.743523] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-30T17:51:30.743593] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-30T17:51:30.872007] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T17:51:31.006600] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-30T17:51:31.205728] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:31.454413] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-30T17:51:32.254376] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-30T17:51:32.575157] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T17:51:33.063531] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-30T17:51:33.070086] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T17:51:33.251344] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-30T17:51:33.854359] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-30T17:51:34.654357] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-30T17:51:34.674877] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T17:51:35.099791] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-30T17:51:35.454414] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-30T17:51:36.254321] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-30T17:51:36.509565] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T17:51:36.521398] [INFO ] [REMOTE ] CCI: Full fetch complete (76996 records). [2025-09-30T17:51:36.521597] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-30T17:51:36.686207] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T17:51:36.724727] [INFO ] [REMOTE ] CCIF: Full fetch complete (21864 records). [2025-09-30T17:51:36.737764] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-30T17:51:37.057696] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-30T17:51:37.326970] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-30T17:51:37.333424] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-30T17:51:37.334558] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-30T17:51:37.339819] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-30T17:51:37.388375] [DEBUG] [LOCAL ] CCI: Trimmed 76996 records to 53140 (keeping 200 days of data) [2025-09-30T17:51:37.545858] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-30T17:51:37.572492] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-30T17:51:37.575073] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-30T17:51:37.575426] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-30T17:51:37.584468] [DEBUG] [LOCAL ] CCIF: Trimmed 21864 records to 15713 (keeping 200 days of data) [2025-09-30T17:51:37.800260] [DEBUG] [LOCAL ] CCIF: Primary data saved (15713 records). [2025-09-30T17:51:37.802694] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-30T17:51:37.803099] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCIF took 24.2s. Estimated remaining: 4h 5m 56s. Rate: 8.0 symbols/min [2025-09-30T17:51:38.022186] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:38.087000] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T17:51:38.104991] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-30T17:51:38.219637] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-30T17:51:38.221705] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-09-30T17:51:38.438889] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:51:38.441143] [DEBUG] [LOCAL ] CCI: Primary data saved (53140 records). [2025-09-30T17:51:38.441456] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-30T17:51:38.441694] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-30T17:51:38.441590] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-30T17:51:38.441892] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCI took 43.4s. Estimated remaining: 4h 5m 16s. Rate: 8.0 symbols/min [2025-09-30T17:51:38.475501] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-30T17:51:38.516427] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-30T17:51:38.680440] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:39.084528] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:39.116235] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-30T17:51:39.119410] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-30T17:51:39.118073] [DEBUG] [LOCAL ] CCO: Loaded 47797 existing records from primary storage. [2025-09-30T17:51:39.130492] [INFO ] [MAIN ] CCO: Loaded 47797 existing records. [2025-09-30T17:51:39.320299] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:51:39.320572] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-30T17:51:39.320629] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-30T17:51:39.321464] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-30T17:51:39.321528] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-30T17:51:39.459466] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-30T17:51:39.710584] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:39.849171] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T17:51:40.254360] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-30T17:51:41.054332] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-30T17:51:41.092996] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:51:41.204407] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-30T17:51:41.854398] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-30T17:51:42.416536] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-30T17:51:42.659474] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-30T17:51:42.681976] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T17:51:43.380543] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T17:51:43.454381] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-30T17:51:44.254385] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-30T17:51:44.962284] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-30T17:51:45.054333] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-30T17:51:45.155951] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T17:51:45.854347] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-30T17:51:46.506351] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:51:46.593141] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-30T17:51:46.654353] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-30T17:51:47.227798] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T17:51:47.454407] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-30T17:51:48.254387] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-30T17:51:48.818209] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T17:51:48.877750] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-30T17:51:49.054356] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-30T17:51:49.854367] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-30T17:51:50.005178] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T17:51:50.654400] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-30T17:51:51.352836] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T17:51:51.454368] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-30T17:51:51.504009] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-30T17:51:51.515502] [INFO ] [REMOTE ] CCJ: Full fetch complete (77684 records). [2025-09-30T17:51:51.515725] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-30T17:51:51.954919] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-30T17:51:51.955026] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-30T17:51:51.955950] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-30T17:51:51.956021] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-30T17:51:51.960495] [DEBUG] [LOCAL ] CCJ: Trimmed 77684 records to 53673 (keeping 200 days of data) [2025-09-30T17:51:52.271450] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-30T17:51:52.299728] [DEBUG] [LOCAL ] CCJ: Primary data saved (53673 records). [2025-09-30T17:51:52.299958] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-30T17:51:52.300085] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCJ took 29.7s. Estimated remaining: 4h 5m 38s. Rate: 8.0 symbols/min [2025-09-30T17:51:52.493725] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:52.505719] [DEBUG] [LOCAL ] CCRD: Loaded 9032 existing records from primary storage. [2025-09-30T17:51:52.506001] [INFO ] [MAIN ] CCRD: Loaded 9032 existing records. [2025-09-30T17:51:52.705416] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:51:52.705846] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-30T17:51:52.705997] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-30T17:51:52.706591] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-30T17:51:52.706688] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-30T17:51:53.110277] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-30T17:51:53.153713] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:51:53.164495] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-30T17:51:53.193684] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T17:51:53.854337] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-30T17:51:54.347341] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-30T17:51:54.517725] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T17:51:54.654352] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-30T17:51:55.445840] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T17:51:55.459404] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-30T17:51:55.476739] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T17:51:56.254369] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-30T17:51:56.972225] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T17:51:57.054376] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-30T17:51:57.854465] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-30T17:51:58.277473] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T17:51:58.654357] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-30T17:51:58.725841] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-30T17:51:58.801890] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T17:51:58.813007] [INFO ] [REMOTE ] CCK: Full fetch complete (67702 records). [2025-09-30T17:51:58.813215] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-30T17:51:59.180033] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-30T17:51:59.235984] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-30T17:51:59.236102] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-30T17:51:59.237248] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-30T17:51:59.237331] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-30T17:51:59.239431] [DEBUG] [LOCAL ] CCK: Trimmed 67702 records to 46241 (keeping 200 days of data) [2025-09-30T17:51:59.456034] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-30T17:51:59.603471] [DEBUG] [LOCAL ] CCK: Primary data saved (46241 records). [2025-09-30T17:51:59.603731] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-30T17:51:59.604616] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCK took 29.3s. Estimated remaining: 4h 5m 30s. Rate: 8.0 symbols/min [2025-09-30T17:51:59.830223] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:51:59.870460] [DEBUG] [LOCAL ] CCS: Loaded 30622 existing records from primary storage. [2025-09-30T17:51:59.870898] [INFO ] [MAIN ] CCS: Loaded 30622 existing records. [2025-09-30T17:52:00.058883] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:00.059192] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-30T17:52:00.059315] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-30T17:52:00.060633] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-30T17:52:00.060725] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-30T17:52:00.262505] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-30T17:52:00.449705] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:01.056941] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-30T17:52:01.064228] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T17:52:01.854401] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-30T17:52:02.391159] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T17:52:02.571452] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-30T17:52:02.654394] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-30T17:52:03.171356] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T17:52:03.454403] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-30T17:52:04.100375] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-30T17:52:04.102045] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:52:04.254382] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-30T17:52:05.026283] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T17:52:05.054325] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-30T17:52:05.854334] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-30T17:52:06.019391] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T17:52:06.654397] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-30T17:52:07.454436] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-30T17:52:07.785923] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T17:52:08.085496] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-30T17:52:08.254398] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-30T17:52:08.758412] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T17:52:09.054455] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-30T17:52:09.854427] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-30T17:52:10.404489] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T17:52:10.489052] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-30T17:52:10.654418] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-30T17:52:11.428711] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T17:52:11.454316] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-30T17:52:12.254470] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-30T17:52:13.056330] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-30T17:52:13.060093] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-30T17:52:13.103225] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T17:52:13.114160] [INFO ] [REMOTE ] CCO: Full fetch complete (66475 records). [2025-09-30T17:52:13.114334] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-30T17:52:13.538434] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-30T17:52:13.538537] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-30T17:52:13.539375] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-30T17:52:13.539446] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-30T17:52:13.541021] [DEBUG] [LOCAL ] CCO: Trimmed 66475 records to 47809 (keeping 200 days of data) [2025-09-30T17:52:13.854819] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-30T17:52:13.858287] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T17:52:13.873604] [DEBUG] [LOCAL ] CCO: Primary data saved (47809 records). [2025-09-30T17:52:13.873857] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-30T17:52:13.873988] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCO took 35.4s. Estimated remaining: 4h 5m 54s. Rate: 8.0 symbols/min [2025-09-30T17:52:14.007790] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T17:52:14.150963] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:14.178878] [DEBUG] [LOCAL ] CCU: Loaded 23240 existing records from primary storage. [2025-09-30T17:52:14.179208] [INFO ] [MAIN ] CCU: Loaded 23240 existing records. [2025-09-30T17:52:14.374321] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:14.374581] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-30T17:52:14.374635] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-30T17:52:14.375045] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-30T17:52:14.375106] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-30T17:52:14.663384] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-30T17:52:14.817618] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:15.454441] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-30T17:52:16.162165] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T17:52:16.259128] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-30T17:52:16.282172] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-30T17:52:16.305549] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-09-30T17:52:16.306769] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T17:52:16.306004] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-30T17:52:16.751066] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-30T17:52:16.751167] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-30T17:52:16.752149] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-30T17:52:16.752229] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-30T17:52:16.753861] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-09-30T17:52:17.069813] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-30T17:52:17.098698] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-09-30T17:52:17.098870] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-30T17:52:17.098964] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCL took 39.3s. Estimated remaining: 4h 5m 26s. Rate: 8.0 symbols/min [2025-09-30T17:52:17.292978] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:17.293167] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-30T17:52:17.293226] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-30T17:52:17.293353] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-30T17:52:17.293398] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-30T17:52:17.293442] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-30T17:52:17.293478] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-30T17:52:17.740914] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:17.744405] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T17:52:17.854326] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-30T17:52:17.929017] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T17:52:17.931518] [INFO ] [REMOTE ] CCRD: Full fetch complete (11844 records). [2025-09-30T17:52:17.931611] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-30T17:52:18.437445] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-30T17:52:18.437534] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-30T17:52:18.437928] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-30T17:52:18.438009] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-30T17:52:18.438628] [DEBUG] [LOCAL ] CCRD: Trimmed 11844 records to 9062 (keeping 200 days of data) [2025-09-30T17:52:18.478301] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-30T17:52:18.514669] [DEBUG] [LOCAL ] CCRD: Primary data saved (9062 records). [2025-09-30T17:52:18.514834] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-30T17:52:18.514929] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCRD took 26.2s. Estimated remaining: 4h 4m 50s. Rate: 8.0 symbols/min [2025-09-30T17:52:18.659476] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-30T17:52:18.709418] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:18.768620] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-30T17:52:18.769094] [INFO ] [MAIN ] CDE: Loaded 53641 existing records. [2025-09-30T17:52:18.945767] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-30T17:52:18.967470] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:18.968711] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-30T17:52:18.968771] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-30T17:52:18.970599] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-30T17:52:18.970690] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-30T17:52:19.369196] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:19.454390] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-30T17:52:19.675058] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-30T17:52:20.254358] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-30T17:52:21.054354] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-30T17:52:21.299190] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-30T17:52:21.707297] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T17:52:21.854355] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-30T17:52:22.654359] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-30T17:52:23.184057] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T17:52:23.454325] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-30T17:52:23.842812] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T17:52:24.254403] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-30T17:52:24.589912] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-30T17:52:25.054363] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-30T17:52:25.276638] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T17:52:25.279265] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-30T17:52:25.854361] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-30T17:52:26.080233] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:52:26.080561] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-30T17:52:26.080704] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:52:26.080817] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-09-30T17:52:26.080885] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:52:26.080960] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-30T17:52:26.081028] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-30T17:52:26.081067] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-30T17:52:26.081132] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-30T17:52:26.081205] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCZ took 9.0s. Estimated remaining: 4h 4m 42s. Rate: 8.0 symbols/min [2025-09-30T17:52:26.274408] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:26.286590] [DEBUG] [LOCAL ] CDLR: Loaded 9783 existing records from primary storage. [2025-09-30T17:52:26.287059] [INFO ] [MAIN ] CDLR: Loaded 9783 existing records. [2025-09-30T17:52:26.475825] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:26.476068] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-30T17:52:26.476116] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-30T17:52:26.476570] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-30T17:52:26.476632] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-30T17:52:26.659524] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-30T17:52:26.903256] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:27.454388] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-30T17:52:28.254398] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-30T17:52:28.622723] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-30T17:52:28.887006] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T17:52:28.967858] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T17:52:28.974561] [INFO ] [REMOTE ] CCS: Full fetch complete (45078 records). [2025-09-30T17:52:28.974706] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-30T17:52:29.059492] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-30T17:52:29.387830] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-30T17:52:29.387915] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-30T17:52:29.388550] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-30T17:52:29.388620] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-30T17:52:29.389731] [DEBUG] [LOCAL ] CCS: Trimmed 45078 records to 30574 (keeping 200 days of data) [2025-09-30T17:52:29.584151] [DEBUG] [LOCAL ] CCS: Primary data saved (30574 records). [2025-09-30T17:52:29.584289] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-30T17:52:29.584863] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCS took 30.0s. Estimated remaining: 4h 4m 16s. Rate: 8.0 symbols/min [2025-09-30T17:52:29.768104] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:29.810919] [DEBUG] [LOCAL ] CDP: Loaded 42547 existing records from primary storage. [2025-09-30T17:52:29.811227] [INFO ] [MAIN ] CDP: Loaded 42547 existing records. [2025-09-30T17:52:29.861741] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-30T17:52:30.019960] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:30.020172] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-30T17:52:30.020327] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-30T17:52:30.021555] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-30T17:52:30.021618] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-30T17:52:30.358015] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T17:52:30.443181] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:30.654401] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-30T17:52:31.454407] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-30T17:52:31.570370] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T17:52:31.621831] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T17:52:32.254392] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-30T17:52:33.060012] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-30T17:52:33.065826] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T17:52:33.264802] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T17:52:33.854426] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-30T17:52:34.142049] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:52:34.654379] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-30T17:52:35.207879] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T17:52:35.245312] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:52:35.454395] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-30T17:52:36.254364] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-30T17:52:36.991768] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T17:52:37.054380] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-30T17:52:37.854394] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-30T17:52:38.213535] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T17:52:38.512799] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-30T17:52:38.514587] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T17:52:38.654369] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-30T17:52:39.454389] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-30T17:52:40.255372] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-30T17:52:40.258283] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T17:52:40.376430] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T17:52:41.054378] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-30T17:52:41.854360] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-30T17:52:41.951840] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-30T17:52:42.124945] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T17:52:42.426535] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T17:52:42.654406] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-30T17:52:43.454333] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-30T17:52:43.609182] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T17:52:44.254397] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-30T17:52:45.054351] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-30T17:52:45.103306] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T17:52:45.480012] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-30T17:52:45.854356] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-30T17:52:46.350053] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T17:52:46.654342] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-30T17:52:46.932261] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T17:52:47.454366] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-30T17:52:48.254365] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-30T17:52:48.520001] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T17:52:48.701457] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-30T17:52:48.739627] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T17:52:49.054375] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-30T17:52:49.854407] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-30T17:52:50.654342] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-30T17:52:50.935904] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T17:52:51.106581] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-30T17:52:51.454356] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-30T17:52:52.083531] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T17:52:52.254346] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-30T17:52:52.393304] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T17:52:53.054396] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-30T17:52:53.854373] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-30T17:52:54.219140] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T17:52:54.584027] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T17:52:54.654385] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-30T17:52:54.800554] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T17:52:54.803284] [INFO ] [REMOTE ] CDLR: Full fetch complete (13226 records). [2025-09-30T17:52:54.803380] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-30T17:52:55.200915] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-30T17:52:55.201001] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-30T17:52:55.201370] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-30T17:52:55.201412] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-30T17:52:55.201994] [DEBUG] [LOCAL ] CDLR: Trimmed 13226 records to 9816 (keeping 200 days of data) [2025-09-30T17:52:55.259196] [DEBUG] [LOCAL ] CDLR: Primary data saved (9816 records). [2025-09-30T17:52:55.259346] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-30T17:52:55.259492] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CDLR took 29.2s. Estimated remaining: 4h 5m 33s. Rate: 7.9 symbols/min [2025-09-30T17:52:55.445837] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:55.454411] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-30T17:52:55.473839] [DEBUG] [LOCAL ] CDRE: Loaded 25219 existing records from primary storage. [2025-09-30T17:52:55.474131] [INFO ] [MAIN ] CDRE: Loaded 25219 existing records. [2025-09-30T17:52:55.669494] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:55.669730] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-30T17:52:55.669787] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-30T17:52:55.670316] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-30T17:52:55.670378] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-30T17:52:56.056164] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:56.254340] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-30T17:52:57.010185] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T17:52:57.054383] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-30T17:52:57.164897] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T17:52:57.279923] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-30T17:52:57.292295] [INFO ] [REMOTE ] CDE: Full fetch complete (77581 records). [2025-09-30T17:52:57.292459] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-30T17:52:57.735808] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-30T17:52:57.735928] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-30T17:52:57.736848] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-30T17:52:57.736916] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-30T17:52:57.738584] [DEBUG] [LOCAL ] CDE: Trimmed 77581 records to 53641 (keeping 200 days of data) [2025-09-30T17:52:57.855715] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-30T17:52:58.060151] [DEBUG] [LOCAL ] CDE: Primary data saved (53641 records). [2025-09-30T17:52:58.060287] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-30T17:52:58.060368] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDE took 39.5s. Estimated remaining: 4h 5m 4s. Rate: 8.0 symbols/min [2025-09-30T17:52:58.242895] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:58.294857] [DEBUG] [LOCAL ] CE: Loaded 51527 existing records from primary storage. [2025-09-30T17:52:58.295176] [INFO ] [MAIN ] CE: Loaded 51527 existing records. [2025-09-30T17:52:58.547417] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:52:58.547921] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-30T17:52:58.548053] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-30T17:52:58.557814] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-30T17:52:58.574879] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-30T17:52:58.629156] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T17:52:58.664162] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-30T17:52:58.681042] [INFO ] [REMOTE ] CDP: Full fetch complete (61796 records). [2025-09-30T17:52:58.707686] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-30T17:52:59.372597] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T17:52:59.411596] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:52:59.456541] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-30T17:52:59.499092] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-30T17:52:59.499185] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-30T17:52:59.499986] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-30T17:52:59.500054] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-30T17:52:59.501476] [DEBUG] [LOCAL ] CDP: Trimmed 61796 records to 42529 (keeping 200 days of data) [2025-09-30T17:52:59.776258] [DEBUG] [LOCAL ] CDP: Primary data saved (42529 records). [2025-09-30T17:52:59.776405] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-30T17:52:59.777079] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDP took 30.2s. Estimated remaining: 4h 4m 29s. Rate: 8.0 symbols/min [2025-09-30T17:52:59.977011] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:52:59.988913] [DEBUG] [LOCAL ] CEE: Loaded 6213 existing records from primary storage. [2025-09-30T17:52:59.989244] [INFO ] [MAIN ] CEE: Loaded 6213 existing records. [2025-09-30T17:53:00.209137] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T17:53:00.207849] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:00.216457] [INFO ] [REMOTE ] CCU: Full fetch complete (33034 records). [2025-09-30T17:53:00.216341] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-30T17:53:00.216785] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-30T17:53:00.216938] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-30T17:53:00.217447] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-30T17:53:00.217531] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-30T17:53:00.310248] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-30T17:53:01.089722] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-30T17:53:01.110786] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-30T17:53:01.116750] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-30T17:53:01.117036] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-30T17:53:01.178203] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:01.179041] [DEBUG] [LOCAL ] CCU: Trimmed 33034 records to 23218 (keeping 200 days of data) [2025-09-30T17:53:01.179692] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-30T17:53:01.305710] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T17:53:01.371151] [DEBUG] [LOCAL ] CCU: Primary data saved (23218 records). [2025-09-30T17:53:01.371328] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-30T17:53:01.371438] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CCU took 47.5s. Estimated remaining: 4h 3m 54s. Rate: 8.0 symbols/min [2025-09-30T17:53:01.499453] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T17:53:01.587927] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:01.620729] [DEBUG] [LOCAL ] CEPU: Loaded 25890 existing records from primary storage. [2025-09-30T17:53:01.620996] [INFO ] [MAIN ] CEPU: Loaded 25890 existing records. [2025-09-30T17:53:01.850744] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:01.851003] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-30T17:53:01.851108] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-30T17:53:01.851505] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-30T17:53:01.851564] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-30T17:53:01.859518] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-30T17:53:02.140494] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T17:53:02.274019] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:02.654400] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-30T17:53:03.454332] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-30T17:53:03.655124] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T17:53:03.695435] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T17:53:04.254363] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-30T17:53:04.586388] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T17:53:04.844200] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T17:53:05.054368] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-30T17:53:05.854381] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-30T17:53:06.654396] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-30T17:53:06.769849] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T17:53:07.069366] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T17:53:07.454493] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-30T17:53:07.634773] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T17:53:08.254422] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-30T17:53:08.796484] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T17:53:09.054392] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-30T17:53:09.854345] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-30T17:53:09.959587] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T17:53:10.120251] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T17:53:10.654386] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-30T17:53:10.881422] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T17:53:11.284819] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T17:53:11.454358] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-30T17:53:12.254352] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-30T17:53:12.486683] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T17:53:12.764759] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T17:53:13.054367] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-30T17:53:13.854390] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-30T17:53:13.908989] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T17:53:14.467280] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-30T17:53:14.654363] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-30T17:53:15.454375] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-30T17:53:15.862166] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T17:53:16.076848] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-30T17:53:16.254364] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-30T17:53:17.054373] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-30T17:53:17.472883] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T17:53:17.478514] [INFO ] [REMOTE ] CDRE: Full fetch complete (35288 records). [2025-09-30T17:53:17.478615] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-30T17:53:17.855989] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-30T17:53:17.891705] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-30T17:53:17.891788] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-30T17:53:17.892295] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-30T17:53:17.892359] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-30T17:53:17.893285] [DEBUG] [LOCAL ] CDRE: Trimmed 35288 records to 25130 (keeping 200 days of data) [2025-09-30T17:53:18.049544] [DEBUG] [LOCAL ] CDRE: Primary data saved (25130 records). [2025-09-30T17:53:18.049713] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-30T17:53:18.049810] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CDRE took 22.8s. Estimated remaining: 4h 4m 29s. Rate: 8.0 symbols/min [2025-09-30T17:53:18.241129] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:18.304826] [DEBUG] [LOCAL ] CF: Loaded 52195 existing records from primary storage. [2025-09-30T17:53:18.305226] [INFO ] [MAIN ] CF: Loaded 52195 existing records. [2025-09-30T17:53:18.502890] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:18.503224] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-30T17:53:18.503314] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-30T17:53:18.505744] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-30T17:53:18.505809] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-30T17:53:18.622517] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T17:53:18.656454] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-30T17:53:18.920340] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:18.954418] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T17:53:19.455303] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-30T17:53:19.460674] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T17:53:20.254360] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-30T17:53:21.054338] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-30T17:53:21.230257] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T17:53:21.707371] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T17:53:21.707706] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T17:53:21.720878] [INFO ] [REMOTE ] CEE: Full fetch complete (10179 records). [2025-09-30T17:53:21.721161] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-30T17:53:21.859478] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-30T17:53:22.122404] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-30T17:53:22.122494] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-30T17:53:22.122827] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-30T17:53:22.122891] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-30T17:53:22.123349] [DEBUG] [LOCAL ] CEE: Trimmed 10179 records to 6103 (keeping 200 days of data) [2025-09-30T17:53:22.163819] [DEBUG] [LOCAL ] CEE: Primary data saved (6103 records). [2025-09-30T17:53:22.163962] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-30T17:53:22.164111] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CEE took 22.4s. Estimated remaining: 4h 4m 6s. Rate: 8.0 symbols/min [2025-09-30T17:53:22.345667] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:22.413845] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-09-30T17:53:22.414270] [INFO ] [MAIN ] CFG: Loaded 53624 existing records. [2025-09-30T17:53:22.611819] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:22.612055] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-30T17:53:22.612105] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-30T17:53:22.614136] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-30T17:53:22.614202] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-30T17:53:22.659571] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-30T17:53:23.012769] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:23.087236] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T17:53:23.454434] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-30T17:53:24.254319] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-30T17:53:24.466169] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T17:53:24.657372] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T17:53:25.054363] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-30T17:53:25.540995] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T17:53:25.854368] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-30T17:53:26.654454] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-30T17:53:26.769198] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T17:53:27.463623] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-30T17:53:27.469689] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T17:53:27.589963] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T17:53:28.254358] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-30T17:53:29.054379] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-30T17:53:29.213222] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T17:53:29.369469] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T17:53:29.854342] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-30T17:53:30.641239] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T17:53:30.654330] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-30T17:53:31.454367] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-30T17:53:31.693407] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T17:53:31.823329] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T17:53:32.254387] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-30T17:53:32.967513] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T17:53:32.993933] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T17:53:33.054345] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-30T17:53:33.854360] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-30T17:53:34.525079] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T17:53:34.532868] [INFO ] [REMOTE ] CEPU: Full fetch complete (39705 records). [2025-09-30T17:53:34.533079] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-30T17:53:34.659518] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-30T17:53:34.949051] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-30T17:53:34.949159] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-30T17:53:34.949792] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-30T17:53:34.949863] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-30T17:53:34.951148] [DEBUG] [LOCAL ] CEPU: Trimmed 39705 records to 25948 (keeping 200 days of data) [2025-09-30T17:53:35.118375] [DEBUG] [LOCAL ] CEPU: Primary data saved (25948 records). [2025-09-30T17:53:35.118513] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-30T17:53:35.118673] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CEPU took 33.7s. Estimated remaining: 4h 4m 23s. Rate: 8.0 symbols/min [2025-09-30T17:53:35.305723] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:35.306225] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-30T17:53:35.306406] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-30T17:53:35.306808] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-30T17:53:35.306911] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-30T17:53:35.307129] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-30T17:53:35.307221] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-30T17:53:35.461674] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-30T17:53:35.678141] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T17:53:35.777124] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:36.254372] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-30T17:53:36.476216] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T17:53:36.487983] [INFO ] [REMOTE ] CE: Full fetch complete (74857 records). [2025-09-30T17:53:36.488164] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-30T17:53:36.904035] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-30T17:53:36.904122] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-30T17:53:36.905001] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-30T17:53:36.905095] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-30T17:53:36.906736] [DEBUG] [LOCAL ] CE: Trimmed 74857 records to 51519 (keeping 200 days of data) [2025-09-30T17:53:37.095695] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-30T17:53:37.236151] [DEBUG] [LOCAL ] CE: Primary data saved (51519 records). [2025-09-30T17:53:37.236285] [INFO ] [MAIN ] CE: Full history saved. [2025-09-30T17:53:37.236391] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CE took 39.2s. Estimated remaining: 4h 3m 51s. Rate: 8.0 symbols/min [2025-09-30T17:53:37.345414] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:53:37.346044] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-30T17:53:37.346604] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:53:37.346774] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-09-30T17:53:37.362536] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:53:37.367802] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-30T17:53:37.430192] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:37.430386] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-30T17:53:37.431341] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-30T17:53:37.431457] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-30T17:53:37.431571] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CFND took 2.3s. Estimated remaining: 4h 3m 10s. Rate: 8.0 symbols/min [2025-09-30T17:53:37.660133] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:37.693741] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-30T17:53:37.707248] [DEBUG] [LOCAL ] CFR: Loaded 33412 existing records from primary storage. [2025-09-30T17:53:37.707762] [INFO ] [MAIN ] CFR: Loaded 33412 existing records. [2025-09-30T17:53:37.867951] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-30T17:53:37.926854] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:37.928737] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-30T17:53:37.929695] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-30T17:53:37.941588] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-30T17:53:37.968081] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-30T17:53:38.005185] [DEBUG] [LOCAL ] CGAU: Loaded 42672 existing records from primary storage. [2025-09-30T17:53:38.068395] [INFO ] [MAIN ] CGAU: Loaded 42672 existing records. [2025-09-30T17:53:38.086177] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T17:53:38.531586] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:38.545322] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-30T17:53:38.552589] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-30T17:53:38.568531] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-30T17:53:38.574417] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:38.574839] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-30T17:53:38.660515] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-30T17:53:38.967529] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:39.454366] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-30T17:53:39.669620] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T17:53:40.254332] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-30T17:53:40.475325] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T17:53:40.877696] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T17:53:41.054366] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-30T17:53:41.439878] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T17:53:41.854382] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-30T17:53:42.654314] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-30T17:53:42.856915] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T17:53:43.235081] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T17:53:43.454368] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-30T17:53:43.968736] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T17:53:44.254395] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-30T17:53:45.054337] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-30T17:53:45.152286] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:53:45.618177] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T17:53:45.854356] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-30T17:53:46.654386] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-30T17:53:46.881173] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T17:53:47.454464] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-30T17:53:47.676990] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T17:53:48.021058] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T17:53:48.254352] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-30T17:53:49.054328] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-30T17:53:49.259974] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T17:53:49.785282] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T17:53:49.854349] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-30T17:53:50.553534] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T17:53:50.565045] [INFO ] [REMOTE ] CF: Full fetch complete (75192 records). [2025-09-30T17:53:50.565233] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-30T17:53:50.659454] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-30T17:53:51.015319] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-30T17:53:51.015445] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-30T17:53:51.016828] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-30T17:53:51.016912] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-30T17:53:51.018595] [DEBUG] [LOCAL ] CF: Trimmed 75192 records to 52186 (keeping 200 days of data) [2025-09-30T17:53:51.355723] [DEBUG] [LOCAL ] CF: Primary data saved (52186 records). [2025-09-30T17:53:51.355873] [INFO ] [MAIN ] CF: Full history saved. [2025-09-30T17:53:51.355978] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CF took 33.3s. Estimated remaining: 4h 3m 31s. Rate: 8.0 symbols/min [2025-09-30T17:53:51.454765] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-30T17:53:51.550082] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:51.563257] [DEBUG] [LOCAL ] CGV: No existing data file found in primary storage. [2025-09-30T17:53:51.563807] [WARN ] [MAIN ] CGV: No existing data found, performing full refresh instead. [2025-09-30T17:53:51.564734] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T17:53:51.564925] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-30T17:53:51.573029] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-30T17:53:51.573458] [DEBUG] [LOCAL ] CGV: No primary data file found to delete. [2025-09-30T17:53:51.573507] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-30T17:53:51.969212] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:52.254377] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-30T17:53:52.336739] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T17:53:52.998883] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T17:53:53.054337] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-30T17:53:53.460247] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T17:53:53.854384] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-30T17:53:54.350212] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-30T17:53:54.654356] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-30T17:53:54.714537] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T17:53:55.454391] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-30T17:53:55.980611] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T17:53:56.254371] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-30T17:53:56.682612] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-30T17:53:57.054334] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-30T17:53:57.167967] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T17:53:57.179783] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-09-30T17:53:57.179948] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-30T17:53:57.372830] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-30T17:53:57.607850] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-30T17:53:57.607988] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-30T17:53:57.609143] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-30T17:53:57.609225] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-30T17:53:57.610912] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 53624 (keeping 200 days of data) [2025-09-30T17:53:57.855099] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-30T17:53:57.962501] [DEBUG] [LOCAL ] CFG: Primary data saved (53624 records). [2025-09-30T17:53:57.962673] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-30T17:53:57.963288] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CFG took 35.8s. Estimated remaining: 4h 3m 20s. Rate: 8.0 symbols/min [2025-09-30T17:53:58.151582] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:53:58.180233] [DEBUG] [LOCAL ] CHCT: Loaded 23872 existing records from primary storage. [2025-09-30T17:53:58.180498] [INFO ] [MAIN ] CHCT: Loaded 23872 existing records. [2025-09-30T17:53:58.378083] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:53:58.378615] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-30T17:53:58.378716] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-30T17:53:58.379746] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-30T17:53:58.379808] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-30T17:53:58.659464] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-30T17:53:58.763596] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:53:58.998525] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T17:53:59.127512] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-30T17:53:59.454410] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-30T17:54:00.254406] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-30T17:54:00.991250] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T17:54:01.054335] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-30T17:54:01.712931] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T17:54:01.854327] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-30T17:54:02.019690] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T17:54:02.339772] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T17:54:02.654414] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-30T17:54:03.454416] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-30T17:54:04.199488] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T17:54:04.254368] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-30T17:54:04.749168] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T17:54:04.799255] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T17:54:05.054366] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-30T17:54:05.854387] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-30T17:54:06.107996] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T17:54:06.654394] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-30T17:54:06.995079] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T17:54:07.454377] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-30T17:54:07.863985] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T17:54:07.891114] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T17:54:08.254401] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-30T17:54:08.679971] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-30T17:54:09.054378] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-30T17:54:09.854361] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-30T17:54:10.603981] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T17:54:10.654378] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-30T17:54:10.888419] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T17:54:11.454409] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-30T17:54:12.058031] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T17:54:12.254381] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-30T17:54:13.018886] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T17:54:13.054335] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-30T17:54:13.136857] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T17:54:13.854353] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-30T17:54:14.654358] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-30T17:54:14.772899] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T17:54:14.784102] [INFO ] [REMOTE ] CGAU: Full fetch complete (60805 records). [2025-09-30T17:54:14.784273] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-30T17:54:15.223068] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-30T17:54:15.223214] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-30T17:54:15.224279] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-30T17:54:15.224386] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-30T17:54:15.225991] [DEBUG] [LOCAL ] CGAU: Trimmed 60805 records to 42654 (keeping 200 days of data) [2025-09-30T17:54:15.337507] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T17:54:15.347102] [INFO ] [REMOTE ] CFR: Full fetch complete (48560 records). [2025-09-30T17:54:15.348061] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-30T17:54:15.459024] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-30T17:54:15.811410] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-30T17:54:15.811534] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-30T17:54:15.812469] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-30T17:54:15.868328] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-30T17:54:15.901455] [DEBUG] [LOCAL ] CFR: Trimmed 48560 records to 33291 (keeping 200 days of data) [2025-09-30T17:54:15.923890] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T17:54:16.031565] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-30T17:54:16.189473] [DEBUG] [LOCAL ] CGAU: Primary data saved (42654 records). [2025-09-30T17:54:16.194549] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-30T17:54:16.195671] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CGAU took 38.8s. Estimated remaining: 4h 4m 0s. Rate: 8.0 symbols/min [2025-09-30T17:54:16.256265] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-30T17:54:16.331251] [DEBUG] [LOCAL ] CFR: Primary data saved (33291 records). [2025-09-30T17:54:16.331763] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-30T17:54:16.337376] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CFR took 39.1s. Estimated remaining: 4h 3m 20s. Rate: 8.0 symbols/min [2025-09-30T17:54:16.536895] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:54:16.620923] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:54:16.642515] [DEBUG] [LOCAL ] CHE: Loaded 14789 existing records from primary storage. [2025-09-30T17:54:16.642846] [INFO ] [MAIN ] CHE: Loaded 14789 existing records. [2025-09-30T17:54:16.846258] [DEBUG] [LOCAL ] CHD: Loaded 52043 existing records from primary storage. [2025-09-30T17:54:16.866215] [INFO ] [MAIN ] CHD: Loaded 52043 existing records. [2025-09-30T17:54:16.941834] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:54:16.971287] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-30T17:54:16.977566] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-30T17:54:16.995506] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-30T17:54:17.005005] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-30T17:54:17.055794] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-30T17:54:17.150044] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T17:54:17.183574] [INFO ] [REMOTE ] CGV: Full fetch complete (2289 records). [2025-09-30T17:54:17.219603] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:54:17.219918] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-30T17:54:17.225948] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-30T17:54:17.293162] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-30T17:54:17.330206] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-30T17:54:17.402343] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-30T17:54:18.051309] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:54:18.122030] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-30T17:54:18.535727] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-30T17:54:18.535341] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:54:18.535940] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-30T17:54:18.536296] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-30T17:54:18.536727] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-30T17:54:18.553136] [DEBUG] [LOCAL ] CGV: Trimmed 2289 records to 1411 (keeping 200 days of data) [2025-09-30T17:54:18.555003] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T17:54:18.563991] [DEBUG] [LOCAL ] CGV: Primary data saved (1411 records). [2025-09-30T17:54:18.569498] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-30T17:54:18.570112] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CGV took 27.2s. Estimated remaining: 4h 2m 48s. Rate: 8.0 symbols/min [2025-09-30T17:54:18.659498] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-30T17:54:18.758838] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:54:18.809931] [DEBUG] [LOCAL ] CHGG: Loaded 47693 existing records from primary storage. [2025-09-30T17:54:18.810296] [INFO ] [MAIN ] CHGG: Loaded 47693 existing records. [2025-09-30T17:54:19.005736] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:54:19.006012] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-30T17:54:19.006070] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-30T17:54:19.008549] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-30T17:54:19.008613] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-30T17:54:19.327194] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T17:54:19.416000] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:54:19.454346] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-30T17:54:19.874470] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T17:54:19.879723] [INFO ] [REMOTE ] CHCT: Full fetch complete (34922 records). [2025-09-30T17:54:19.879869] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-30T17:54:20.259518] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-30T17:54:20.308175] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-30T17:54:20.308294] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-30T17:54:20.308865] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-30T17:54:20.308931] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-30T17:54:20.309859] [DEBUG] [LOCAL ] CHCT: Trimmed 34922 records to 23849 (keeping 200 days of data) [2025-09-30T17:54:20.464492] [DEBUG] [LOCAL ] CHCT: Primary data saved (23849 records). [2025-09-30T17:54:20.464631] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-30T17:54:20.464759] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CHCT took 22.5s. Estimated remaining: 4h 2m 16s. Rate: 8.0 symbols/min [2025-09-30T17:54:20.650333] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:54:20.688267] [DEBUG] [LOCAL ] CHH: Loaded 32071 existing records from primary storage. [2025-09-30T17:54:20.688580] [INFO ] [MAIN ] CHH: Loaded 32071 existing records. [2025-09-30T17:54:20.881301] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:54:20.881591] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-30T17:54:20.881664] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-30T17:54:20.882612] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-30T17:54:20.882704] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-30T17:54:21.064529] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-30T17:54:21.264091] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T17:54:21.337914] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:54:21.368218] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T17:54:21.854352] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-30T17:54:22.367117] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T17:54:22.654397] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-30T17:54:23.299697] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T17:54:23.454371] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-30T17:54:23.897844] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T17:54:24.254388] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-30T17:54:24.424085] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T17:54:25.054374] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-30T17:54:25.762298] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T17:54:25.854348] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-30T17:54:26.150545] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T17:54:26.654362] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-30T17:54:27.293039] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T17:54:27.347886] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T17:54:27.454391] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-30T17:54:28.254377] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-30T17:54:29.062114] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-30T17:54:29.068468] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T17:54:29.854338] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-30T17:54:30.051438] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T17:54:30.096971] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T17:54:30.654357] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-30T17:54:31.173508] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T17:54:31.454383] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-30T17:54:31.836515] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T17:54:32.254366] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-30T17:54:33.054351] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-30T17:54:33.105942] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T17:54:33.854386] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-30T17:54:34.158828] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-30T17:54:34.195617] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T17:54:34.654399] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-30T17:54:34.786121] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T17:54:35.454331] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-30T17:54:36.254324] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-30T17:54:36.347800] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T17:54:36.423205] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T17:54:37.054353] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-30T17:54:37.854360] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-30T17:54:37.995192] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T17:54:38.423112] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T17:54:38.654385] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-30T17:54:38.678894] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T17:54:39.454369] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-30T17:54:40.254319] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-30T17:54:40.439998] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T17:54:40.492794] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T17:54:41.054369] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-30T17:54:41.854419] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-30T17:54:42.073431] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T17:54:42.144521] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T17:54:42.654387] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-30T17:54:42.993598] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T17:54:42.997972] [INFO ] [REMOTE ] CHE: Full fetch complete (19886 records). [2025-09-30T17:54:42.998061] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-30T17:54:43.391773] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-30T17:54:43.391865] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-30T17:54:43.392299] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-30T17:54:43.392392] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-30T17:54:43.393277] [DEBUG] [LOCAL ] CHE: Trimmed 19886 records to 14939 (keeping 200 days of data) [2025-09-30T17:54:43.466932] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-30T17:54:43.500404] [DEBUG] [LOCAL ] CHE: Primary data saved (14939 records). [2025-09-30T17:54:43.500565] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-30T17:54:43.500679] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHE took 27.2s. Estimated remaining: 4h 3m 17s. Rate: 8.0 symbols/min [2025-09-30T17:54:43.688253] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:54:43.712922] [DEBUG] [LOCAL ] CHMI: Loaded 21938 existing records from primary storage. [2025-09-30T17:54:43.713209] [INFO ] [MAIN ] CHMI: Loaded 21938 existing records. [2025-09-30T17:54:43.924200] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:54:43.924437] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-30T17:54:43.924488] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-30T17:54:43.925051] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-30T17:54:43.925115] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-30T17:54:44.259436] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-30T17:54:44.342352] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:54:44.560540] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T17:54:44.571401] [INFO ] [REMOTE ] CHGG: Full fetch complete (70514 records). [2025-09-30T17:54:44.571569] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-30T17:54:45.052303] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-30T17:54:45.052502] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-30T17:54:45.053373] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-30T17:54:45.053461] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-30T17:54:45.054460] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-30T17:54:45.056801] [DEBUG] [LOCAL ] CHGG: Trimmed 70514 records to 47636 (keeping 200 days of data) [2025-09-30T17:54:45.177792] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T17:54:45.331209] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T17:54:45.420101] [DEBUG] [LOCAL ] CHGG: Primary data saved (47636 records). [2025-09-30T17:54:45.420253] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-30T17:54:45.420355] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHGG took 26.8s. Estimated remaining: 4h 2m 45s. Rate: 8.0 symbols/min [2025-09-30T17:54:45.603561] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:54:45.611193] [DEBUG] [LOCAL ] CHN: Loaded 4812 existing records from primary storage. [2025-09-30T17:54:45.611409] [INFO ] [MAIN ] CHN: Loaded 4812 existing records. [2025-09-30T17:54:45.818082] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:54:45.818392] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-30T17:54:45.818447] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-30T17:54:45.818813] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-30T17:54:45.818877] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-30T17:54:45.859457] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-30T17:54:46.231160] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:54:46.356402] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T17:54:46.654375] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-30T17:54:47.352377] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T17:54:47.454370] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-30T17:54:47.760184] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-30T17:54:48.254329] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-30T17:54:48.619096] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T17:54:48.876623] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T17:54:49.054358] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-30T17:54:49.854374] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-30T17:54:50.425937] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T17:54:50.654362] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-30T17:54:51.240257] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T17:54:51.436696] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T17:54:51.454331] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-30T17:54:52.254418] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-30T17:54:53.060012] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-30T17:54:53.082312] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T17:54:53.228447] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T17:54:53.421851] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-30T17:54:53.854393] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-30T17:54:54.449339] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T17:54:54.654399] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-30T17:54:55.454363] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-30T17:54:55.872183] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-30T17:54:56.254328] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-30T17:54:56.511191] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T17:54:56.523250] [INFO ] [REMOTE ] CHD: Full fetch complete (74383 records). [2025-09-30T17:54:56.523416] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-30T17:54:56.868091] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T17:54:56.976417] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-30T17:54:56.976524] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-30T17:54:56.978066] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-30T17:54:56.978219] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-30T17:54:56.979972] [DEBUG] [LOCAL ] CHD: Trimmed 74383 records to 52070 (keeping 200 days of data) [2025-09-30T17:54:57.079839] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-30T17:54:57.323306] [DEBUG] [LOCAL ] CHD: Primary data saved (52070 records). [2025-09-30T17:54:57.323440] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-30T17:54:57.323536] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHD took 41.1s. Estimated remaining: 4h 2m 57s. Rate: 8.0 symbols/min [2025-09-30T17:54:57.854357] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-30T17:54:58.391691] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T17:54:58.654374] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-30T17:54:59.055044] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T17:54:59.237408] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T17:54:59.454412] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-30T17:55:00.013936] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T17:55:00.254392] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-30T17:55:01.054371] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-30T17:55:01.559011] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T17:55:01.570260] [INFO ] [REMOTE ] CHH: Full fetch complete (46531 records). [2025-09-30T17:55:01.570512] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-30T17:55:01.877929] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-30T17:55:02.067010] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-30T17:55:02.067361] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-30T17:55:02.068049] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-30T17:55:02.068117] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-30T17:55:02.069527] [DEBUG] [LOCAL ] CHH: Trimmed 46531 records to 32027 (keeping 200 days of data) [2025-09-30T17:55:02.297275] [DEBUG] [LOCAL ] CHH: Primary data saved (32027 records). [2025-09-30T17:55:02.297464] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-30T17:55:02.298266] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHH took 41.8s. Estimated remaining: 4h 2m 38s. Rate: 8.0 symbols/min [2025-09-30T17:55:02.373245] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T17:55:02.654362] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-30T17:55:02.733338] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T17:55:02.735319] [INFO ] [REMOTE ] CHN: Full fetch complete (7430 records). [2025-09-30T17:55:02.735432] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-30T17:55:03.137276] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-30T17:55:03.137379] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-30T17:55:03.137618] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-30T17:55:03.137693] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-30T17:55:03.138251] [DEBUG] [LOCAL ] CHN: Trimmed 7430 records to 4833 (keeping 200 days of data) [2025-09-30T17:55:03.168131] [DEBUG] [LOCAL ] CHN: Primary data saved (4833 records). [2025-09-30T17:55:03.168361] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-30T17:55:03.168465] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHN took 17.7s. Estimated remaining: 4h 2m 1s. Rate: 8.0 symbols/min [2025-09-30T17:55:03.603781] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T17:55:03.608770] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-30T17:55:04.383932] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T17:55:04.389506] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-30T17:55:05.243151] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T17:55:05.248470] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-30T17:55:06.271668] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T17:55:06.276491] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-30T17:55:07.515434] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T17:55:07.520911] [INFO ] [REMOTE ] CHMI: Full fetch complete (31758 records). [2025-09-30T17:55:07.521052] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-30T17:55:07.958872] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-30T17:55:07.958979] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-30T17:55:07.959597] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-30T17:55:07.959722] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-30T17:55:07.961137] [DEBUG] [LOCAL ] CHMI: Trimmed 31758 records to 21961 (keeping 200 days of data) [2025-09-30T17:55:08.094893] [DEBUG] [LOCAL ] CHMI: Primary data saved (21961 records). [2025-09-30T17:55:08.095045] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-30T17:55:08.095146] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHMI took 24.6s. Estimated remaining: 4h 1m 42s. Rate: 8.0 symbols/min [2025-09-30T17:55:08.865796] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:08.846000] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:08.885156] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:08.923563] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:08.950437] [DEBUG] [LOCAL ] CHT: Loaded 19553 existing records from primary storage. [2025-09-30T17:55:08.950943] [INFO ] [MAIN ] CHT: Loaded 19553 existing records. [2025-09-30T17:55:09.243248] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-09-30T17:55:09.242516] [DEBUG] [LOCAL ] CI: Loaded 49743 existing records from primary storage. [2025-09-30T17:55:09.247187] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-09-30T17:55:09.258673] [INFO ] [MAIN ] CI: Loaded 49743 existing records. [2025-09-30T17:55:09.246596] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:09.279991] [DEBUG] [LOCAL ] CHPT: Loaded 48897 existing records from primary storage. [2025-09-30T17:55:09.319745] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-30T17:55:09.314492] [INFO ] [MAIN ] CHPT: Loaded 48897 existing records. [2025-09-30T17:55:09.340544] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-30T17:55:09.424527] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-30T17:55:09.491532] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-30T17:55:09.950950] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:09.959623] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:09.988307] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-30T17:55:10.047031] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:10.038193] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-30T17:55:10.037780] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-30T17:55:10.062763] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-30T17:55:10.073602] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-30T17:55:10.086783] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-30T17:55:10.092621] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-30T17:55:10.097996] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-30T17:55:10.073555] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-30T17:55:10.180072] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-30T17:55:10.384987] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-30T17:55:10.428532] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-30T17:55:10.937839] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:11.102097] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-30T17:55:11.451409] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:11.539378] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-30T17:55:11.545419] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:11.558865] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-30T17:55:11.657194] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:11.657624] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-30T17:55:12.544611] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T17:55:12.549101] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-30T17:55:13.490616] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T17:55:13.495220] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-30T17:55:13.554466] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-30T17:55:13.565437] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-30T17:55:13.605467] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-30T17:55:13.618388] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-30T17:55:13.809948] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-30T17:55:13.821141] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-30T17:55:14.274251] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T17:55:14.278788] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-30T17:55:15.107034] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T17:55:15.118701] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-30T17:55:15.258319] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T17:55:15.283911] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T17:55:15.454364] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-30T17:55:16.081889] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-30T17:55:16.254400] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-30T17:55:16.788917] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T17:55:16.880257] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T17:55:17.054381] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-30T17:55:17.854316] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-30T17:55:18.340458] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-30T17:55:18.654399] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-30T17:55:18.880921] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T17:55:18.914726] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T17:55:19.454372] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-30T17:55:20.254418] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-30T17:55:20.470101] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T17:55:21.054361] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-30T17:55:21.292200] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T17:55:21.340822] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-30T17:55:21.854348] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-30T17:55:22.654365] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-30T17:55:22.949626] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T17:55:23.454430] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-30T17:55:23.923429] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-30T17:55:24.254381] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-30T17:55:24.962217] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-30T17:55:25.054365] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-30T17:55:25.213637] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T17:55:25.854386] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-30T17:55:26.186197] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-30T17:55:26.258824] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T17:55:26.654384] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-30T17:55:27.454369] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-30T17:55:27.859813] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T17:55:28.254403] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-30T17:55:28.326103] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T17:55:29.054345] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-30T17:55:29.364398] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T17:55:29.661735] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-30T17:55:29.854354] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-30T17:55:30.654388] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-30T17:55:30.879476] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T17:55:31.454412] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-30T17:55:32.214956] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-30T17:55:32.254334] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-30T17:55:32.835220] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-30T17:55:33.054349] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-30T17:55:33.093073] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T17:55:33.854381] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-30T17:55:34.540013] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-30T17:55:34.654349] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-30T17:55:34.730281] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T17:55:34.741532] [INFO ] [REMOTE ] CI: Full fetch complete (72410 records). [2025-09-30T17:55:34.741722] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-30T17:55:35.190951] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-30T17:55:35.191067] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-30T17:55:35.191983] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-30T17:55:35.192065] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-30T17:55:35.193867] [DEBUG] [LOCAL ] CI: Trimmed 72410 records to 49729 (keeping 200 days of data) [2025-09-30T17:55:35.454381] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-30T17:55:35.532508] [DEBUG] [LOCAL ] CI: Primary data saved (49729 records). [2025-09-30T17:55:35.532724] [INFO ] [MAIN ] CI: Full history saved. [2025-09-30T17:55:35.538902] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CI took 27.4s. Estimated remaining: 4h 3m 2s. Rate: 7.9 symbols/min [2025-09-30T17:55:35.737365] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:35.759106] [DEBUG] [LOCAL ] CIA: Loaded 16973 existing records from primary storage. [2025-09-30T17:55:35.759383] [INFO ] [MAIN ] CIA: Loaded 16973 existing records. [2025-09-30T17:55:35.974226] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:35.974717] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-30T17:55:35.974790] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-30T17:55:35.986395] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-30T17:55:36.006688] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-30T17:55:36.014376] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-30T17:55:36.262448] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-30T17:55:36.422237] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:36.628209] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T17:55:36.658378] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T17:55:37.054362] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-30T17:55:37.854371] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-30T17:55:38.044420] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T17:55:38.049106] [INFO ] [REMOTE ] CHT: Full fetch complete (27339 records). [2025-09-30T17:55:38.049278] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-30T17:55:38.488424] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-30T17:55:38.488628] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-30T17:55:38.489413] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-30T17:55:38.489491] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-30T17:55:38.490507] [DEBUG] [LOCAL ] CHT: Trimmed 27339 records to 19569 (keeping 200 days of data) [2025-09-30T17:55:38.637691] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-30T17:55:38.654735] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-30T17:55:38.661967] [INFO ] [REMOTE ] CHWY: Full fetch complete (77634 records). [2025-09-30T17:55:38.669435] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-30T17:55:38.778990] [DEBUG] [LOCAL ] CHT: Primary data saved (19569 records). [2025-09-30T17:55:38.790904] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-30T17:55:38.791444] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CHT took 30.7s. Estimated remaining: 4h 2m 36s. Rate: 8.0 symbols/min [2025-09-30T17:55:39.179064] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:39.344941] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-30T17:55:39.345241] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-30T17:55:39.346282] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-30T17:55:39.346500] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-30T17:55:39.357069] [DEBUG] [LOCAL ] CHWY: Trimmed 77634 records to 53655 (keeping 200 days of data) [2025-09-30T17:55:39.484193] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T17:55:39.507407] [DEBUG] [LOCAL ] CIB: Loaded 30906 existing records from primary storage. [2025-09-30T17:55:39.521522] [INFO ] [REMOTE ] CHPT: Full fetch complete (72869 records). [2025-09-30T17:55:39.525690] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T17:55:39.520811] [INFO ] [MAIN ] CIB: Loaded 30906 existing records. [2025-09-30T17:55:39.522777] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-30T17:55:39.552464] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-30T17:55:39.863542] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:39.887122] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-30T17:55:39.893223] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-30T17:55:39.926268] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-30T17:55:39.931198] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-30T17:55:40.585228] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-30T17:55:40.622793] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-30T17:55:40.626034] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-30T17:55:40.626598] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-30T17:55:40.731675] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:40.725158] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T17:55:40.733519] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-30T17:55:40.738217] [DEBUG] [LOCAL ] CHPT: Trimmed 72869 records to 48767 (keeping 200 days of data) [2025-09-30T17:55:41.061201] [DEBUG] [LOCAL ] CHWY: Primary data saved (53655 records). [2025-09-30T17:55:41.061394] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-30T17:55:41.062195] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CHWY took 33.0s. Estimated remaining: 4h 2m 5s. Rate: 8.0 symbols/min [2025-09-30T17:55:41.058389] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-30T17:55:41.316994] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:41.318343] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-30T17:55:41.318416] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-30T17:55:41.324820] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-30T17:55:41.326517] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-30T17:55:41.329636] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-30T17:55:41.329777] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-30T17:55:41.420310] [DEBUG] [LOCAL ] CHPT: Primary data saved (48767 records). [2025-09-30T17:55:41.448764] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-30T17:55:41.455103] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CHPT took 33.4s. Estimated remaining: 4h 1m 27s. Rate: 8.0 symbols/min [2025-09-30T17:55:41.869241] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:41.978905] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:41.980211] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T17:55:41.985778] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-30T17:55:42.029540] [DEBUG] [LOCAL ] CIEN: Loaded 52074 existing records from primary storage. [2025-09-30T17:55:42.039472] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T17:55:42.039182] [INFO ] [MAIN ] CIEN: Loaded 52074 existing records. [2025-09-30T17:55:42.237265] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:42.237539] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-30T17:55:42.237592] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-30T17:55:42.239130] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-30T17:55:42.239193] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-30T17:55:42.437891] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-30T17:55:42.645916] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:42.654375] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-30T17:55:43.454379] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-30T17:55:43.875442] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-30T17:55:44.018188] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T17:55:44.254392] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-30T17:55:44.698442] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T17:55:45.054389] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-30T17:55:45.403606] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T17:55:45.854430] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-30T17:55:46.654391] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-30T17:55:47.454339] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-30T17:55:47.716604] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T17:55:47.918698] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T17:55:48.064829] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T17:55:48.254398] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-30T17:55:49.054391] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-30T17:55:49.322291] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-30T17:55:49.617919] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T17:55:49.854401] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-30T17:55:50.262320] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T17:55:50.654398] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-30T17:55:50.941922] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-30T17:55:51.454399] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-30T17:55:52.254362] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-30T17:55:52.580810] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T17:55:52.787830] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T17:55:53.054361] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-30T17:55:53.854386] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-30T17:55:54.058962] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T17:55:54.654412] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-30T17:55:55.454352] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-30T17:55:55.473884] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T17:55:55.520034] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T17:55:56.254402] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-30T17:55:56.701081] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-30T17:55:56.701976] [INFO ] [REMOTE ] CICB: Full fetch complete (2093 records). [2025-09-30T17:55:56.702095] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-30T17:55:56.917418] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-30T17:55:56.917776] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:55:56.917871] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:55:56.918001] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-30T17:55:56.918263] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-30T17:55:56.918401] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-30T17:55:56.918601] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-30T17:55:56.918875] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CICB took 15.9s. Estimated remaining: 4h 1m 53s. Rate: 8.0 symbols/min [2025-09-30T17:55:57.071691] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-30T17:55:57.139670] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:55:57.142187] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T17:55:57.163199] [DEBUG] [LOCAL ] CIF: Loaded 4271 existing records from primary storage. [2025-09-30T17:55:57.163577] [INFO ] [MAIN ] CIF: Loaded 4271 existing records. [2025-09-30T17:55:57.360908] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:55:57.361094] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-30T17:55:57.361213] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-30T17:55:57.361608] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-30T17:55:57.361705] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-30T17:55:57.778520] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:55:57.854341] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-30T17:55:58.330763] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T17:55:58.541977] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-30T17:55:58.654383] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-30T17:55:59.221760] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T17:55:59.454387] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-30T17:56:00.254439] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-30T17:56:01.054449] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-30T17:56:01.318070] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T17:56:01.408830] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-30T17:56:01.859500] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-30T17:56:01.868979] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T17:56:02.654383] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-30T17:56:03.454324] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-30T17:56:03.586978] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T17:56:03.586632] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T17:56:04.146888] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T17:56:04.254366] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-30T17:56:05.054369] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-30T17:56:05.138341] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T17:56:05.854433] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-30T17:56:06.359012] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T17:56:06.508564] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T17:56:06.512149] [INFO ] [REMOTE ] CIA: Full fetch complete (23563 records). [2025-09-30T17:56:06.512230] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-30T17:56:06.659509] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-30T17:56:06.926063] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-30T17:56:06.926159] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-30T17:56:06.926631] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-30T17:56:06.926730] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-30T17:56:06.927627] [DEBUG] [LOCAL ] CIA: Trimmed 23563 records to 17030 (keeping 200 days of data) [2025-09-30T17:56:07.028154] [DEBUG] [LOCAL ] CIA: Primary data saved (17030 records). [2025-09-30T17:56:07.028345] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-30T17:56:07.028455] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CIA took 31.5s. Estimated remaining: 4h 1m 57s. Rate: 8.0 symbols/min [2025-09-30T17:56:07.265479] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:07.321589] [DEBUG] [LOCAL ] CIG: Loaded 43863 existing records from primary storage. [2025-09-30T17:56:07.321958] [INFO ] [MAIN ] CIG: Loaded 43863 existing records. [2025-09-30T17:56:07.459550] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-30T17:56:07.528793] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:56:07.529616] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-30T17:56:07.529711] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-30T17:56:07.531068] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-30T17:56:07.531136] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-30T17:56:07.924627] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:07.984860] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T17:56:08.132730] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-30T17:56:08.254374] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-30T17:56:09.054335] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-30T17:56:09.762797] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T17:56:09.854342] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-30T17:56:09.991128] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T17:56:10.568557] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T17:56:10.654362] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-30T17:56:11.454383] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-30T17:56:12.136003] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-30T17:56:12.254399] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-30T17:56:12.299637] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T17:56:12.637553] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-30T17:56:13.054393] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-30T17:56:13.854348] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-30T17:56:14.654365] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-30T17:56:14.980202] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T17:56:15.212748] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-30T17:56:15.219673] [INFO ] [REMOTE ] CIB: Full fetch complete (44402 records). [2025-09-30T17:56:15.219781] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-30T17:56:15.318155] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-30T17:56:15.460942] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-30T17:56:15.644347] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-30T17:56:15.644493] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-30T17:56:15.645187] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-30T17:56:15.645321] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-30T17:56:15.646594] [DEBUG] [LOCAL ] CIB: Trimmed 44402 records to 30856 (keeping 200 days of data) [2025-09-30T17:56:15.840803] [DEBUG] [LOCAL ] CIB: Primary data saved (30856 records). [2025-09-30T17:56:15.841008] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-30T17:56:15.841136] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIB took 37.0s. Estimated remaining: 4h 1m 55s. Rate: 8.0 symbols/min [2025-09-30T17:56:16.024717] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:16.041468] [DEBUG] [LOCAL ] CII: Loaded 15286 existing records from primary storage. [2025-09-30T17:56:16.041828] [INFO ] [MAIN ] CII: Loaded 15286 existing records. [2025-09-30T17:56:16.226692] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:56:16.226987] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-30T17:56:16.227057] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-30T17:56:16.227773] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-30T17:56:16.227837] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-30T17:56:16.259558] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-30T17:56:16.602276] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:17.054406] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-30T17:56:17.122317] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T17:56:17.696791] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T17:56:17.698317] [INFO ] [REMOTE ] CIF: Full fetch complete (6613 records). [2025-09-30T17:56:17.698400] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-30T17:56:17.855766] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-30T17:56:17.897075] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T17:56:18.151766] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-30T17:56:18.151884] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-30T17:56:18.152082] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-30T17:56:18.152125] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-30T17:56:18.152545] [DEBUG] [LOCAL ] CIF: Trimmed 6613 records to 4251 (keeping 200 days of data) [2025-09-30T17:56:18.178124] [DEBUG] [LOCAL ] CIF: Primary data saved (4251 records). [2025-09-30T17:56:18.178337] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-30T17:56:18.178435] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIF took 21.3s. Estimated remaining: 4h 1m 25s. Rate: 8.0 symbols/min [2025-09-30T17:56:18.369595] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:18.412166] [DEBUG] [LOCAL ] CIM: Loaded 37273 existing records from primary storage. [2025-09-30T17:56:18.412446] [INFO ] [MAIN ] CIM: Loaded 37273 existing records. [2025-09-30T17:56:18.614625] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:56:18.614859] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-30T17:56:18.614910] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-30T17:56:18.616415] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-30T17:56:18.616483] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-30T17:56:18.663970] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-30T17:56:19.035133] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:19.454386] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-30T17:56:19.559849] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T17:56:20.254409] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-30T17:56:20.318886] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T17:56:20.471019] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T17:56:21.054374] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-30T17:56:21.854371] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-30T17:56:21.972898] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T17:56:22.174948] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T17:56:22.422939] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T17:56:22.654387] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-30T17:56:23.454374] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-30T17:56:23.629202] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T17:56:24.254368] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-30T17:56:24.981086] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T17:56:25.054327] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-30T17:56:25.467580] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T17:56:25.854360] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-30T17:56:26.623858] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T17:56:26.654390] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-30T17:56:26.945490] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T17:56:27.454360] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-30T17:56:28.194733] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T17:56:28.254321] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-30T17:56:28.724074] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-30T17:56:28.741285] [INFO ] [REMOTE ] CIEN: Full fetch complete (75583 records). [2025-09-30T17:56:28.741506] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-30T17:56:29.059502] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-30T17:56:29.166740] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T17:56:29.217120] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-30T17:56:29.217222] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-30T17:56:29.218253] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-30T17:56:29.218327] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-30T17:56:29.220889] [DEBUG] [LOCAL ] CIEN: Trimmed 75583 records to 52073 (keeping 200 days of data) [2025-09-30T17:56:29.549412] [DEBUG] [LOCAL ] CIEN: Primary data saved (52073 records). [2025-09-30T17:56:29.549574] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-30T17:56:29.549694] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIEN took 48.1s. Estimated remaining: 4h 1m 34s. Rate: 8.0 symbols/min [2025-09-30T17:56:29.738822] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:29.743875] [DEBUG] [LOCAL ] CIMN: Loaded 2664 existing records from primary storage. [2025-09-30T17:56:29.744072] [INFO ] [MAIN ] CIMN: Loaded 2664 existing records. [2025-09-30T17:56:29.859475] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-30T17:56:29.943458] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:56:29.943708] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-30T17:56:29.943789] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-30T17:56:29.944040] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-30T17:56:29.944102] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-30T17:56:30.320297] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:30.654339] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-30T17:56:30.860496] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T17:56:30.883404] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T17:56:31.454399] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-30T17:56:31.969211] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-30T17:56:32.254347] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-30T17:56:32.417350] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T17:56:33.025077] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T17:56:33.054364] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-30T17:56:33.854359] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-30T17:56:34.418753] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T17:56:34.442401] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T17:56:34.654365] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-30T17:56:35.454361] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-30T17:56:35.794340] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T17:56:36.254312] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-30T17:56:36.255495] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T17:56:36.593703] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T17:56:37.054368] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-30T17:56:37.854344] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-30T17:56:38.560367] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T17:56:38.654376] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-30T17:56:39.328873] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T17:56:39.454357] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-30T17:56:40.254325] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-30T17:56:40.277869] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T17:56:40.281949] [INFO ] [REMOTE ] CII: Full fetch complete (23033 records). [2025-09-30T17:56:40.282032] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-30T17:56:40.490623] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T17:56:40.578716] [INFO ] [REMOTE ] CIG: Full fetch complete (61116 records). [2025-09-30T17:56:40.609458] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-30T17:56:40.912114] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T17:56:40.917576] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-30T17:56:40.940363] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-30T17:56:40.952207] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-30T17:56:40.956589] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-30T17:56:41.050227] [DEBUG] [LOCAL ] CII: Trimmed 23033 records to 15237 (keeping 200 days of data) [2025-09-30T17:56:41.066831] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-30T17:56:41.317700] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-30T17:56:41.319265] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-30T17:56:41.322229] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-30T17:56:41.322313] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-30T17:56:41.322414] [DEBUG] [LOCAL ] CII: Primary data saved (15237 records). [2025-09-30T17:56:41.322770] [INFO ] [MAIN ] CII: Full history saved. [2025-09-30T17:56:41.322891] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CII took 25.5s. Estimated remaining: 4h 1m 45s. Rate: 7.9 symbols/min [2025-09-30T17:56:41.402629] [DEBUG] [LOCAL ] CIG: Trimmed 61116 records to 43817 (keeping 200 days of data) [2025-09-30T17:56:41.639376] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:41.643486] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-30T17:56:41.643861] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-30T17:56:41.645670] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-30T17:56:41.645790] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-30T17:56:41.646228] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-30T17:56:41.646304] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-30T17:56:41.758576] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T17:56:41.855523] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-30T17:56:42.113266] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:42.271907] [DEBUG] [LOCAL ] CIG: Primary data saved (43817 records). [2025-09-30T17:56:42.272110] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-30T17:56:42.272224] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIG took 35.2s. Estimated remaining: 4h 1m 9s. Rate: 8.0 symbols/min [2025-09-30T17:56:42.455218] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:42.455496] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-30T17:56:42.455554] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-30T17:56:42.455694] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-30T17:56:42.455749] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-30T17:56:42.455794] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-30T17:56:42.455828] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-30T17:56:42.663857] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-30T17:56:42.839576] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:43.454386] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-30T17:56:43.522339] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T17:56:43.650503] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:56:43.651004] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-30T17:56:43.651108] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:56:43.651172] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-09-30T17:56:43.651259] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:56:43.651364] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-30T17:56:43.651443] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-30T17:56:43.651482] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-30T17:56:43.651543] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-30T17:56:43.651616] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIMP took 1.4s. Estimated remaining: 4h 0m 35s. Rate: 8.0 symbols/min [2025-09-30T17:56:43.832737] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:43.854847] [DEBUG] [LOCAL ] CINT: Loaded 18619 existing records from primary storage. [2025-09-30T17:56:43.855274] [INFO ] [MAIN ] CINT: Loaded 18619 existing records. [2025-09-30T17:56:43.942515] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T17:56:44.085622] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:56:44.085985] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-30T17:56:44.086058] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-30T17:56:44.086639] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-30T17:56:44.086762] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-30T17:56:44.263897] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-30T17:56:44.507512] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:44.712212] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-30T17:56:45.054359] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-30T17:56:45.595613] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-30T17:56:45.854351] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-30T17:56:46.288540] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-30T17:56:46.654401] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-30T17:56:47.454374] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-30T17:56:47.905704] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T17:56:47.933394] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T17:56:48.254368] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-30T17:56:48.794698] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-30T17:56:48.795831] [INFO ] [REMOTE ] CIMN: Full fetch complete (3910 records). [2025-09-30T17:56:48.795909] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-30T17:56:49.059515] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-30T17:56:49.178215] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-30T17:56:49.178330] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-30T17:56:49.178485] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-30T17:56:49.178526] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-30T17:56:49.178942] [DEBUG] [LOCAL ] CIMN: Trimmed 3910 records to 2679 (keeping 200 days of data) [2025-09-30T17:56:49.196119] [DEBUG] [LOCAL ] CIMN: Primary data saved (2679 records). [2025-09-30T17:56:49.196205] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-30T17:56:49.196282] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIMN took 19.6s. Estimated remaining: 4h 0m 19s. Rate: 8.0 symbols/min [2025-09-30T17:56:49.372784] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:56:49.393268] [DEBUG] [LOCAL ] CIO: Loaded 20139 existing records from primary storage. [2025-09-30T17:56:49.393571] [INFO ] [MAIN ] CIO: Loaded 20139 existing records. [2025-09-30T17:56:49.588628] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T17:56:49.595537] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:56:49.597778] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-30T17:56:49.597840] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-30T17:56:49.598537] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-30T17:56:49.598601] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-30T17:56:49.859488] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-30T17:56:49.986758] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:56:50.351671] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-30T17:56:50.654398] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-30T17:56:51.226585] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T17:56:51.454368] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-30T17:56:51.908512] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T17:56:52.254374] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-30T17:56:53.054397] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-30T17:56:53.308523] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-30T17:56:53.784841] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T17:56:53.854369] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-30T17:56:54.654359] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-30T17:56:55.157011] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-30T17:56:55.293177] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T17:56:55.454363] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-30T17:56:56.254377] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-30T17:56:56.358315] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T17:56:57.054338] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-30T17:56:57.416968] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T17:56:57.687834] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T17:56:57.854378] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-30T17:56:58.654376] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-30T17:56:58.912990] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T17:56:59.454372] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-30T17:56:59.654382] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T17:57:00.254381] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-30T17:57:00.923142] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T17:57:00.981405] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T17:57:01.054372] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-30T17:57:01.854346] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-30T17:57:02.074528] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T17:57:02.605499] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T17:57:02.654392] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-30T17:57:03.454326] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-30T17:57:03.757678] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T17:57:04.254362] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-30T17:57:04.583109] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T17:57:05.054367] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-30T17:57:05.758978] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T17:57:05.759365] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T17:57:05.770244] [INFO ] [REMOTE ] CIMO: Full fetch complete (5274 records). [2025-09-30T17:57:05.770382] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-30T17:57:05.859484] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-30T17:57:05.969831] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T17:57:05.970087] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:57:05.970167] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:57:05.970238] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-30T17:57:05.970306] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-30T17:57:05.970342] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-30T17:57:05.970418] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-30T17:57:05.970530] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIMO took 24.6s. Estimated remaining: 4h 0m 51s. Rate: 8.0 symbols/min [2025-09-30T17:57:06.160232] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:06.191413] [DEBUG] [LOCAL ] CION: Loaded 29154 existing records from primary storage. [2025-09-30T17:57:06.191738] [INFO ] [MAIN ] CION: Loaded 29154 existing records. [2025-09-30T17:57:06.391144] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:06.391361] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-30T17:57:06.391409] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-30T17:57:06.392406] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-30T17:57:06.392470] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-30T17:57:06.657098] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-30T17:57:06.819950] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:06.956475] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T17:57:07.454383] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-30T17:57:07.789463] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T17:57:08.254331] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-30T17:57:08.484991] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T17:57:09.054315] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-30T17:57:09.218463] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T17:57:09.854375] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-30T17:57:10.654371] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-30T17:57:10.713685] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T17:57:10.722329] [INFO ] [REMOTE ] CIM: Full fetch complete (54798 records). [2025-09-30T17:57:10.722484] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-30T17:57:10.875966] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T17:57:11.156128] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-30T17:57:11.156237] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-30T17:57:11.157037] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-30T17:57:11.157107] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-30T17:57:11.158438] [DEBUG] [LOCAL ] CIM: Trimmed 54798 records to 37414 (keeping 200 days of data) [2025-09-30T17:57:11.396951] [DEBUG] [LOCAL ] CIM: Primary data saved (37414 records). [2025-09-30T17:57:11.397095] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-30T17:57:11.397184] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIM took 53.2s. Estimated remaining: 4h 0m 34s. Rate: 8.0 symbols/min [2025-09-30T17:57:11.455596] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-30T17:57:11.526317] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T17:57:11.599481] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:11.652004] [DEBUG] [LOCAL ] CIVI: Loaded 52585 existing records from primary storage. [2025-09-30T17:57:11.652344] [INFO ] [MAIN ] CIVI: Loaded 52585 existing records. [2025-09-30T17:57:11.846285] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:11.846763] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-30T17:57:11.846818] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-30T17:57:11.849044] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-30T17:57:11.849111] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-30T17:57:12.226037] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:12.254323] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-30T17:57:12.667064] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T17:57:13.054380] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-30T17:57:13.854328] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-30T17:57:13.962922] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T17:57:14.137957] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T17:57:14.654376] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-30T17:57:14.982636] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T17:57:15.454417] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-30T17:57:16.254311] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-30T17:57:16.365720] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:57:16.647597] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T17:57:16.652803] [INFO ] [REMOTE ] CIO: Full fetch complete (29007 records). [2025-09-30T17:57:16.652906] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-30T17:57:17.059101] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-30T17:57:17.062480] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-30T17:57:17.062845] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-30T17:57:17.064512] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-30T17:57:17.064832] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-30T17:57:17.066433] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T17:57:17.072858] [DEBUG] [LOCAL ] CIO: Trimmed 29007 records to 20234 (keeping 200 days of data) [2025-09-30T17:57:17.193168] [DEBUG] [LOCAL ] CIO: Primary data saved (20234 records). [2025-09-30T17:57:17.193307] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-30T17:57:17.193391] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CIO took 28.0s. Estimated remaining: 4h 0m 20s. Rate: 8.0 symbols/min [2025-09-30T17:57:17.379885] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:17.439243] [DEBUG] [LOCAL ] CL: Loaded 53644 existing records from primary storage. [2025-09-30T17:57:17.439733] [INFO ] [MAIN ] CL: Loaded 53644 existing records. [2025-09-30T17:57:17.632290] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:17.632557] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-30T17:57:17.632625] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-30T17:57:17.634680] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-30T17:57:17.634747] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-30T17:57:17.859785] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-30T17:57:18.016977] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:18.654375] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-30T17:57:18.691849] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T17:57:19.263426] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T17:57:19.269155] [INFO ] [REMOTE ] CINT: Full fetch complete (26377 records). [2025-09-30T17:57:19.269262] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-30T17:57:19.462253] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-30T17:57:19.693229] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-30T17:57:19.693311] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-30T17:57:19.693799] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-30T17:57:19.693865] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-30T17:57:19.694799] [DEBUG] [LOCAL ] CINT: Trimmed 26377 records to 18629 (keeping 200 days of data) [2025-09-30T17:57:19.802938] [DEBUG] [LOCAL ] CINT: Primary data saved (18629 records). [2025-09-30T17:57:19.803094] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-30T17:57:19.803181] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CINT took 36.2s. Estimated remaining: 3h 59m 51s. Rate: 8.0 symbols/min [2025-09-30T17:57:19.994483] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:20.029773] [DEBUG] [LOCAL ] CLB: Loaded 32878 existing records from primary storage. [2025-09-30T17:57:20.030056] [INFO ] [MAIN ] CLB: Loaded 32878 existing records. [2025-09-30T17:57:20.235119] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:20.235390] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-30T17:57:20.235450] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-30T17:57:20.236425] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-30T17:57:20.236488] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-30T17:57:20.269670] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-30T17:57:20.683233] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-30T17:57:20.681300] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:21.054317] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-30T17:57:21.109729] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T17:57:21.397678] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T17:57:21.854355] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-30T17:57:22.312381] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T17:57:22.654370] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-30T17:57:23.454339] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-30T17:57:23.674876] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T17:57:23.876098] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T17:57:24.254349] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-30T17:57:24.281132] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T17:57:25.054361] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-30T17:57:25.854377] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-30T17:57:26.076808] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T17:57:26.654356] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-30T17:57:27.224613] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-30T17:57:27.303345] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T17:57:27.454379] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-30T17:57:28.254353] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-30T17:57:28.396326] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T17:57:28.765559] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T17:57:29.054367] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-30T17:57:29.460100] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T17:57:29.854367] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-30T17:57:30.654332] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-30T17:57:30.993739] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T17:57:31.464504] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-30T17:57:31.471548] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T17:57:31.689422] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T17:57:32.254417] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-30T17:57:32.896209] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T17:57:33.054384] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-30T17:57:33.854331] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-30T17:57:34.064051] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T17:57:34.181392] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T17:57:34.654376] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-30T17:57:35.326108] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T17:57:35.454368] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-30T17:57:36.254326] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-30T17:57:36.293615] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T17:57:36.305135] [INFO ] [REMOTE ] CIVI: Full fetch complete (75644 records). [2025-09-30T17:57:36.305308] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-30T17:57:36.670226] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T17:57:36.780427] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-30T17:57:36.780551] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-30T17:57:36.781424] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-30T17:57:36.781488] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-30T17:57:36.783043] [DEBUG] [LOCAL ] CIVI: Trimmed 75644 records to 52589 (keeping 200 days of data) [2025-09-30T17:57:37.076545] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-30T17:57:37.128257] [DEBUG] [LOCAL ] CIVI: Primary data saved (52589 records). [2025-09-30T17:57:37.128438] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-30T17:57:37.128550] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CIVI took 25.7s. Estimated remaining: 4h 0m 25s. Rate: 8.0 symbols/min [2025-09-30T17:57:37.340865] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:37.355986] [DEBUG] [LOCAL ] CLCO: Loaded 12684 existing records from primary storage. [2025-09-30T17:57:37.356245] [INFO ] [MAIN ] CLCO: Loaded 12684 existing records. [2025-09-30T17:57:37.588768] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:37.589066] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-30T17:57:37.589115] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-30T17:57:37.589685] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-30T17:57:37.589750] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-30T17:57:37.865876] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-30T17:57:38.002217] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:38.039075] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T17:57:38.341503] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T17:57:38.654378] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-30T17:57:38.945882] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T17:57:39.454370] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-30T17:57:39.971791] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T17:57:40.254430] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-30T17:57:41.054327] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-30T17:57:41.251741] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T17:57:41.303102] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T17:57:41.854364] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-30T17:57:42.472187] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T17:57:42.654341] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-30T17:57:42.888176] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T17:57:43.454389] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-30T17:57:43.915776] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T17:57:43.921667] [INFO ] [REMOTE ] CION: Full fetch complete (41099 records). [2025-09-30T17:57:43.921758] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-30T17:57:44.259480] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-30T17:57:44.331181] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-30T17:57:44.331272] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-30T17:57:44.331881] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-30T17:57:44.331945] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-30T17:57:44.332933] [DEBUG] [LOCAL ] CION: Trimmed 41099 records to 29029 (keeping 200 days of data) [2025-09-30T17:57:44.527784] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T17:57:44.543847] [DEBUG] [LOCAL ] CION: Primary data saved (29029 records). [2025-09-30T17:57:44.544005] [INFO ] [MAIN ] CION: Full history saved. [2025-09-30T17:57:44.545242] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CION took 38.6s. Estimated remaining: 4h 0m 17s. Rate: 8.0 symbols/min [2025-09-30T17:57:44.729927] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:44.756398] [DEBUG] [LOCAL ] CLDT: Loaded 25475 existing records from primary storage. [2025-09-30T17:57:44.756709] [INFO ] [MAIN ] CLDT: Loaded 25475 existing records. [2025-09-30T17:57:44.945348] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:44.945567] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-30T17:57:44.945616] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-30T17:57:44.946474] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-30T17:57:44.946537] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-30T17:57:45.059746] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-30T17:57:45.337377] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:45.854438] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-30T17:57:45.976255] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T17:57:46.654415] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-30T17:57:46.706473] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T17:57:47.209979] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T17:57:47.454365] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-30T17:57:47.724296] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T17:57:48.254368] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-30T17:57:48.513631] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T17:57:49.054363] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-30T17:57:49.774780] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T17:57:49.782306] [INFO ] [REMOTE ] CLB: Full fetch complete (46673 records). [2025-09-30T17:57:49.782450] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-30T17:57:49.862363] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-30T17:57:50.205350] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-30T17:57:50.205469] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-30T17:57:50.216013] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-30T17:57:50.225429] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-30T17:57:50.226903] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T17:57:50.233970] [DEBUG] [LOCAL ] CLB: Trimmed 46673 records to 33011 (keeping 200 days of data) [2025-09-30T17:57:50.452202] [DEBUG] [LOCAL ] CLB: Primary data saved (33011 records). [2025-09-30T17:57:50.452352] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-30T17:57:50.452562] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CLB took 30.6s. Estimated remaining: 4h 0m 3s. Rate: 8.0 symbols/min [2025-09-30T17:57:50.659588] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-30T17:57:50.675862] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:57:50.735726] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-09-30T17:57:50.736120] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-09-30T17:57:50.943541] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:57:50.943849] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-30T17:57:50.943940] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-30T17:57:50.945336] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-30T17:57:50.945418] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-30T17:57:51.358520] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:57:51.454344] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-30T17:57:51.816989] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T17:57:51.899522] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-30T17:57:52.224424] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T17:57:52.254309] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-30T17:57:52.873624] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T17:57:53.054358] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-30T17:57:53.854425] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-30T17:57:54.274978] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-30T17:57:54.654376] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-30T17:57:55.454367] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-30T17:57:55.770630] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-30T17:57:56.254319] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-30T17:57:56.387463] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T17:57:56.536579] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T17:57:57.054352] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-30T17:57:57.854333] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-30T17:57:57.885635] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T17:57:58.205887] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T17:57:58.654377] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-30T17:57:59.454349] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-30T17:57:59.469211] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T17:57:59.848255] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T17:57:59.859949] [INFO ] [REMOTE ] CL: Full fetch complete (77227 records). [2025-09-30T17:57:59.860177] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-30T17:57:59.861238] [FATAL] [VALIDATOR ] CL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T17:57:59.861340] [FATAL] [MAIN ] CL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T17:57:59.861383] [WARN ] [MAIN ] CL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T17:57:59.861456] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-30T17:57:59.861576] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-09-30T17:57:59.861672] [INFO ] [LOCAL ] CL: Starting deletion of derivative data. [2025-09-30T17:57:59.862037] [DEBUG] [LOCAL ] CL: Deleted derivative data file. [2025-09-30T17:57:59.862204] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CL took 42.7s. Estimated remaining: 4h 0m 3s. Rate: 8.0 symbols/min [2025-09-30T17:58:00.040171] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:00.072253] [DEBUG] [LOCAL ] CLH: Loaded 27795 existing records from primary storage. [2025-09-30T17:58:00.072547] [INFO ] [MAIN ] CLH: Loaded 27795 existing records. [2025-09-30T17:58:00.265001] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-30T17:58:00.272137] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:00.272447] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-30T17:58:00.272494] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-30T17:58:00.273386] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-30T17:58:00.273449] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-30T17:58:00.735171] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:01.054328] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-30T17:58:01.225907] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T17:58:01.340554] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T17:58:01.854394] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-30T17:58:02.188086] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-30T17:58:02.654362] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-30T17:58:02.966415] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T17:58:02.969587] [INFO ] [REMOTE ] CLCO: Full fetch complete (22832 records). [2025-09-30T17:58:02.969709] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-30T17:58:03.362316] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-30T17:58:03.362398] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-30T17:58:03.362831] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-30T17:58:03.362894] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-30T17:58:03.363546] [DEBUG] [LOCAL ] CLCO: Trimmed 22832 records to 12668 (keeping 200 days of data) [2025-09-30T17:58:03.443239] [DEBUG] [LOCAL ] CLCO: Primary data saved (12668 records). [2025-09-30T17:58:03.443427] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-30T17:58:03.443589] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CLCO took 26.3s. Estimated remaining: 3h 59m 39s. Rate: 8.0 symbols/min [2025-09-30T17:58:03.460526] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-30T17:58:03.637921] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:03.651295] [DEBUG] [LOCAL ] CLPR: Loaded 11464 existing records from primary storage. [2025-09-30T17:58:03.651534] [INFO ] [MAIN ] CLPR: Loaded 11464 existing records. [2025-09-30T17:58:03.841916] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:03.842141] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-30T17:58:03.842189] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-30T17:58:03.842471] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-30T17:58:03.842533] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-30T17:58:04.233778] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:04.254316] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-30T17:58:04.732201] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T17:58:04.773316] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T17:58:05.054399] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-30T17:58:05.346398] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T17:58:05.854424] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-30T17:58:06.655286] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-30T17:58:06.657816] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T17:58:07.426169] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-30T17:58:07.454334] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-30T17:58:07.765256] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T17:58:08.254406] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-30T17:58:09.054363] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-30T17:58:09.377816] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T17:58:09.555590] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T17:58:09.839678] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T17:58:09.854345] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-30T17:58:10.543946] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-30T17:58:10.654338] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-30T17:58:11.454334] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-30T17:58:11.487318] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T17:58:12.254356] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-30T17:58:12.522224] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T17:58:13.054356] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-30T17:58:13.854354] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-30T17:58:14.237445] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-30T17:58:14.307677] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T17:58:14.540698] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T17:58:14.654366] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-30T17:58:15.454330] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-30T17:58:15.596151] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T17:58:16.254394] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-30T17:58:17.054429] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-30T17:58:17.090943] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T17:58:17.712542] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-30T17:58:17.854366] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-30T17:58:18.442924] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T17:58:18.654375] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-30T17:58:19.454345] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-30T17:58:19.839927] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T17:58:19.898716] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T17:58:19.950872] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-30T17:58:20.254371] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-30T17:58:21.054330] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-30T17:58:21.248474] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T17:58:21.854382] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-30T17:58:22.172712] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T17:58:22.654354] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-30T17:58:23.454367] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-30T17:58:23.502827] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T17:58:23.504908] [INFO ] [REMOTE ] CLPR: Full fetch complete (17592 records). [2025-09-30T17:58:23.505008] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-30T17:58:23.956596] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-30T17:58:23.956742] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-30T17:58:23.957199] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-30T17:58:23.957313] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-30T17:58:23.958358] [DEBUG] [LOCAL ] CLPR: Trimmed 17592 records to 11437 (keeping 200 days of data) [2025-09-30T17:58:24.047960] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-30T17:58:24.077339] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-09-30T17:58:24.079753] [DEBUG] [LOCAL ] CLPR: Primary data saved (11437 records). [2025-09-30T17:58:24.079894] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-30T17:58:24.080245] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-30T17:58:24.080378] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLPR took 20.6s. Estimated remaining: 4h 0m 25s. Rate: 7.9 symbols/min [2025-09-30T17:58:24.255473] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-30T17:58:24.608971] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:24.832913] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T17:58:24.838566] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-30T17:58:24.856266] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-30T17:58:24.858147] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-30T17:58:24.858352] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-30T17:58:24.860127] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 53741 (keeping 200 days of data) [2025-09-30T17:58:24.940967] [DEBUG] [LOCAL ] CLS: Loaded 53629 existing records from primary storage. [2025-09-30T17:58:24.968748] [INFO ] [MAIN ] CLS: Loaded 53629 existing records. [2025-09-30T17:58:25.058161] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-30T17:58:25.198361] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:25.201326] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-30T17:58:25.202062] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-30T17:58:25.204189] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-30T17:58:25.205156] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-30T17:58:25.722480] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:25.745345] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T17:58:25.752660] [INFO ] [REMOTE ] CLDT: Full fetch complete (37028 records). [2025-09-30T17:58:25.753302] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-30T17:58:25.862629] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-30T17:58:26.265500] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-30T17:58:26.265760] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-30T17:58:26.266395] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-30T17:58:26.267362] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-30T17:58:26.291379] [DEBUG] [LOCAL ] CLDT: Trimmed 37028 records to 25444 (keeping 200 days of data) [2025-09-30T17:58:26.295128] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-30T17:58:26.421932] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-09-30T17:58:26.424741] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-30T17:58:26.424899] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLF took 36.0s. Estimated remaining: 3h 59m 56s. Rate: 7.9 symbols/min [2025-09-30T17:58:26.624405] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:26.657482] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-30T17:58:26.680291] [DEBUG] [LOCAL ] CLDT: Primary data saved (25444 records). [2025-09-30T17:58:26.680512] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-30T17:58:26.680721] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLDT took 42.1s. Estimated remaining: 3h 59m 19s. Rate: 8.0 symbols/min [2025-09-30T17:58:26.914787] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:26.917328] [DEBUG] [LOCAL ] CLVT: Loaded 51942 existing records from primary storage. [2025-09-30T17:58:26.917771] [INFO ] [MAIN ] CLVT: Loaded 51942 existing records. [2025-09-30T17:58:27.121161] [DEBUG] [LOCAL ] CLW: Loaded 21833 existing records from primary storage. [2025-09-30T17:58:27.149237] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:27.149464] [INFO ] [MAIN ] CLW: Loaded 21833 existing records. [2025-09-30T17:58:27.149702] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-30T17:58:27.182352] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-30T17:58:27.230720] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-30T17:58:27.257357] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-30T17:58:27.453227] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:27.465260] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-30T17:58:27.486495] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-30T17:58:27.527320] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-30T17:58:27.550257] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-30T17:58:27.968569] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:27.997224] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-30T17:58:28.161936] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T17:58:28.225175] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:28.238189] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-30T17:58:28.254310] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-30T17:58:29.054369] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-30T17:58:29.139997] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T17:58:29.146100] [INFO ] [REMOTE ] CLH: Full fetch complete (41831 records). [2025-09-30T17:58:29.146237] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-30T17:58:29.561008] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-30T17:58:29.561229] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-30T17:58:29.561890] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-30T17:58:29.561957] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-30T17:58:29.563167] [DEBUG] [LOCAL ] CLH: Trimmed 41831 records to 27833 (keeping 200 days of data) [2025-09-30T17:58:29.763317] [DEBUG] [LOCAL ] CLH: Primary data saved (27833 records). [2025-09-30T17:58:29.763522] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-30T17:58:29.763768] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLH took 29.9s. Estimated remaining: 3h 58m 53s. Rate: 8.0 symbols/min [2025-09-30T17:58:29.863047] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-30T17:58:29.975291] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T17:58:29.996267] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:30.067850] [DEBUG] [LOCAL ] CLX: Loaded 51455 existing records from primary storage. [2025-09-30T17:58:30.068197] [INFO ] [MAIN ] CLX: Loaded 51455 existing records. [2025-09-30T17:58:30.353056] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:30.353333] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-30T17:58:30.353506] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-30T17:58:30.359992] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-30T17:58:30.370795] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-30T17:58:30.377322] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T17:58:30.664023] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-30T17:58:30.759997] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:31.454380] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-30T17:58:31.985105] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T17:58:32.105995] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-30T17:58:32.254403] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-30T17:58:33.054379] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-30T17:58:33.278858] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T17:58:33.854393] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-30T17:58:33.899451] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T17:58:34.278979] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T17:58:34.654352] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-30T17:58:35.454420] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-30T17:58:36.252800] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T17:58:36.262217] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-30T17:58:36.316943] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-30T17:58:36.693507] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T17:58:37.054378] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-30T17:58:37.813947] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T17:58:37.854369] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-30T17:58:38.654428] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-30T17:58:39.202187] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T17:58:39.255457] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-30T17:58:39.454411] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-30T17:58:40.254359] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-30T17:58:40.468637] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T17:58:41.054484] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-30T17:58:41.129994] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T17:58:41.854400] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-30T17:58:42.425102] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T17:58:42.576683] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-30T17:58:42.654326] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-30T17:58:43.454346] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-30T17:58:43.605731] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T17:58:44.239111] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T17:58:44.254298] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-30T17:58:44.876477] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-30T17:58:44.999106] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T17:58:45.054342] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-30T17:58:45.854377] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-30T17:58:45.989271] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T17:58:46.654376] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-30T17:58:47.212274] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T17:58:47.454408] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-30T17:58:48.254335] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-30T17:58:48.741082] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-30T17:58:48.838888] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T17:58:49.054376] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-30T17:58:49.829699] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T17:58:49.854316] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-30T17:58:50.541940] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T17:58:50.654360] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-30T17:58:51.454336] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-30T17:58:51.618546] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T17:58:52.202371] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T17:58:52.254355] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-30T17:58:53.054369] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-30T17:58:53.493992] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T17:58:53.859550] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-30T17:58:53.874982] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-30T17:58:54.654396] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-30T17:58:54.818240] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T17:58:55.031227] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T17:58:55.036314] [INFO ] [REMOTE ] CLW: Full fetch complete (35133 records). [2025-09-30T17:58:55.036415] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-30T17:58:55.429985] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-30T17:58:55.430100] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-30T17:58:55.430795] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-30T17:58:55.430864] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-30T17:58:55.432065] [DEBUG] [LOCAL ] CLW: Trimmed 35133 records to 21778 (keeping 200 days of data) [2025-09-30T17:58:55.480947] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-30T17:58:55.569490] [DEBUG] [LOCAL ] CLW: Primary data saved (21778 records). [2025-09-30T17:58:55.569628] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-30T17:58:55.569749] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLW took 28.9s. Estimated remaining: 4h 0m 0s. Rate: 7.9 symbols/min [2025-09-30T17:58:55.749320] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:55.802965] [DEBUG] [LOCAL ] CM: Loaded 48571 existing records from primary storage. [2025-09-30T17:58:55.803396] [INFO ] [MAIN ] CM: Loaded 48571 existing records. [2025-09-30T17:58:55.990264] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:55.990507] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-30T17:58:55.990557] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-30T17:58:55.991101] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-30T17:58:55.991163] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-30T17:58:56.260790] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-30T17:58:56.379401] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:58:56.468454] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T17:58:57.054339] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-30T17:58:57.397581] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T17:58:57.854397] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-30T17:58:58.539001] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T17:58:58.550293] [INFO ] [REMOTE ] CLVT: Full fetch complete (75237 records). [2025-09-30T17:58:58.550503] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-30T17:58:58.659947] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-30T17:58:58.938093] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-30T17:58:59.041568] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-30T17:58:59.041678] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-30T17:58:59.042505] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-30T17:58:59.042549] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-30T17:58:59.044176] [DEBUG] [LOCAL ] CLVT: Trimmed 75237 records to 51954 (keeping 200 days of data) [2025-09-30T17:58:59.342459] [DEBUG] [LOCAL ] CLVT: Primary data saved (51954 records). [2025-09-30T17:58:59.342595] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-30T17:58:59.342702] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLVT took 32.9s. Estimated remaining: 3h 59m 37s. Rate: 7.9 symbols/min [2025-09-30T17:58:59.459477] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-30T17:58:59.530878] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:58:59.587925] [DEBUG] [LOCAL ] CMA: Loaded 49918 existing records from primary storage. [2025-09-30T17:58:59.588314] [INFO ] [MAIN ] CMA: Loaded 49918 existing records. [2025-09-30T17:58:59.795301] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:58:59.795777] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-30T17:58:59.795856] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-30T17:58:59.796484] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-30T17:58:59.796545] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-30T17:59:00.197118] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-30T17:59:00.272862] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:00.285891] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-30T17:59:00.287543] [INFO ] [REMOTE ] CLX: Full fetch complete (73028 records). [2025-09-30T17:59:00.287853] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-30T17:59:00.556349] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T17:59:00.884720] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-30T17:59:00.884837] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-30T17:59:00.885791] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-30T17:59:00.885876] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-30T17:59:00.887864] [DEBUG] [LOCAL ] CLX: Trimmed 73028 records to 51484 (keeping 200 days of data) [2025-09-30T17:59:01.083075] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-30T17:59:01.242396] [DEBUG] [LOCAL ] CLX: Primary data saved (51484 records). [2025-09-30T17:59:01.242576] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-30T17:59:01.242700] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLX took 31.5s. Estimated remaining: 3h 59m 7s. Rate: 8.0 symbols/min [2025-09-30T17:59:01.431939] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:01.455695] [DEBUG] [LOCAL ] CMBT: Loaded 22930 existing records from primary storage. [2025-09-30T17:59:01.456052] [INFO ] [MAIN ] CMBT: Loaded 22930 existing records. [2025-09-30T17:59:01.649870] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:01.650184] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-30T17:59:01.650243] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-30T17:59:01.650572] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-30T17:59:01.650637] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-30T17:59:02.055147] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:02.055898] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-30T17:59:02.094303] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-30T17:59:02.106805] [INFO ] [REMOTE ] CLS: Full fetch complete (77453 records). [2025-09-30T17:59:02.106991] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-30T17:59:02.550920] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-30T17:59:02.551128] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-30T17:59:02.552319] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-30T17:59:02.552453] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-30T17:59:02.586008] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-30T17:59:02.596931] [DEBUG] [LOCAL ] CLS: Trimmed 77453 records to 53623 (keeping 200 days of data) [2025-09-30T17:59:02.660721] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-30T17:59:02.866858] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T17:59:02.977135] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T17:59:03.001158] [DEBUG] [LOCAL ] CLS: Primary data saved (53623 records). [2025-09-30T17:59:03.001352] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-30T17:59:03.001492] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CLS took 38.9s. Estimated remaining: 3h 58m 36s. Rate: 8.0 symbols/min [2025-09-30T17:59:03.197326] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:03.244544] [DEBUG] [LOCAL ] CMC: Loaded 45570 existing records from primary storage. [2025-09-30T17:59:03.244907] [INFO ] [MAIN ] CMC: Loaded 45570 existing records. [2025-09-30T17:59:03.450536] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:03.450784] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-30T17:59:03.450873] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-30T17:59:03.451352] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-30T17:59:03.451413] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-30T17:59:03.457757] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-30T17:59:03.856491] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:04.028230] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T17:59:04.254330] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-30T17:59:04.564253] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T17:59:05.054364] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-30T17:59:05.719834] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T17:59:05.854391] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-30T17:59:06.562309] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T17:59:06.654329] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-30T17:59:07.454334] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-30T17:59:07.562561] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T17:59:08.254372] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-30T17:59:08.331177] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T17:59:08.883305] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T17:59:09.054361] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-30T17:59:09.854347] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-30T17:59:09.900198] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T17:59:09.977687] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T17:59:10.654362] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-30T17:59:11.454365] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-30T17:59:11.755315] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T17:59:11.807554] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T17:59:12.254372] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-30T17:59:12.999596] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T17:59:13.054363] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-30T17:59:13.790869] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T17:59:13.854369] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-30T17:59:14.278384] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T17:59:14.654368] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-30T17:59:14.845142] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T17:59:15.454372] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-30T17:59:16.254342] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-30T17:59:16.290396] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T17:59:17.054371] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-30T17:59:17.143594] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T17:59:17.190969] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-30T17:59:17.854364] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-30T17:59:18.659476] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-30T17:59:18.679988] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T17:59:19.451436] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T17:59:19.460567] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-30T17:59:19.807243] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T17:59:20.254374] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-30T17:59:21.054373] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-30T17:59:21.252733] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T17:59:21.854367] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-30T17:59:22.077546] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T17:59:22.577506] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T17:59:22.654367] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-30T17:59:22.846938] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T17:59:23.454349] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-30T17:59:24.220063] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T17:59:24.254347] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-30T17:59:25.054370] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-30T17:59:25.123953] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T17:59:25.400992] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T17:59:25.854355] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-30T17:59:26.654367] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-30T17:59:26.714675] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T17:59:27.284299] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T17:59:27.454366] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-30T17:59:28.211223] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T17:59:28.254316] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-30T17:59:29.054318] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-30T17:59:29.242465] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T17:59:29.253001] [INFO ] [REMOTE ] CM: Full fetch complete (69347 records). [2025-09-30T17:59:29.253147] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-30T17:59:29.689446] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-30T17:59:29.689562] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-30T17:59:29.690415] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-30T17:59:29.690486] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-30T17:59:29.692143] [DEBUG] [LOCAL ] CM: Trimmed 69347 records to 48567 (keeping 200 days of data) [2025-09-30T17:59:29.883787] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-30T17:59:29.957039] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T17:59:29.970301] [INFO ] [REMOTE ] CMBT: Full fetch complete (30160 records). [2025-09-30T17:59:29.971523] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-30T17:59:30.447866] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-30T17:59:30.448344] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-30T17:59:30.451265] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-30T17:59:30.451386] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-30T17:59:30.470496] [DEBUG] [LOCAL ] CM: Primary data saved (48567 records). [2025-09-30T17:59:30.470845] [INFO ] [MAIN ] CM: Full history saved. [2025-09-30T17:59:30.471507] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CM took 34.9s. Estimated remaining: 3h 59m 49s. Rate: 7.9 symbols/min [2025-09-30T17:59:30.483164] [DEBUG] [LOCAL ] CMBT: Trimmed 30160 records to 23214 (keeping 200 days of data) [2025-09-30T17:59:30.804410] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:30.841357] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T17:59:30.855393] [DEBUG] [LOCAL ] CMCM: Loaded 4758 existing records from primary storage. [2025-09-30T17:59:30.856442] [INFO ] [MAIN ] CMCM: Loaded 4758 existing records. [2025-09-30T17:59:30.862543] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-30T17:59:31.057269] [DEBUG] [LOCAL ] CMBT: Primary data saved (23214 records). [2025-09-30T17:59:31.086563] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:31.081143] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-30T17:59:31.086794] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-30T17:59:31.086864] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-30T17:59:31.086981] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMBT took 29.8s. Estimated remaining: 3h 59m 13s. Rate: 7.9 symbols/min [2025-09-30T17:59:31.122051] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-30T17:59:31.157245] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-30T17:59:31.407916] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:31.428605] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-30T17:59:31.462033] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-30T17:59:31.521009] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-30T17:59:31.529791] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-30T17:59:31.551901] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-30T17:59:31.578580] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-30T17:59:31.754878] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:31.783342] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-30T17:59:32.110326] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:32.102817] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T17:59:32.122265] [INFO ] [REMOTE ] CMA: Full fetch complete (73162 records). [2025-09-30T17:59:32.122674] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-30T17:59:32.257530] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-30T17:59:32.482934] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T17:59:32.517479] [INFO ] [REMOTE ] CMC: Full fetch complete (67044 records). [2025-09-30T17:59:32.527926] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-30T17:59:32.587981] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T17:59:32.680318] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-30T17:59:32.689844] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T17:59:32.719739] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-30T17:59:32.719577] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T17:59:32.742771] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-30T17:59:32.762784] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-30T17:59:32.761573] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-09-30T17:59:32.768980] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T17:59:32.769149] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-30T17:59:32.774991] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-30T17:59:32.791590] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-30T17:59:32.797275] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-30T17:59:32.829472] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-30T17:59:32.899527] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CMDB took 1.8s. Estimated remaining: 3h 58m 42s. Rate: 8.0 symbols/min [2025-09-30T17:59:32.885821] [DEBUG] [LOCAL ] CMA: Trimmed 73162 records to 49922 (keeping 200 days of data) [2025-09-30T17:59:33.086394] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-30T17:59:33.371713] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-30T17:59:33.378637] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-30T17:59:33.379972] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-30T17:59:33.380827] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-30T17:59:33.434223] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:33.444870] [DEBUG] [LOCAL ] CMC: Trimmed 67044 records to 45583 (keeping 200 days of data) [2025-09-30T17:59:33.638158] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T17:59:33.765525] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-09-30T17:59:33.768513] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-09-30T17:59:33.855787] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-30T17:59:34.011737] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:34.065164] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-30T17:59:34.075017] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-30T17:59:34.105978] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-30T17:59:34.109123] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-30T17:59:34.231125] [DEBUG] [LOCAL ] CMA: Primary data saved (49922 records). [2025-09-30T17:59:34.244749] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-30T17:59:34.245230] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMA took 34.9s. Estimated remaining: 3h 58m 10s. Rate: 8.0 symbols/min [2025-09-30T17:59:34.682007] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:34.807809] [DEBUG] [LOCAL ] CMC: Primary data saved (45583 records). [2025-09-30T17:59:34.815223] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-30T17:59:34.814891] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:34.822761] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T17:59:34.825480] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-30T17:59:34.822330] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMC took 31.8s. Estimated remaining: 3h 57m 35s. Rate: 8.0 symbols/min [2025-09-30T17:59:34.992546] [DEBUG] [LOCAL ] CMI: Loaded 41746 existing records from primary storage. [2025-09-30T17:59:35.016371] [INFO ] [MAIN ] CMI: Loaded 41746 existing records. [2025-09-30T17:59:35.110741] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:35.253375] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:35.253699] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-30T17:59:35.253777] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-30T17:59:35.263568] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-30T17:59:35.263633] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-30T17:59:35.420405] [DEBUG] [LOCAL ] CMP: Loaded 36313 existing records from primary storage. [2025-09-30T17:59:35.442038] [INFO ] [MAIN ] CMP: Loaded 36313 existing records. [2025-09-30T17:59:35.498184] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-30T17:59:35.579962] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T17:59:35.897580] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:35.931985] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-30T17:59:35.935778] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:35.936039] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-30T17:59:35.936418] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-30T17:59:35.936500] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-30T17:59:36.262712] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-30T17:59:36.353530] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:36.771912] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T17:59:37.054401] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-30T17:59:37.461829] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-30T17:59:37.818598] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-30T17:59:37.854436] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-30T17:59:38.456218] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T17:59:38.654402] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-30T17:59:39.454415] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-30T17:59:40.254388] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-30T17:59:41.048583] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T17:59:41.056908] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-30T17:59:41.167715] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-30T17:59:41.654693] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T17:59:41.723332] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T17:59:41.854430] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-30T17:59:42.654377] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-30T17:59:43.454375] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-30T17:59:43.792129] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T17:59:43.943195] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-30T17:59:43.970461] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-30T17:59:44.254367] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-30T17:59:45.054406] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-30T17:59:45.734633] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T17:59:45.854379] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-30T17:59:46.654358] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-30T17:59:46.870570] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T17:59:46.873047] [INFO ] [REMOTE ] CMCM: Full fetch complete (6993 records). [2025-09-30T17:59:46.873126] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-30T17:59:47.259783] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-30T17:59:47.260002] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-30T17:59:47.260210] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-30T17:59:47.260284] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-30T17:59:47.260929] [DEBUG] [LOCAL ] CMCM: Trimmed 6993 records to 4747 (keeping 200 days of data) [2025-09-30T17:59:47.288880] [DEBUG] [LOCAL ] CMCM: Primary data saved (4747 records). [2025-09-30T17:59:47.289006] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-30T17:59:47.289218] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMCM took 16.8s. Estimated remaining: 3h 57m 47s. Rate: 8.0 symbols/min [2025-09-30T17:59:47.431375] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-30T17:59:47.456243] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-30T17:59:47.539431] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T17:59:47.593945] [DEBUG] [LOCAL ] CMPO: Loaded 39383 existing records from primary storage. [2025-09-30T17:59:47.594355] [INFO ] [MAIN ] CMPO: Loaded 39383 existing records. [2025-09-30T17:59:47.817767] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T17:59:47.818159] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-09-30T17:59:47.818322] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-30T17:59:47.818693] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-09-30T17:59:47.818765] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-09-30T17:59:48.255206] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-30T17:59:48.268758] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T17:59:48.393958] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T17:59:49.054334] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-09-30T17:59:49.171147] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T17:59:49.854373] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-30T17:59:50.646933] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T17:59:50.655981] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-30T17:59:50.753175] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-30T17:59:51.260721] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T17:59:51.454412] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-09-30T17:59:52.116007] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T17:59:52.254343] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-30T17:59:53.021803] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T17:59:53.054330] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-30T17:59:53.841150] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T17:59:53.854318] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-30T17:59:54.654357] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-09-30T17:59:54.705913] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T17:59:55.454358] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-30T17:59:55.587498] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T17:59:56.023233] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T17:59:56.254364] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-30T17:59:56.598674] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T17:59:57.054364] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-09-30T17:59:57.644081] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T17:59:57.854361] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-30T17:59:58.269354] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T17:59:58.654362] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-09-30T17:59:59.330449] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T17:59:59.454358] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-30T18:00:00.254339] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-30T18:00:00.349234] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T18:00:00.766287] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T18:00:01.054374] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-09-30T18:00:01.854589] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-30T18:00:01.942339] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T18:00:02.654381] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-30T18:00:02.817427] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:00:03.454379] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-09-30T18:00:04.254400] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-30T18:00:04.481611] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T18:00:04.624750] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-09-30T18:00:05.054357] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-30T18:00:05.351773] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-30T18:00:05.854317] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-30T18:00:06.054503] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T18:00:06.427089] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T18:00:06.433710] [INFO ] [REMOTE ] CMP: Full fetch complete (52705 records). [2025-09-30T18:00:06.433909] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-30T18:00:06.659516] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-30T18:00:06.852294] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-30T18:00:06.852392] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-30T18:00:06.853160] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-30T18:00:06.853247] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-30T18:00:06.854439] [DEBUG] [LOCAL ] CMP: Trimmed 52705 records to 36282 (keeping 200 days of data) [2025-09-30T18:00:07.096858] [DEBUG] [LOCAL ] CMP: Primary data saved (36282 records). [2025-09-30T18:00:07.097029] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-30T18:00:07.097215] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMP took 32.3s. Estimated remaining: 3h 58m 28s. Rate: 7.9 symbols/min [2025-09-30T18:00:07.454366] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-09-30T18:00:07.790277] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-30T18:00:08.254344] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-30T18:00:08.587606] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T18:00:08.597103] [INFO ] [REMOTE ] CMI: Full fetch complete (60005 records). [2025-09-30T18:00:08.597272] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-30T18:00:09.051138] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T18:00:09.101330] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-30T18:00:09.101767] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-30T18:00:09.102681] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-30T18:00:09.102904] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-30T18:00:09.103625] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-09-30T18:00:09.105837] [DEBUG] [LOCAL ] CMI: Trimmed 60005 records to 41730 (keeping 200 days of data) [2025-09-30T18:00:09.400317] [DEBUG] [LOCAL ] CMI: Primary data saved (41730 records). [2025-09-30T18:00:09.400465] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-30T18:00:09.400689] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMI took 35.2s. Estimated remaining: 3h 57m 60s. Rate: 8.0 symbols/min [2025-09-30T18:00:10.325571] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-30T18:00:10.338542] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-30T18:00:10.830102] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T18:00:10.842269] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-09-30T18:00:12.759018] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-30T18:00:12.774437] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-30T18:00:14.412442] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (3.57 seconds). [2025-09-30T18:00:14.421414] [INFO ] [REMOTE ] CMPO: Full fetch complete (58678 records). [2025-09-30T18:00:14.421698] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-09-30T18:00:14.422600] [FATAL] [VALIDATOR ] CMPO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:00:14.422725] [FATAL] [MAIN ] CMPO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:00:14.422806] [WARN ] [MAIN ] CMPO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:00:14.422902] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-30T18:00:14.422993] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-09-30T18:00:14.423053] [INFO ] [LOCAL ] CMPO: Starting deletion of derivative data. [2025-09-30T18:00:14.423377] [DEBUG] [LOCAL ] CMPO: Deleted derivative data file. [2025-09-30T18:00:14.424254] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMPO took 27.1s. Estimated remaining: 3h 57m 42s. Rate: 8.0 symbols/min [2025-09-30T18:00:15.372153] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-30T18:00:15.384927] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-09-30T18:00:15.385112] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-30T18:00:15.844598] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-30T18:00:15.844763] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-30T18:00:15.846122] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-30T18:00:15.846265] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-30T18:00:15.848416] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53721 (keeping 200 days of data) [2025-09-30T18:00:16.211479] [DEBUG] [LOCAL ] CMG: Primary data saved (53721 records). [2025-09-30T18:00:16.211639] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-30T18:00:16.211803] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMG took 43.3s. Estimated remaining: 3h 57m 12s. Rate: 8.0 symbols/min [2025-09-30T18:00:17.024227] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:17.022677] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:17.059516] [DEBUG] [LOCAL ] CMS: No existing data file found in primary storage. [2025-09-30T18:00:17.068536] [WARN ] [MAIN ] CMS: No existing data found, performing full refresh instead. [2025-09-30T18:00:17.081668] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-30T18:00:17.088886] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:17.089968] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-30T18:00:17.089803] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:17.090231] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-09-30T18:00:17.090341] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-30T18:00:17.173963] [DEBUG] [LOCAL ] CMSC: Loaded 5080 existing records from primary storage. [2025-09-30T18:00:17.195447] [INFO ] [MAIN ] CMSC: Loaded 5080 existing records. [2025-09-30T18:00:17.229845] [DEBUG] [LOCAL ] CMSA: Loaded 3414 existing records from primary storage. [2025-09-30T18:00:17.244357] [INFO ] [MAIN ] CMSA: Loaded 3414 existing records. [2025-09-30T18:00:17.503290] [DEBUG] [LOCAL ] CMRE: Loaded 35457 existing records from primary storage. [2025-09-30T18:00:17.602304] [INFO ] [MAIN ] CMRE: Loaded 35457 existing records. [2025-09-30T18:00:17.896314] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:17.943061] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-30T18:00:17.998233] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-30T18:00:17.998093] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:18.065592] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-30T18:00:18.065415] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-30T18:00:18.109338] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:18.102390] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-30T18:00:18.110207] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-30T18:00:18.109424] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-30T18:00:18.116720] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-30T18:00:18.173117] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-30T18:00:18.322967] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:18.388435] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-30T18:00:18.403537] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-30T18:00:18.422584] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-30T18:00:18.455083] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-30T18:00:19.235177] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:19.287257] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-30T18:00:19.406103] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:19.410435] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-30T18:00:19.498411] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:19.498835] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-30T18:00:19.973612] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T18:00:19.985162] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-30T18:00:20.017539] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-30T18:00:20.019418] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-30T18:00:20.031551] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T18:00:20.034054] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-30T18:00:20.526694] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T18:00:20.533855] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-30T18:00:20.606211] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T18:00:20.608492] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-30T18:00:21.074491] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T18:00:21.076206] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-30T18:00:21.369687] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:00:21.380578] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-30T18:00:21.407161] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T18:00:21.409104] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-30T18:00:21.798109] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-30T18:00:21.854341] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-30T18:00:21.879309] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T18:00:21.984249] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T18:00:22.367908] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T18:00:22.654306] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-30T18:00:23.064598] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:00:23.133105] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T18:00:23.454425] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-30T18:00:24.254407] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-30T18:00:24.441318] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T18:00:24.827020] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T18:00:25.054405] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-30T18:00:25.648504] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T18:00:25.854366] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-30T18:00:26.654420] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-30T18:00:27.109439] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T18:00:27.373094] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:00:27.454410] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-30T18:00:28.020920] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T18:00:28.254374] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-30T18:00:28.758058] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T18:00:29.054374] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-30T18:00:29.537726] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-30T18:00:29.854402] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-30T18:00:30.453449] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T18:00:30.654412] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-30T18:00:31.454384] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-30T18:00:32.254341] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-30T18:00:32.272262] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T18:00:32.274095] [INFO ] [REMOTE ] CMSC: Full fetch complete (7185 records). [2025-09-30T18:00:32.274197] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-30T18:00:32.691294] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-30T18:00:32.691416] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-30T18:00:32.691814] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-30T18:00:32.691919] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-30T18:00:32.692749] [DEBUG] [LOCAL ] CMSC: Trimmed 7185 records to 5049 (keeping 200 days of data) [2025-09-30T18:00:32.806459] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-30T18:00:32.824026] [DEBUG] [LOCAL ] CMSC: Primary data saved (5049 records). [2025-09-30T18:00:32.824135] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-30T18:00:32.824213] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSC took 16.6s. Estimated remaining: 3h 57m 40s. Rate: 8.0 symbols/min [2025-09-30T18:00:33.011477] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:33.023564] [DEBUG] [LOCAL ] CMSD: Loaded 8088 existing records from primary storage. [2025-09-30T18:00:33.023889] [INFO ] [MAIN ] CMSD: Loaded 8088 existing records. [2025-09-30T18:00:33.065473] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-30T18:00:33.227759] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:33.228080] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-30T18:00:33.228139] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-30T18:00:33.228451] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-30T18:00:33.228511] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-30T18:00:33.553334] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T18:00:33.626403] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:33.850574] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T18:00:33.858114] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-30T18:00:34.654366] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-30T18:00:35.454353] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-30T18:00:35.619678] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:00:35.800731] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-30T18:00:36.150319] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:00:36.254369] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-30T18:00:36.901690] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T18:00:36.903217] [INFO ] [REMOTE ] CMSA: Full fetch complete (5138 records). [2025-09-30T18:00:36.903292] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-30T18:00:37.059523] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-30T18:00:37.318472] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-30T18:00:37.318557] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-30T18:00:37.318798] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-30T18:00:37.318862] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-30T18:00:37.319326] [DEBUG] [LOCAL ] CMSA: Trimmed 5138 records to 3503 (keeping 200 days of data) [2025-09-30T18:00:37.342226] [DEBUG] [LOCAL ] CMSA: Primary data saved (3503 records). [2025-09-30T18:00:37.342348] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-30T18:00:37.342437] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSA took 21.1s. Estimated remaining: 3h 57m 21s. Rate: 8.0 symbols/min [2025-09-30T18:00:37.528506] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:37.581533] [DEBUG] [LOCAL ] CMTG: Loaded 37127 existing records from primary storage. [2025-09-30T18:00:37.581863] [INFO ] [MAIN ] CMTG: Loaded 37127 existing records. [2025-09-30T18:00:37.770821] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:37.771029] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-30T18:00:37.771078] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-30T18:00:37.771461] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-30T18:00:37.771520] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-30T18:00:37.859481] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-30T18:00:38.171253] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:38.206329] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T18:00:38.654397] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-30T18:00:39.238283] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T18:00:39.253515] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T18:00:39.454396] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-30T18:00:40.146752] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T18:00:40.254444] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-30T18:00:41.054420] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-30T18:00:41.274350] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T18:00:41.601658] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T18:00:41.854421] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-30T18:00:42.654382] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-30T18:00:43.454334] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-30T18:00:43.574457] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T18:00:43.834601] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T18:00:43.944712] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T18:00:44.254383] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-30T18:00:45.054376] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-30T18:00:45.629691] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T18:00:45.854366] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-30T18:00:46.650584] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T18:00:46.661429] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-30T18:00:47.406724] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T18:00:47.454376] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-30T18:00:48.142098] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T18:00:48.254400] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-30T18:00:48.906400] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T18:00:49.054352] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-30T18:00:49.213122] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T18:00:49.786280] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T18:00:49.854361] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-30T18:00:50.654359] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-30T18:00:51.464476] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-30T18:00:51.470622] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T18:00:51.483082] [INFO ] [REMOTE ] CMS: Full fetch complete (76018 records). [2025-09-30T18:00:51.483244] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-30T18:00:51.656213] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-30T18:00:51.935605] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-30T18:00:51.935734] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-30T18:00:51.936631] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-30T18:00:51.936764] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-30T18:00:51.939777] [DEBUG] [LOCAL ] CMS: Trimmed 76018 records to 52610 (keeping 200 days of data) [2025-09-30T18:00:52.255097] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-30T18:00:52.278972] [DEBUG] [LOCAL ] CMS: Primary data saved (52610 records). [2025-09-30T18:00:52.279145] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-30T18:00:52.279234] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMS took 36.1s. Estimated remaining: 3h 57m 42s. Rate: 7.9 symbols/min [2025-09-30T18:00:52.488364] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:52.497633] [DEBUG] [LOCAL ] CMU: Loaded 7024 existing records from primary storage. [2025-09-30T18:00:52.497956] [INFO ] [MAIN ] CMU: Loaded 7024 existing records. [2025-09-30T18:00:52.697582] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:52.697857] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-30T18:00:52.697906] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-30T18:00:52.698088] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-30T18:00:52.698147] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-30T18:00:53.064607] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-30T18:00:53.092707] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T18:00:53.105522] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:00:53.149384] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:53.854401] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-30T18:00:54.654352] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-30T18:00:54.703309] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T18:00:54.705569] [INFO ] [REMOTE ] CMSD: Full fetch complete (12448 records). [2025-09-30T18:00:54.705677] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-30T18:00:54.940443] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T18:00:55.177233] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-30T18:00:55.177334] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-30T18:00:55.177709] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-30T18:00:55.177780] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-30T18:00:55.178599] [DEBUG] [LOCAL ] CMSD: Trimmed 12448 records to 8092 (keeping 200 days of data) [2025-09-30T18:00:55.232098] [DEBUG] [LOCAL ] CMSD: Primary data saved (8092 records). [2025-09-30T18:00:55.232252] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-30T18:00:55.232434] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMSD took 22.4s. Estimated remaining: 3h 57m 17s. Rate: 8.0 symbols/min [2025-09-30T18:00:55.349240] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-30T18:00:55.430921] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:00:55.461717] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-30T18:00:55.464447] [DEBUG] [LOCAL ] CNA: Loaded 32662 existing records from primary storage. [2025-09-30T18:00:55.464855] [INFO ] [MAIN ] CNA: Loaded 32662 existing records. [2025-09-30T18:00:55.663607] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:00:55.663842] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-30T18:00:55.663891] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-30T18:00:55.664158] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-30T18:00:55.664217] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-30T18:00:56.050999] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:00:56.254411] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-30T18:00:56.379664] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T18:00:57.054373] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-30T18:00:57.517699] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T18:00:57.628128] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T18:00:57.854406] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-30T18:00:58.654387] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-30T18:00:59.331242] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T18:00:59.454377] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-30T18:00:59.841587] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T18:01:00.254359] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-30T18:01:00.658192] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T18:01:01.054392] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-30T18:01:01.551791] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T18:01:01.558914] [INFO ] [REMOTE ] CMRE: Full fetch complete (49663 records). [2025-09-30T18:01:01.559038] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-30T18:01:01.559776] [FATAL] [VALIDATOR ] CMRE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:01:01.559896] [FATAL] [MAIN ] CMRE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:01:01.559943] [WARN ] [MAIN ] CMRE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:01:01.560035] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-30T18:01:01.560105] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-09-30T18:01:01.560144] [INFO ] [LOCAL ] CMRE: Starting deletion of derivative data. [2025-09-30T18:01:01.560419] [DEBUG] [LOCAL ] CMRE: Deleted derivative data file. [2025-09-30T18:01:01.560517] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMRE took 45.3s. Estimated remaining: 3h 57m 5s. Rate: 8.0 symbols/min [2025-09-30T18:01:01.763715] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:01:01.827703] [DEBUG] [LOCAL ] CNC: Loaded 53739 existing records from primary storage. [2025-09-30T18:01:01.828176] [INFO ] [MAIN ] CNC: Loaded 53739 existing records. [2025-09-30T18:01:01.863247] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-30T18:01:02.003805] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T18:01:02.046692] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:01:02.046908] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-30T18:01:02.046958] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-30T18:01:02.047469] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-30T18:01:02.047739] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-30T18:01:02.432088] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:01:02.654378] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-30T18:01:03.362334] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T18:01:03.454362] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-30T18:01:03.541865] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T18:01:04.254381] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-30T18:01:04.796185] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T18:01:05.054359] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-30T18:01:05.854339] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-30T18:01:05.931637] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T18:01:06.375026] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T18:01:06.654333] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-30T18:01:06.785807] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T18:01:07.454378] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-30T18:01:08.254321] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-30T18:01:08.384011] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T18:01:08.867851] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T18:01:08.868632] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T18:01:09.054357] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-30T18:01:09.854360] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-30T18:01:10.654365] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-30T18:01:10.724823] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T18:01:10.732073] [INFO ] [REMOTE ] CMTG: Full fetch complete (53440 records). [2025-09-30T18:01:10.732198] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-30T18:01:11.145665] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-30T18:01:11.145783] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-30T18:01:11.146514] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-30T18:01:11.146579] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-30T18:01:11.147767] [DEBUG] [LOCAL ] CMTG: Trimmed 53440 records to 36969 (keeping 200 days of data) [2025-09-30T18:01:11.378844] [DEBUG] [LOCAL ] CMTG: Primary data saved (36969 records). [2025-09-30T18:01:11.379046] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-30T18:01:11.379774] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMTG took 34.0s. Estimated remaining: 3h 57m 6s. Rate: 8.0 symbols/min [2025-09-30T18:01:11.459697] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-30T18:01:11.566061] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:01:11.580439] [DEBUG] [LOCAL ] CNF: Loaded 11068 existing records from primary storage. [2025-09-30T18:01:11.580712] [INFO ] [MAIN ] CNF: Loaded 11068 existing records. [2025-09-30T18:01:11.713323] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T18:01:11.840763] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:01:11.842933] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-30T18:01:11.852896] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-30T18:01:11.853513] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-30T18:01:11.854112] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-30T18:01:11.854174] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-30T18:01:12.230864] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:01:12.254363] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-30T18:01:12.899514] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T18:01:13.054365] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-30T18:01:13.854362] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-30T18:01:14.077846] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T18:01:14.363552] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T18:01:14.441347] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-30T18:01:14.654350] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-30T18:01:15.454390] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-30T18:01:16.086630] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T18:01:16.254379] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-30T18:01:17.054343] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-30T18:01:17.143856] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-30T18:01:17.854371] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-30T18:01:18.267887] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T18:01:18.297536] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T18:01:18.654403] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-30T18:01:19.076466] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-30T18:01:19.454385] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-30T18:01:20.254379] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-30T18:01:20.557188] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T18:01:20.559792] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T18:01:20.562537] [INFO ] [REMOTE ] CMU: Full fetch complete (9646 records). [2025-09-30T18:01:20.574939] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-30T18:01:20.989978] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-30T18:01:20.990063] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-30T18:01:20.990338] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-30T18:01:20.990382] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-30T18:01:20.990986] [DEBUG] [LOCAL ] CMU: Trimmed 9646 records to 6938 (keeping 200 days of data) [2025-09-30T18:01:21.034378] [DEBUG] [LOCAL ] CMU: Primary data saved (6938 records). [2025-09-30T18:01:21.034510] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-30T18:01:21.034593] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMU took 28.8s. Estimated remaining: 3h 57m 6s. Rate: 7.9 symbols/min [2025-09-30T18:01:21.059482] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-30T18:01:21.229577] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:01:21.290392] [DEBUG] [LOCAL ] CNH: Loaded 53557 existing records from primary storage. [2025-09-30T18:01:21.290796] [INFO ] [MAIN ] CNH: Loaded 53557 existing records. [2025-09-30T18:01:21.487992] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:01:21.488268] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-30T18:01:21.488334] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-30T18:01:21.489038] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-30T18:01:21.489100] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-30T18:01:21.869176] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-30T18:01:21.914991] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:01:21.939958] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T18:01:22.654328] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-30T18:01:22.748150] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T18:01:22.847136] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T18:01:23.454399] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-30T18:01:24.055841] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-30T18:01:24.184958] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T18:01:24.254355] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-30T18:01:25.054358] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-30T18:01:25.761456] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T18:01:25.854364] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-30T18:01:26.654364] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-30T18:01:26.697731] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T18:01:26.991467] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-30T18:01:27.454409] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-30T18:01:27.947396] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T18:01:28.234255] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T18:01:28.254319] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-30T18:01:28.938730] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T18:01:29.054422] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-30T18:01:29.854394] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-30T18:01:30.654371] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-30T18:01:30.956129] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T18:01:31.454370] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-30T18:01:31.682819] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T18:01:31.686769] [INFO ] [REMOTE ] CNF: Full fetch complete (12963 records). [2025-09-30T18:01:31.686895] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-30T18:01:32.112434] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-30T18:01:32.112751] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-30T18:01:32.113144] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-30T18:01:32.113240] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-30T18:01:32.114305] [DEBUG] [LOCAL ] CNF: Trimmed 12963 records to 10899 (keeping 200 days of data) [2025-09-30T18:01:32.183874] [DEBUG] [LOCAL ] CNF: Primary data saved (10899 records). [2025-09-30T18:01:32.184058] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-30T18:01:32.184188] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNF took 20.8s. Estimated remaining: 3h 57m 13s. Rate: 7.9 symbols/min [2025-09-30T18:01:32.259190] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-30T18:01:32.397208] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:01:32.446698] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-30T18:01:32.514499] [DEBUG] [LOCAL ] CNI: Loaded 51653 existing records from primary storage. [2025-09-30T18:01:32.514990] [INFO ] [MAIN ] CNI: Loaded 51653 existing records. [2025-09-30T18:01:32.786776] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:01:32.788419] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-30T18:01:32.788482] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-30T18:01:32.788953] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-30T18:01:32.789053] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-30T18:01:33.030892] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T18:01:33.059297] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-30T18:01:33.438304] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:01:33.784017] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T18:01:33.790865] [INFO ] [REMOTE ] CNA: Full fetch complete (45309 records). [2025-09-30T18:01:33.791000] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-30T18:01:33.791724] [FATAL] [VALIDATOR ] CNA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:01:33.791811] [FATAL] [MAIN ] CNA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:01:33.791855] [WARN ] [MAIN ] CNA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:01:33.791925] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-30T18:01:33.792014] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-09-30T18:01:33.792074] [INFO ] [LOCAL ] CNA: Starting deletion of derivative data. [2025-09-30T18:01:33.792293] [DEBUG] [LOCAL ] CNA: Deleted derivative data file. [2025-09-30T18:01:33.792387] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNA took 38.6s. Estimated remaining: 3h 56m 42s. Rate: 8.0 symbols/min [2025-09-30T18:01:33.862812] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-30T18:01:33.986282] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:01:34.050732] [DEBUG] [LOCAL ] CNK: Loaded 52880 existing records from primary storage. [2025-09-30T18:01:34.051128] [INFO ] [MAIN ] CNK: Loaded 52880 existing records. [2025-09-30T18:01:34.266407] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:01:34.266629] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-30T18:01:34.266726] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-30T18:01:34.267323] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-30T18:01:34.267386] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-30T18:01:34.658844] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-30T18:01:34.685019] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:01:35.402520] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-30T18:01:35.415532] [INFO ] [REMOTE ] CNC: Full fetch complete (77675 records). [2025-09-30T18:01:35.415937] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-30T18:01:35.464711] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-30T18:01:35.917990] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-30T18:01:35.918185] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-30T18:01:35.919264] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-30T18:01:35.919364] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-30T18:01:35.922889] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-30T18:01:35.936078] [DEBUG] [LOCAL ] CNC: Trimmed 77675 records to 53740 (keeping 200 days of data) [2025-09-30T18:01:36.258165] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-30T18:01:36.286424] [DEBUG] [LOCAL ] CNC: Primary data saved (53740 records). [2025-09-30T18:01:36.286957] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-30T18:01:36.287062] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNC took 34.7s. Estimated remaining: 3h 56m 15s. Rate: 8.0 symbols/min [2025-09-30T18:01:36.487579] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:01:36.545380] [DEBUG] [LOCAL ] CNM: Loaded 50973 existing records from primary storage. [2025-09-30T18:01:36.545871] [INFO ] [MAIN ] CNM: Loaded 50973 existing records. [2025-09-30T18:01:36.762870] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:01:36.763458] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-30T18:01:36.763560] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-30T18:01:36.764137] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-30T18:01:36.795004] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-30T18:01:36.862075] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-30T18:01:37.059442] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-30T18:01:37.228927] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:01:37.353510] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T18:01:37.854352] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-30T18:01:38.107349] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T18:01:38.654344] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-30T18:01:38.924205] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T18:01:39.454375] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-30T18:01:39.714216] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T18:01:40.254353] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-30T18:01:40.417827] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:01:41.054389] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-30T18:01:41.437666] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-30T18:01:41.854320] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-30T18:01:42.200899] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T18:01:42.404845] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T18:01:42.654379] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-30T18:01:43.378132] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:01:43.454408] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-30T18:01:44.231921] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:01:44.254337] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-30T18:01:45.054369] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-30T18:01:45.117511] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T18:01:45.575612] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:01:45.854371] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-30T18:01:46.659485] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-30T18:01:46.678509] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T18:01:47.454376] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-30T18:01:47.520997] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T18:01:48.254331] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-30T18:01:48.525917] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T18:01:49.054358] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-30T18:01:49.309946] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T18:01:49.854340] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-30T18:01:50.108810] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T18:01:50.655145] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T18:01:50.655226] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-30T18:01:51.454410] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-30T18:01:51.971742] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-30T18:01:52.263625] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-30T18:01:52.270699] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-30T18:01:53.054333] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-30T18:01:53.109721] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T18:01:53.854401] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-30T18:01:53.898549] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T18:01:54.599111] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T18:01:54.654371] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-30T18:01:55.454374] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-30T18:01:55.751956] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-30T18:01:56.254446] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-30T18:01:56.501956] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T18:01:56.816503] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T18:01:57.054428] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-30T18:01:57.854392] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-30T18:01:58.094930] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T18:01:58.654361] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-30T18:01:58.847836] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T18:01:59.454395] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-30T18:01:59.705534] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T18:01:59.718868] [INFO ] [REMOTE ] CNH: Full fetch complete (77533 records). [2025-09-30T18:01:59.719099] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-30T18:02:00.204824] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-30T18:02:00.205015] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-30T18:02:00.206279] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-30T18:02:00.206527] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-30T18:02:00.208501] [DEBUG] [LOCAL ] CNH: Trimmed 77533 records to 53555 (keeping 200 days of data) [2025-09-30T18:02:00.270486] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-30T18:02:00.401835] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T18:02:00.693542] [DEBUG] [LOCAL ] CNH: Primary data saved (53555 records). [2025-09-30T18:02:00.693723] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-30T18:02:00.693928] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNH took 39.7s. Estimated remaining: 3h 57m 12s. Rate: 7.9 symbols/min [2025-09-30T18:02:00.877295] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:00.877559] [DEBUG] [LOCAL ] CNMD: No existing data file found in primary storage. [2025-09-30T18:02:00.877616] [WARN ] [MAIN ] CNMD: No existing data found, performing full refresh instead. [2025-09-30T18:02:00.877788] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-30T18:02:00.877852] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-30T18:02:00.877919] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-09-30T18:02:00.877976] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-30T18:02:01.056693] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-30T18:02:01.256191] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:01.293307] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T18:02:01.854361] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-30T18:02:02.089136] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T18:02:02.654455] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-30T18:02:02.964869] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:02:02.976708] [INFO ] [REMOTE ] CNK: Full fetch complete (75738 records). [2025-09-30T18:02:02.976876] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-30T18:02:03.405262] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-30T18:02:03.405347] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-30T18:02:03.406161] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-30T18:02:03.406227] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-30T18:02:03.407752] [DEBUG] [LOCAL ] CNK: Trimmed 75738 records to 52880 (keeping 200 days of data) [2025-09-30T18:02:03.492293] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-30T18:02:03.941151] [DEBUG] [LOCAL ] CNK: Primary data saved (52880 records). [2025-09-30T18:02:03.941329] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-30T18:02:03.941524] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNK took 30.1s. Estimated remaining: 3h 56m 48s. Rate: 7.9 symbols/min [2025-09-30T18:02:04.137614] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:04.205366] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-30T18:02:04.203572] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T18:02:04.228987] [INFO ] [REMOTE ] CNI: Full fetch complete (74657 records). [2025-09-30T18:02:04.229603] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-30T18:02:04.264964] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-30T18:02:04.417483] [DEBUG] [LOCAL ] CNNE: Loaded 36466 existing records from primary storage. [2025-09-30T18:02:04.429466] [INFO ] [MAIN ] CNNE: Loaded 36466 existing records. [2025-09-30T18:02:04.851978] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:02:04.873302] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-30T18:02:04.913857] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-30T18:02:04.918447] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-30T18:02:04.918584] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-30T18:02:04.918784] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-30T18:02:04.919065] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-30T18:02:04.933114] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-30T18:02:04.960467] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-30T18:02:05.050561] [DEBUG] [LOCAL ] CNI: Trimmed 74657 records to 51650 (keeping 200 days of data) [2025-09-30T18:02:05.115106] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T18:02:05.122446] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-30T18:02:05.478381] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:05.745781] [DEBUG] [LOCAL ] CNI: Primary data saved (51650 records). [2025-09-30T18:02:05.746037] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-30T18:02:05.747142] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNI took 33.6s. Estimated remaining: 3h 56m 19s. Rate: 7.9 symbols/min [2025-09-30T18:02:05.859482] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-30T18:02:05.945889] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:05.997614] [DEBUG] [LOCAL ] CNO: Loaded 41180 existing records from primary storage. [2025-09-30T18:02:05.997962] [INFO ] [MAIN ] CNO: Loaded 41180 existing records. [2025-09-30T18:02:06.218784] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:02:06.219077] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-30T18:02:06.219146] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-30T18:02:06.220182] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-30T18:02:06.220408] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-30T18:02:06.376404] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T18:02:06.446791] [INFO ] [REMOTE ] CNM: Full fetch complete (73630 records). [2025-09-30T18:02:06.492016] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-30T18:02:06.798047] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:06.819930] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-30T18:02:07.042293] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-30T18:02:07.171867] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T18:02:07.170964] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-30T18:02:07.172000] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-30T18:02:07.178907] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-30T18:02:07.179056] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-30T18:02:07.180480] [DEBUG] [LOCAL ] CNM: Trimmed 73630 records to 50981 (keeping 200 days of data) [2025-09-30T18:02:07.463183] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-30T18:02:07.508250] [DEBUG] [LOCAL ] CNM: Primary data saved (50981 records). [2025-09-30T18:02:07.508411] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-30T18:02:07.508530] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNM took 31.2s. Estimated remaining: 3h 55m 49s. Rate: 8.0 symbols/min [2025-09-30T18:02:07.705286] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:07.763803] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-30T18:02:07.764156] [INFO ] [MAIN ] CNP: Loaded 53469 existing records. [2025-09-30T18:02:07.964854] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:02:07.965122] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-30T18:02:07.965186] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-30T18:02:07.965607] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-30T18:02:07.965726] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-30T18:02:08.258192] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-30T18:02:08.395853] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:08.597579] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T18:02:08.651503] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T18:02:09.054536] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-30T18:02:09.703838] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T18:02:09.854318] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-30T18:02:10.249842] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T18:02:10.654376] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-30T18:02:11.341871] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T18:02:11.454390] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-30T18:02:12.142573] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T18:02:12.254372] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-30T18:02:13.054331] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-30T18:02:13.319711] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T18:02:13.429348] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:02:13.854379] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-30T18:02:14.654335] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-30T18:02:14.908384] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T18:02:15.454360] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-30T18:02:15.661871] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T18:02:16.254434] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-30T18:02:16.403581] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T18:02:17.044980] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:02:17.054819] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-30T18:02:17.570353] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T18:02:17.854386] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-30T18:02:18.660639] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-30T18:02:18.681397] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:02:19.115774] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T18:02:19.454361] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-30T18:02:20.254388] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-30T18:02:20.388046] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T18:02:21.054422] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-30T18:02:21.223867] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:02:21.288797] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T18:02:21.854412] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-30T18:02:22.295140] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T18:02:22.654382] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-30T18:02:23.454338] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-30T18:02:23.867103] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T18:02:24.198869] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T18:02:24.254334] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-30T18:02:24.476687] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T18:02:25.054446] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-30T18:02:25.691865] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T18:02:25.854414] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-30T18:02:26.115037] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T18:02:26.654413] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-30T18:02:27.454409] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-30T18:02:27.686713] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T18:02:28.027121] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T18:02:28.254376] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-30T18:02:28.861955] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T18:02:28.868660] [INFO ] [REMOTE ] CNMD: Full fetch complete (47242 records). [2025-09-30T18:02:28.868781] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-30T18:02:29.061144] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-30T18:02:29.283675] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-30T18:02:29.283997] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-30T18:02:29.284674] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-30T18:02:29.284738] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-30T18:02:29.288626] [DEBUG] [LOCAL ] CNMD: Trimmed 47242 records to 32253 (keeping 200 days of data) [2025-09-30T18:02:29.496293] [DEBUG] [LOCAL ] CNMD: Primary data saved (32253 records). [2025-09-30T18:02:29.496439] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-30T18:02:29.496519] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNMD took 28.8s. Estimated remaining: 3h 56m 37s. Rate: 7.9 symbols/min [2025-09-30T18:02:29.683688] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:29.683996] [DEBUG] [LOCAL ] CNQ: No existing data file found in primary storage. [2025-09-30T18:02:29.684107] [WARN ] [MAIN ] CNQ: No existing data found, performing full refresh instead. [2025-09-30T18:02:29.684292] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-30T18:02:29.684336] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-30T18:02:29.684383] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-09-30T18:02:29.684425] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-30T18:02:29.873077] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-30T18:02:30.103438] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:30.127601] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T18:02:30.654359] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-30T18:02:30.799907] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T18:02:31.454373] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-30T18:02:31.677933] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T18:02:32.146088] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T18:02:32.153724] [INFO ] [REMOTE ] CNNE: Full fetch complete (49390 records). [2025-09-30T18:02:32.153848] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-30T18:02:32.154440] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:02:32.154528] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:02:32.154571] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:02:32.154638] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-30T18:02:32.154768] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-09-30T18:02:32.154845] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-09-30T18:02:32.155281] [DEBUG] [LOCAL ] CNNE: Deleted derivative data file. [2025-09-30T18:02:32.155407] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNNE took 28.2s. Estimated remaining: 3h 56m 10s. Rate: 7.9 symbols/min [2025-09-30T18:02:32.259485] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-30T18:02:32.338796] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:32.338995] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-30T18:02:32.339034] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-30T18:02:32.339148] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-30T18:02:32.339188] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-30T18:02:32.339230] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-30T18:02:32.339262] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-30T18:02:32.741939] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:32.972394] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T18:02:33.054372] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-30T18:02:33.854358] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-30T18:02:34.057165] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:02:34.057498] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-30T18:02:34.057589] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:02:34.057665] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-09-30T18:02:34.057735] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:02:34.057815] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-30T18:02:34.057917] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-30T18:02:34.058006] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-30T18:02:34.058070] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-30T18:02:34.058124] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNR took 1.9s. Estimated remaining: 3h 55m 42s. Rate: 8.0 symbols/min [2025-09-30T18:02:34.285181] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:34.336770] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-30T18:02:34.381219] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T18:02:34.410128] [DEBUG] [LOCAL ] CNS: Loaded 20650 existing records from primary storage. [2025-09-30T18:02:34.410499] [INFO ] [MAIN ] CNS: Loaded 20650 existing records. [2025-09-30T18:02:34.647880] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:02:34.648103] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-30T18:02:34.648151] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-30T18:02:34.648507] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-30T18:02:34.648568] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-30T18:02:34.660180] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-30T18:02:35.080340] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:35.454402] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-30T18:02:36.254408] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-30T18:02:36.345381] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T18:02:36.652670] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T18:02:37.054408] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-30T18:02:37.854351] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-30T18:02:38.021246] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T18:02:38.192297] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T18:02:38.201440] [INFO ] [REMOTE ] CNO: Full fetch complete (60321 records). [2025-09-30T18:02:38.201571] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-30T18:02:38.202526] [FATAL] [VALIDATOR ] CNO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:02:38.202624] [FATAL] [MAIN ] CNO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:02:38.202710] [WARN ] [MAIN ] CNO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:02:38.202784] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-30T18:02:38.202853] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-09-30T18:02:38.202940] [INFO ] [LOCAL ] CNO: Starting deletion of derivative data. [2025-09-30T18:02:38.203218] [DEBUG] [LOCAL ] CNO: Deleted derivative data file. [2025-09-30T18:02:38.203794] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNO took 32.5s. Estimated remaining: 3h 55m 21s. Rate: 8.0 symbols/min [2025-09-30T18:02:38.396769] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:38.457043] [DEBUG] [LOCAL ] CNX: Loaded 51375 existing records from primary storage. [2025-09-30T18:02:38.457398] [INFO ] [MAIN ] CNX: Loaded 51375 existing records. [2025-09-30T18:02:38.654205] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:02:38.654354] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-30T18:02:38.655489] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-30T18:02:38.655560] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-30T18:02:38.656009] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-30T18:02:38.656071] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-30T18:02:39.097887] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T18:02:39.105920] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:39.454373] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-30T18:02:40.254386] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-30T18:02:40.433605] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T18:02:41.054373] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-30T18:02:41.211292] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T18:02:41.854399] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-30T18:02:42.015454] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T18:02:42.654401] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-30T18:02:43.036522] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:02:43.048995] [INFO ] [REMOTE ] CNP: Full fetch complete (77369 records). [2025-09-30T18:02:43.049176] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-30T18:02:43.455573] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-30T18:02:43.507873] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-30T18:02:43.508251] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-30T18:02:43.509558] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-30T18:02:43.509914] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-30T18:02:43.541625] [DEBUG] [LOCAL ] CNP: Trimmed 77369 records to 53469 (keeping 200 days of data) [2025-09-30T18:02:43.545827] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T18:02:43.673099] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T18:02:43.934243] [DEBUG] [LOCAL ] CNP: Primary data saved (53469 records). [2025-09-30T18:02:43.934399] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-30T18:02:43.934487] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNP took 36.4s. Estimated remaining: 3h 55m 7s. Rate: 8.0 symbols/min [2025-09-30T18:02:44.137367] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:02:44.186997] [DEBUG] [LOCAL ] CODI: Loaded 39820 existing records from primary storage. [2025-09-30T18:02:44.187358] [INFO ] [MAIN ] CODI: Loaded 39820 existing records. [2025-09-30T18:02:44.259441] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-30T18:02:44.411459] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:02:44.411743] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-30T18:02:44.411799] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-30T18:02:44.412205] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-30T18:02:44.412300] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-30T18:02:44.868720] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:02:45.054402] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-30T18:02:45.681434] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-30T18:02:45.854327] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-30T18:02:45.962417] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T18:02:46.158119] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T18:02:46.654394] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-30T18:02:47.454416] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-30T18:02:47.609758] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:02:48.254353] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-30T18:02:48.357158] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T18:02:48.426711] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T18:02:49.054418] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-30T18:02:49.302881] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T18:02:49.854369] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-30T18:02:50.616364] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T18:02:50.654390] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-30T18:02:50.871917] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T18:02:51.454356] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-30T18:02:52.254495] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-30T18:02:52.304581] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T18:02:52.816890] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T18:02:53.054408] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-30T18:02:53.348578] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T18:02:53.854369] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-30T18:02:54.113118] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T18:02:54.654364] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-30T18:02:54.916087] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T18:02:55.454358] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-30T18:02:56.254435] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-30T18:02:56.564089] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T18:02:56.598313] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T18:02:57.054314] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-30T18:02:57.147903] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T18:02:57.854320] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-30T18:02:58.091128] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T18:02:58.654354] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-30T18:02:59.183553] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T18:02:59.454399] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-30T18:03:00.254352] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-30T18:03:00.450087] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T18:03:01.054589] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-30T18:03:01.279370] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T18:03:01.284740] [INFO ] [REMOTE ] CNS: Full fetch complete (30134 records). [2025-09-30T18:03:01.284890] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-30T18:03:01.726774] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-30T18:03:01.726885] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-30T18:03:01.727613] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-30T18:03:01.727757] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-30T18:03:01.728769] [DEBUG] [LOCAL ] CNS: Trimmed 30134 records to 20624 (keeping 200 days of data) [2025-09-30T18:03:01.857687] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-30T18:03:01.862583] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T18:03:01.910375] [DEBUG] [LOCAL ] CNS: Primary data saved (20624 records). [2025-09-30T18:03:01.910521] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-30T18:03:01.910609] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNS took 27.9s. Estimated remaining: 3h 55m 38s. Rate: 7.9 symbols/min [2025-09-30T18:03:02.107443] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:02.171942] [DEBUG] [LOCAL ] COF: Loaded 53608 existing records from primary storage. [2025-09-30T18:03:02.172354] [INFO ] [MAIN ] COF: Loaded 53608 existing records. [2025-09-30T18:03:02.372160] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:02.372436] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-30T18:03:02.372496] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-30T18:03:02.372980] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-30T18:03:02.373042] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-30T18:03:02.654714] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-30T18:03:02.800412] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:02.861616] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T18:03:03.454357] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-30T18:03:03.946299] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T18:03:03.958707] [INFO ] [REMOTE ] CNQ: Full fetch complete (77553 records). [2025-09-30T18:03:03.958884] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-30T18:03:04.259494] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-30T18:03:04.450432] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-30T18:03:04.450809] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-30T18:03:04.451750] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-30T18:03:04.451930] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-30T18:03:04.468817] [DEBUG] [LOCAL ] CNQ: Trimmed 77553 records to 53581 (keeping 200 days of data) [2025-09-30T18:03:04.483535] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T18:03:04.844054] [DEBUG] [LOCAL ] CNQ: Primary data saved (53581 records). [2025-09-30T18:03:04.844236] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-30T18:03:04.844314] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNQ took 35.3s. Estimated remaining: 3h 55m 14s. Rate: 7.9 symbols/min [2025-09-30T18:03:05.036582] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:05.067270] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-30T18:03:05.090266] [DEBUG] [LOCAL ] COHR: Loaded 53363 existing records from primary storage. [2025-09-30T18:03:05.090637] [INFO ] [MAIN ] COHR: Loaded 53363 existing records. [2025-09-30T18:03:05.285783] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:05.286071] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-30T18:03:05.286224] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-30T18:03:05.286593] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-30T18:03:05.286703] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-30T18:03:05.586928] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-30T18:03:05.735695] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:05.854336] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-30T18:03:05.957222] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:03:06.654355] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-30T18:03:06.763484] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-30T18:03:07.454419] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-30T18:03:07.935532] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-30T18:03:08.254376] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-30T18:03:08.424130] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T18:03:08.657924] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T18:03:09.054373] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-30T18:03:09.870032] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-30T18:03:09.895205] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T18:03:10.654374] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-30T18:03:11.079690] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-30T18:03:11.338413] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T18:03:11.346444] [INFO ] [REMOTE ] CODI: Full fetch complete (50821 records). [2025-09-30T18:03:11.346582] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-30T18:03:11.459578] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-30T18:03:11.763797] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-30T18:03:11.763875] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-30T18:03:11.764479] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-30T18:03:11.764521] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-30T18:03:11.765567] [DEBUG] [LOCAL ] CODI: Trimmed 50821 records to 39921 (keeping 200 days of data) [2025-09-30T18:03:12.001777] [DEBUG] [LOCAL ] CODI: Primary data saved (39921 records). [2025-09-30T18:03:12.002024] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-30T18:03:12.002126] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CODI took 28.1s. Estimated remaining: 3h 55m 5s. Rate: 8.0 symbols/min [2025-09-30T18:03:12.191796] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:12.247518] [DEBUG] [LOCAL ] COLD: Loaded 52032 existing records from primary storage. [2025-09-30T18:03:12.247991] [INFO ] [MAIN ] COLD: Loaded 52032 existing records. [2025-09-30T18:03:12.259832] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-30T18:03:12.445169] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:12.445729] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-30T18:03:12.445866] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-30T18:03:12.446337] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-30T18:03:12.446402] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-30T18:03:12.674204] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-30T18:03:12.881545] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:13.054404] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-30T18:03:13.429884] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T18:03:13.854465] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-30T18:03:14.163550] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-30T18:03:14.654434] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-30T18:03:15.176600] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-30T18:03:15.416127] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T18:03:15.454397] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-30T18:03:16.254424] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-30T18:03:16.502395] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T18:03:16.513156] [INFO ] [REMOTE ] CNX: Full fetch complete (74392 records). [2025-09-30T18:03:16.513344] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-30T18:03:16.514286] [FATAL] [VALIDATOR ] CNX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:03:16.514399] [FATAL] [MAIN ] CNX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:03:16.514443] [WARN ] [MAIN ] CNX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:03:16.514486] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-30T18:03:16.514561] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-09-30T18:03:16.514628] [INFO ] [LOCAL ] CNX: Starting deletion of derivative data. [2025-09-30T18:03:16.515001] [DEBUG] [LOCAL ] CNX: Deleted derivative data file. [2025-09-30T18:03:16.515332] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CNX took 38.3s. Estimated remaining: 3h 54m 46s. Rate: 8.0 symbols/min [2025-09-30T18:03:16.701114] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:16.701288] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-09-30T18:03:16.701325] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-09-30T18:03:16.701441] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-30T18:03:16.701481] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-30T18:03:16.701521] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-09-30T18:03:16.701552] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-30T18:03:17.066987] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-30T18:03:17.104368] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:17.134248] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T18:03:17.854357] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-30T18:03:18.356553] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-30T18:03:18.654339] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-30T18:03:18.975359] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T18:03:19.097399] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T18:03:19.454426] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-30T18:03:20.254357] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-30T18:03:20.593263] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T18:03:21.054394] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-30T18:03:21.371978] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T18:03:21.742464] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T18:03:21.854378] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-30T18:03:22.654345] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-30T18:03:22.948058] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T18:03:23.454415] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-30T18:03:23.726844] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T18:03:24.254341] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-30T18:03:24.384637] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T18:03:25.054326] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-30T18:03:25.626440] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-30T18:03:25.826533] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T18:03:25.854319] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-30T18:03:26.654406] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-30T18:03:26.776841] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T18:03:27.454364] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-30T18:03:27.745097] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T18:03:28.254332] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-30T18:03:28.452282] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T18:03:29.054391] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-30T18:03:29.290661] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T18:03:29.854396] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-30T18:03:30.020990] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T18:03:30.654400] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-30T18:03:31.087921] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T18:03:31.099172] [INFO ] [REMOTE ] COF: Full fetch complete (77019 records). [2025-09-30T18:03:31.099341] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-30T18:03:31.100287] [FATAL] [VALIDATOR ] COF: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:03:31.100386] [FATAL] [MAIN ] COF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:03:31.100429] [WARN ] [MAIN ] COF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:03:31.100496] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-30T18:03:31.100595] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-09-30T18:03:31.100674] [INFO ] [LOCAL ] COF: Starting deletion of derivative data. [2025-09-30T18:03:31.100863] [DEBUG] [LOCAL ] COF: Deleted derivative data file. [2025-09-30T18:03:31.100959] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COF took 29.2s. Estimated remaining: 3h 55m 4s. Rate: 7.9 symbols/min [2025-09-30T18:03:31.293774] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:31.334702] [DEBUG] [LOCAL ] CON: Loaded 38727 existing records from primary storage. [2025-09-30T18:03:31.335037] [INFO ] [MAIN ] CON: Loaded 38727 existing records. [2025-09-30T18:03:31.456156] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-30T18:03:31.535790] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:31.536769] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-30T18:03:31.536981] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-30T18:03:31.537373] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-30T18:03:31.537443] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-30T18:03:31.926696] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-30T18:03:32.023257] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:32.254368] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-30T18:03:32.434096] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T18:03:33.054392] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-30T18:03:33.648273] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-30T18:03:33.854432] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-30T18:03:34.283298] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-30T18:03:34.654442] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-30T18:03:34.812114] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:03:35.454394] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-30T18:03:36.151605] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-30T18:03:36.254355] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-30T18:03:36.392191] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T18:03:37.054377] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-30T18:03:37.221897] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T18:03:37.802850] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:03:37.854319] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-30T18:03:38.654326] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-30T18:03:38.822401] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T18:03:39.410962] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T18:03:39.454336] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-30T18:03:40.254364] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-30T18:03:40.347815] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T18:03:40.863553] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T18:03:41.054368] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-30T18:03:41.854372] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-30T18:03:42.654371] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-30T18:03:42.742917] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-30T18:03:42.755220] [INFO ] [REMOTE ] COHR: Full fetch complete (77111 records). [2025-09-30T18:03:42.755399] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-30T18:03:43.096252] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T18:03:43.241893] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-30T18:03:43.241995] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-30T18:03:43.242898] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-30T18:03:43.242977] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-30T18:03:43.244519] [DEBUG] [LOCAL ] COHR: Trimmed 77111 records to 53362 (keeping 200 days of data) [2025-09-30T18:03:43.468271] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-30T18:03:43.594331] [DEBUG] [LOCAL ] COHR: Primary data saved (53362 records). [2025-09-30T18:03:43.595062] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-30T18:03:43.595398] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COHR took 38.8s. Estimated remaining: 3h 55m 15s. Rate: 7.9 symbols/min [2025-09-30T18:03:43.801381] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:43.839413] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T18:03:43.877155] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T18:03:43.904949] [DEBUG] [LOCAL ] COOK: Loaded 24365 existing records from primary storage. [2025-09-30T18:03:43.905262] [INFO ] [MAIN ] COOK: Loaded 24365 existing records. [2025-09-30T18:03:44.123273] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:44.123551] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-30T18:03:44.123607] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-30T18:03:44.124205] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-30T18:03:44.124290] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-30T18:03:44.259568] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-30T18:03:44.543243] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:45.054333] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-30T18:03:45.315775] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T18:03:45.328894] [INFO ] [REMOTE ] COMP: Full fetch complete (76737 records). [2025-09-30T18:03:45.329073] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-30T18:03:45.333520] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:03:45.333627] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:03:45.333714] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:03:45.333791] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-30T18:03:45.333886] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-09-30T18:03:45.333955] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-09-30T18:03:45.334027] [DEBUG] [LOCAL ] COMP: No derivative data file found to delete. [2025-09-30T18:03:45.334114] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COMP took 28.8s. Estimated remaining: 3h 54m 46s. Rate: 7.9 symbols/min [2025-09-30T18:03:45.529549] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:45.602466] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-30T18:03:45.602828] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-09-30T18:03:45.781248] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:03:45.827669] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:45.827843] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-30T18:03:45.827892] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-30T18:03:45.828579] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-30T18:03:45.828640] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-30T18:03:45.861490] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-30T18:03:46.222208] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:46.356815] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T18:03:46.654362] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-30T18:03:47.454391] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-30T18:03:47.677312] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T18:03:47.777451] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-30T18:03:47.793537] [INFO ] [REMOTE ] COLD: Full fetch complete (74208 records). [2025-09-30T18:03:47.793816] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-30T18:03:48.226743] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-30T18:03:48.226879] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-30T18:03:48.227756] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-30T18:03:48.227833] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-30T18:03:48.229531] [DEBUG] [LOCAL ] COLD: Trimmed 74208 records to 52066 (keeping 200 days of data) [2025-09-30T18:03:48.292826] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-30T18:03:48.567009] [DEBUG] [LOCAL ] COLD: Primary data saved (52066 records). [2025-09-30T18:03:48.567152] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-30T18:03:48.567258] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COLD took 36.6s. Estimated remaining: 3h 54m 23s. Rate: 8.0 symbols/min [2025-09-30T18:03:48.776664] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:48.847510] [DEBUG] [LOCAL ] COR: Loaded 47081 existing records from primary storage. [2025-09-30T18:03:48.847983] [INFO ] [MAIN ] COR: Loaded 47081 existing records. [2025-09-30T18:03:49.060574] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-30T18:03:49.087111] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:49.087610] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-30T18:03:49.087732] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-30T18:03:49.088285] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-30T18:03:49.088348] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-30T18:03:49.468517] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:49.585217] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-30T18:03:49.754595] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T18:03:49.813510] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T18:03:49.854357] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-30T18:03:50.654366] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-30T18:03:51.396897] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T18:03:51.454393] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-30T18:03:51.727450] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T18:03:52.254363] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-30T18:03:52.758261] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T18:03:53.054369] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-30T18:03:53.393308] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T18:03:53.854373] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-30T18:03:54.654369] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-30T18:03:55.035207] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:03:55.044890] [INFO ] [REMOTE ] CON: Full fetch complete (56908 records). [2025-09-30T18:03:55.045045] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-30T18:03:55.451220] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-30T18:03:55.451315] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-30T18:03:55.452071] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-30T18:03:55.452149] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-30T18:03:55.453840] [DEBUG] [LOCAL ] CON: Trimmed 56908 records to 38743 (keeping 200 days of data) [2025-09-30T18:03:55.454365] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-30T18:03:55.708090] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T18:03:55.753484] [DEBUG] [LOCAL ] CON: Primary data saved (38743 records). [2025-09-30T18:03:55.753681] [INFO ] [MAIN ] CON: Full history saved. [2025-09-30T18:03:55.753820] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. CON took 24.7s. Estimated remaining: 3h 54m 14s. Rate: 8.0 symbols/min [2025-09-30T18:03:55.936200] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:03:56.027680] [DEBUG] [LOCAL ] COTY: Loaded 53223 existing records from primary storage. [2025-09-30T18:03:56.037291] [INFO ] [MAIN ] COTY: Loaded 53223 existing records. [2025-09-30T18:03:56.043942] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T18:03:56.249597] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:03:56.249902] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-30T18:03:56.249951] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-30T18:03:56.250538] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-30T18:03:56.250600] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-30T18:03:56.262483] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-30T18:03:56.645527] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T18:03:56.691630] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:03:57.054383] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-30T18:03:57.854332] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-30T18:03:58.117407] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T18:03:58.654390] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-30T18:03:58.972176] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T18:03:59.032362] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T18:03:59.454369] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-30T18:04:00.263670] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-30T18:04:00.282330] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:04:01.054359] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-30T18:04:01.582848] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-30T18:04:01.854369] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-30T18:04:02.021566] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T18:04:02.659997] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-30T18:04:02.662587] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T18:04:02.782821] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T18:04:03.454361] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-30T18:04:04.254342] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-30T18:04:04.338866] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T18:04:05.054362] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-30T18:04:05.122020] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T18:04:05.377434] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T18:04:05.854362] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-30T18:04:06.545756] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T18:04:06.654387] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-30T18:04:07.253549] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T18:04:07.259591] [INFO ] [REMOTE ] COOK: Full fetch complete (32718 records). [2025-09-30T18:04:07.259745] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-30T18:04:07.460973] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-30T18:04:07.703478] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-30T18:04:07.703624] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-30T18:04:07.704174] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-30T18:04:07.704221] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-30T18:04:07.705238] [DEBUG] [LOCAL ] COOK: Trimmed 32718 records to 24364 (keeping 200 days of data) [2025-09-30T18:04:07.847074] [DEBUG] [LOCAL ] COOK: Primary data saved (24364 records). [2025-09-30T18:04:07.847220] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-30T18:04:07.847303] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COOK took 24.3s. Estimated remaining: 3h 54m 23s. Rate: 7.9 symbols/min [2025-09-30T18:04:08.026795] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:08.027073] [DEBUG] [LOCAL ] COUR: No existing data file found in primary storage. [2025-09-30T18:04:08.027128] [WARN ] [MAIN ] COUR: No existing data found, performing full refresh instead. [2025-09-30T18:04:08.027205] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-30T18:04:08.027242] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-30T18:04:08.027284] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-09-30T18:04:08.027318] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-30T18:04:08.265096] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-30T18:04:08.430996] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:08.464660] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T18:04:09.054339] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-30T18:04:09.293423] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T18:04:09.854372] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-30T18:04:10.425971] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-30T18:04:10.654378] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-30T18:04:10.876944] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T18:04:11.412035] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T18:04:11.454407] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-30T18:04:12.254413] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-30T18:04:12.772771] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-30T18:04:12.850873] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T18:04:13.054377] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-30T18:04:13.854367] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-30T18:04:13.985928] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T18:04:14.654392] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-30T18:04:14.783457] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T18:04:15.425317] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T18:04:15.454310] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-30T18:04:16.254388] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-30T18:04:16.538009] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T18:04:17.054370] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-30T18:04:17.226259] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T18:04:17.854333] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-30T18:04:17.921013] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T18:04:18.531532] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T18:04:18.654389] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-30T18:04:19.454383] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-30T18:04:19.712578] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T18:04:20.254333] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-30T18:04:20.734739] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-30T18:04:21.054367] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-30T18:04:21.370748] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-30T18:04:21.380967] [INFO ] [REMOTE ] COR: Full fetch complete (68861 records). [2025-09-30T18:04:21.381130] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-30T18:04:21.819878] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-30T18:04:21.820034] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-30T18:04:21.821046] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-30T18:04:21.821114] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-30T18:04:21.822745] [DEBUG] [LOCAL ] COR: Trimmed 68861 records to 47089 (keeping 200 days of data) [2025-09-30T18:04:21.885730] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-30T18:04:22.136811] [DEBUG] [LOCAL ] COR: Primary data saved (47089 records). [2025-09-30T18:04:22.136945] [INFO ] [MAIN ] COR: Full history saved. [2025-09-30T18:04:22.137046] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COR took 33.6s. Estimated remaining: 3h 54m 40s. Rate: 7.9 symbols/min [2025-09-30T18:04:22.370781] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-30T18:04:22.391881] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:22.443541] [DEBUG] [LOCAL ] CP: Loaded 53268 existing records from primary storage. [2025-09-30T18:04:22.443899] [INFO ] [MAIN ] CP: Loaded 53268 existing records. [2025-09-30T18:04:22.635711] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:04:22.635924] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-30T18:04:22.635971] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-30T18:04:22.636265] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-30T18:04:22.636323] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-30T18:04:22.659614] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-30T18:04:23.012186] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:23.052358] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T18:04:23.454336] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-30T18:04:23.489681] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T18:04:24.254373] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-30T18:04:24.545131] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T18:04:24.556343] [INFO ] [REMOTE ] COTY: Full fetch complete (76682 records). [2025-09-30T18:04:24.556526] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-30T18:04:24.557530] [FATAL] [VALIDATOR ] COTY: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:04:24.557636] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:04:24.557730] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:04:24.557808] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-30T18:04:24.557877] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-09-30T18:04:24.557915] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-09-30T18:04:24.558261] [DEBUG] [LOCAL ] COTY: Deleted derivative data file. [2025-09-30T18:04:24.558380] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COTY took 28.8s. Estimated remaining: 3h 54m 14s. Rate: 7.9 symbols/min [2025-09-30T18:04:24.761193] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:24.761391] [DEBUG] [LOCAL ] CPA: No existing data file found in primary storage. [2025-09-30T18:04:24.761508] [WARN ] [MAIN ] CPA: No existing data found, performing full refresh instead. [2025-09-30T18:04:24.761595] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-30T18:04:24.761634] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-30T18:04:24.761719] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-09-30T18:04:24.761759] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-30T18:04:25.063072] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-30T18:04:25.230632] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:25.796426] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-30T18:04:25.810444] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-09-30T18:04:25.810696] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-30T18:04:25.861932] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-30T18:04:26.299034] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-30T18:04:26.299187] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-30T18:04:26.300131] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-30T18:04:26.300856] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-30T18:04:26.302122] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T18:04:26.314334] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 53727 (keeping 200 days of data) [2025-09-30T18:04:26.654552] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-30T18:04:26.667111] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-09-30T18:04:26.667259] [INFO ] [MAIN ] COP: Full history saved. [2025-09-30T18:04:26.668062] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COP took 41.3s. Estimated remaining: 3h 53m 46s. Rate: 8.0 symbols/min [2025-09-30T18:04:26.859010] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:26.859259] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-30T18:04:26.859328] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-30T18:04:26.859519] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-30T18:04:26.859563] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-30T18:04:26.859607] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-30T18:04:26.859674] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-30T18:04:27.437251] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-30T18:04:27.448148] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:27.462376] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-30T18:04:27.506140] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:04:27.850022] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T18:04:27.930941] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-30T18:04:28.254383] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-30T18:04:29.054371] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-30T18:04:29.854332] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-30T18:04:29.954790] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T18:04:30.240813] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T18:04:30.394840] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T18:04:30.654396] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-30T18:04:31.009173] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-30T18:04:31.454332] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-30T18:04:32.254403] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-30T18:04:32.595938] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T18:04:32.706219] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T18:04:33.054401] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-30T18:04:33.526792] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-30T18:04:33.854379] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-30T18:04:34.654362] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-30T18:04:35.454334] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-30T18:04:35.492477] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T18:04:36.254332] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-30T18:04:36.298419] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T18:04:36.602842] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-30T18:04:36.821157] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T18:04:37.054402] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-30T18:04:37.337698] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-30T18:04:37.854371] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-30T18:04:38.456080] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T18:04:38.654419] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-30T18:04:39.454372] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-30T18:04:40.254331] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-30T18:04:40.629506] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T18:04:40.664866] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T18:04:40.674861] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-30T18:04:41.054422] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-30T18:04:41.854381] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-30T18:04:42.572590] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-30T18:04:42.573632] [INFO ] [REMOTE ] CPAC: Full fetch complete (1891 records). [2025-09-30T18:04:42.573732] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-30T18:04:42.656001] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-30T18:04:42.788573] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T18:04:42.789026] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:04:42.789245] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:04:42.789325] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-30T18:04:42.789403] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-30T18:04:42.789445] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-30T18:04:42.789485] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-30T18:04:42.789560] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. CPAC took 16.1s. Estimated remaining: 3h 54m 10s. Rate: 7.9 symbols/min [2025-09-30T18:04:42.981286] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:43.017217] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T18:04:43.064419] [DEBUG] [LOCAL ] CPAY: Loaded 30608 existing records from primary storage. [2025-09-30T18:04:43.064775] [INFO ] [MAIN ] CPAY: Loaded 30608 existing records. [2025-09-30T18:04:43.260333] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:04:43.260571] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-30T18:04:43.260621] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-30T18:04:43.261005] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-30T18:04:43.261064] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-30T18:04:43.462026] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-30T18:04:43.649791] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:44.096988] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T18:04:44.254363] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-30T18:04:45.054338] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-30T18:04:45.369245] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T18:04:45.421039] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T18:04:45.854363] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-30T18:04:46.654360] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-30T18:04:47.120459] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-30T18:04:47.454359] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-30T18:04:47.547899] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T18:04:47.958848] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T18:04:48.254406] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-30T18:04:48.575619] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T18:04:49.054375] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-30T18:04:49.785835] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:04:49.854392] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-30T18:04:50.109302] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T18:04:50.654366] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-30T18:04:51.294501] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T18:04:51.454395] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-30T18:04:51.915539] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-30T18:04:52.254375] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-30T18:04:52.798550] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T18:04:52.804969] [INFO ] [REMOTE ] CPA: Full fetch complete (41859 records). [2025-09-30T18:04:52.805189] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-30T18:04:53.061889] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-30T18:04:53.214709] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-30T18:04:53.214805] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-30T18:04:53.215462] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-30T18:04:53.215525] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-30T18:04:53.216726] [DEBUG] [LOCAL ] CPA: Trimmed 41859 records to 28403 (keeping 200 days of data) [2025-09-30T18:04:53.412778] [DEBUG] [LOCAL ] CPA: Primary data saved (28403 records). [2025-09-30T18:04:53.412938] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-30T18:04:53.413025] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. CPA took 28.9s. Estimated remaining: 3h 54m 13s. Rate: 7.9 symbols/min [2025-09-30T18:04:53.603488] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:53.621873] [DEBUG] [LOCAL ] CPF: Loaded 15248 existing records from primary storage. [2025-09-30T18:04:53.622145] [INFO ] [MAIN ] CPF: Loaded 15248 existing records. [2025-09-30T18:04:53.828600] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:04:53.828968] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-30T18:04:53.829045] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-30T18:04:53.829374] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-30T18:04:53.829436] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-30T18:04:53.861621] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-30T18:04:54.235130] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:54.268540] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-30T18:04:54.281280] [INFO ] [REMOTE ] COUR: Full fetch complete (70876 records). [2025-09-30T18:04:54.281478] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-30T18:04:54.670717] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-30T18:04:54.728482] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-30T18:04:54.729594] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-30T18:04:54.731197] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-30T18:04:54.742977] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-30T18:04:54.766903] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T18:04:54.778167] [DEBUG] [LOCAL ] COUR: Trimmed 70876 records to 48912 (keeping 200 days of data) [2025-09-30T18:04:55.078016] [DEBUG] [LOCAL ] COUR: Primary data saved (48912 records). [2025-09-30T18:04:55.078167] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-30T18:04:55.078297] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. COUR took 47.2s. Estimated remaining: 3h 53m 44s. Rate: 7.9 symbols/min [2025-09-30T18:04:55.265003] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:55.282767] [DEBUG] [LOCAL ] CPK: Loaded 13437 existing records from primary storage. [2025-09-30T18:04:55.283019] [INFO ] [MAIN ] CPK: Loaded 13437 existing records. [2025-09-30T18:04:55.458523] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-30T18:04:55.484855] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:04:55.485075] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-30T18:04:55.485142] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-30T18:04:55.485388] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-30T18:04:55.485455] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-30T18:04:55.895493] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:04:55.893704] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:56.033778] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-30T18:04:56.254359] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-30T18:04:57.054350] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-30T18:04:57.442931] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:04:57.455543] [INFO ] [REMOTE ] CP: Full fetch complete (77128 records). [2025-09-30T18:04:57.468930] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-30T18:04:57.470326] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T18:04:57.859502] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-30T18:04:58.016804] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-30T18:04:58.016926] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-30T18:04:58.017859] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-30T18:04:58.017928] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-30T18:04:58.019541] [DEBUG] [LOCAL ] CP: Trimmed 77128 records to 53267 (keeping 200 days of data) [2025-09-30T18:04:58.365967] [DEBUG] [LOCAL ] CP: Primary data saved (53267 records). [2025-09-30T18:04:58.366111] [INFO ] [MAIN ] CP: Full history saved. [2025-09-30T18:04:58.366195] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CP took 36.2s. Estimated remaining: 3h 53m 22s. Rate: 7.9 symbols/min [2025-09-30T18:04:58.552351] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:04:58.582323] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T18:04:58.634526] [DEBUG] [LOCAL ] CPNG: Loaded 53670 existing records from primary storage. [2025-09-30T18:04:58.634895] [INFO ] [MAIN ] CPNG: Loaded 53670 existing records. [2025-09-30T18:04:58.659557] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-30T18:04:58.828565] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:04:58.828791] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-30T18:04:58.828862] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-30T18:04:58.829326] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-30T18:04:58.829393] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-30T18:04:58.992007] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T18:04:59.222455] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:04:59.454341] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-30T18:04:59.675696] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T18:05:00.254366] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-30T18:05:01.054361] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-30T18:05:01.261383] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T18:05:01.675573] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-30T18:05:01.854378] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-30T18:05:02.434010] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T18:05:02.654397] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-30T18:05:03.454362] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-30T18:05:03.951077] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T18:05:04.052990] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-30T18:05:04.239109] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T18:05:04.254300] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-30T18:05:05.054334] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-30T18:05:05.092821] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T18:05:05.854318] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-30T18:05:05.932301] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-30T18:05:06.654371] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-30T18:05:07.454356] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-30T18:05:07.584181] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T18:05:07.767484] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-30T18:05:08.034590] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T18:05:08.254405] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-30T18:05:09.054389] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-30T18:05:09.423870] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T18:05:09.854334] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-30T18:05:10.019628] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T18:05:10.654346] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-30T18:05:10.836519] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T18:05:11.454403] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-30T18:05:12.254382] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-30T18:05:12.293669] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T18:05:12.818337] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T18:05:12.924744] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-30T18:05:13.054363] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-30T18:05:13.854361] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-30T18:05:14.102580] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T18:05:14.654411] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-30T18:05:14.942159] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T18:05:15.454369] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-30T18:05:15.565462] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T18:05:16.254406] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-30T18:05:17.047991] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T18:05:17.051604] [INFO ] [REMOTE ] CPF: Full fetch complete (24056 records). [2025-09-30T18:05:17.051721] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-30T18:05:17.052805] [FATAL] [VALIDATOR ] CPF: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:05:17.052948] [FATAL] [MAIN ] CPF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:05:17.053015] [WARN ] [MAIN ] CPF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:05:17.053099] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-30T18:05:17.053204] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-09-30T18:05:17.053306] [INFO ] [LOCAL ] CPF: Starting deletion of derivative data. [2025-09-30T18:05:17.053855] [DEBUG] [LOCAL ] CPF: Deleted derivative data file. [2025-09-30T18:05:17.053998] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPF took 23.6s. Estimated remaining: 3h 53m 54s. Rate: 7.9 symbols/min [2025-09-30T18:05:17.054311] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-30T18:05:17.864190] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-30T18:05:17.887848] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-30T18:05:18.128251] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-30T18:05:18.654366] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-30T18:05:18.781428] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T18:05:19.454438] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-30T18:05:20.254361] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-30T18:05:20.508458] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T18:05:20.512455] [INFO ] [REMOTE ] CPK: Full fetch complete (17799 records). [2025-09-30T18:05:20.512635] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-30T18:05:20.962995] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-30T18:05:20.963169] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-30T18:05:20.963736] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-30T18:05:20.963820] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-30T18:05:20.964954] [DEBUG] [LOCAL ] CPK: Trimmed 17799 records to 13455 (keeping 200 days of data) [2025-09-30T18:05:21.063169] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-30T18:05:21.076886] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-30T18:05:21.104554] [DEBUG] [LOCAL ] CPK: Primary data saved (13455 records). [2025-09-30T18:05:21.104737] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-30T18:05:21.104836] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPK took 26.0s. Estimated remaining: 3h 53m 34s. Rate: 7.9 symbols/min [2025-09-30T18:05:21.571473] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T18:05:21.854403] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-30T18:05:23.197453] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-30T18:05:23.230795] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-30T18:05:23.233744] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T18:05:23.243142] [INFO ] [REMOTE ] CPAY: Full fetch complete (45007 records). [2025-09-30T18:05:23.243286] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-30T18:05:23.642086] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-30T18:05:23.642170] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-30T18:05:23.642791] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-30T18:05:23.642860] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-30T18:05:23.643917] [DEBUG] [LOCAL ] CPAY: Trimmed 45007 records to 30567 (keeping 200 days of data) [2025-09-30T18:05:23.835268] [DEBUG] [LOCAL ] CPAY: Primary data saved (30567 records). [2025-09-30T18:05:23.835417] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-30T18:05:23.836558] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPAY took 41.0s. Estimated remaining: 3h 53m 9s. Rate: 7.9 symbols/min [2025-09-30T18:05:25.350932] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-30T18:05:25.363520] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-30T18:05:27.587683] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-30T18:05:27.599785] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-30T18:05:29.959277] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-30T18:05:29.970504] [INFO ] [REMOTE ] CPNG: Full fetch complete (77280 records). [2025-09-30T18:05:29.970693] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-30T18:05:29.971540] [FATAL] [VALIDATOR ] CPNG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:05:29.971638] [FATAL] [MAIN ] CPNG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:05:29.971721] [WARN ] [MAIN ] CPNG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:05:29.971783] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-30T18:05:29.971879] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-09-30T18:05:29.971947] [INFO ] [LOCAL ] CPNG: Starting deletion of derivative data. [2025-09-30T18:05:29.972272] [DEBUG] [LOCAL ] CPNG: Deleted derivative data file. [2025-09-30T18:05:29.972371] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPNG took 31.6s. Estimated remaining: 3h 52m 56s. Rate: 7.9 symbols/min [2025-09-30T18:05:30.740323] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:30.781851] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:30.790379] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:30.789326] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:30.790525] [DEBUG] [LOCAL ] CPRI: No existing data file found in primary storage. [2025-09-30T18:05:30.791604] [DEBUG] [LOCAL ] CPS: No existing data file found in primary storage. [2025-09-30T18:05:30.792165] [WARN ] [MAIN ] CPS: No existing data found, performing full refresh instead. [2025-09-30T18:05:30.792325] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-30T18:05:30.792403] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-30T18:05:30.792528] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-09-30T18:05:30.792607] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-30T18:05:30.791901] [WARN ] [MAIN ] CPRI: No existing data found, performing full refresh instead. [2025-09-30T18:05:30.810533] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-30T18:05:30.817268] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-30T18:05:30.833675] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-09-30T18:05:30.863672] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-30T18:05:31.025505] [DEBUG] [LOCAL ] CQP: Loaded 19676 existing records from primary storage. [2025-09-30T18:05:31.113680] [INFO ] [MAIN ] CQP: Loaded 19676 existing records. [2025-09-30T18:05:31.308350] [DEBUG] [LOCAL ] CPT: Loaded 44317 existing records from primary storage. [2025-09-30T18:05:31.418857] [INFO ] [MAIN ] CPT: Loaded 44317 existing records. [2025-09-30T18:05:31.908056] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:05:32.010697] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-30T18:05:32.075596] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:05:32.064706] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-30T18:05:32.069423] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:05:32.103947] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:05:32.099803] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-30T18:05:32.105255] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-30T18:05:32.104970] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-30T18:05:32.105186] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-30T18:05:32.106857] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-30T18:05:32.108132] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-30T18:05:32.108074] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-30T18:05:32.108264] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-30T18:05:32.914037] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:05:32.921116] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:05:32.921968] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-30T18:05:32.921624] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-30T18:05:33.138094] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T18:05:33.144797] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-30T18:05:33.763819] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T18:05:33.768563] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-30T18:05:33.904468] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T18:05:33.915490] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-30T18:05:34.230559] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T18:05:34.235596] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-30T18:05:34.378403] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T18:05:34.386758] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-30T18:05:34.647596] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T18:05:34.654071] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-30T18:05:35.135708] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T18:05:35.141246] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-30T18:05:35.506494] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T18:05:35.512246] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-30T18:05:35.693261] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T18:05:35.704595] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-30T18:05:36.147006] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T18:05:36.156374] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-30T18:05:36.471461] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T18:05:36.476630] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-30T18:05:36.509611] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T18:05:37.054439] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-30T18:05:37.393422] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T18:05:37.433105] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-30T18:05:37.474055] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T18:05:37.854468] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-30T18:05:38.056713] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T18:05:38.654427] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-30T18:05:39.407283] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T18:05:39.454382] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-30T18:05:39.753360] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T18:05:40.254340] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-30T18:05:41.054354] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-30T18:05:41.091269] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T18:05:41.710115] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T18:05:41.854392] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-30T18:05:42.654378] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-30T18:05:42.849449] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T18:05:42.900145] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T18:05:43.454418] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-30T18:05:44.178543] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:05:44.254484] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-30T18:05:44.258601] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T18:05:45.054370] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-30T18:05:45.854373] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-30T18:05:46.284271] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T18:05:46.654351] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-30T18:05:46.731841] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T18:05:46.830791] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T18:05:46.834300] [INFO ] [REMOTE ] CQP: Full fetch complete (30709 records). [2025-09-30T18:05:46.834475] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-30T18:05:47.264426] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-30T18:05:47.264540] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-30T18:05:47.265195] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-30T18:05:47.265296] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-30T18:05:47.266337] [DEBUG] [LOCAL ] CQP: Trimmed 30709 records to 19633 (keeping 200 days of data) [2025-09-30T18:05:47.409839] [DEBUG] [LOCAL ] CQP: Primary data saved (19633 records). [2025-09-30T18:05:47.410160] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-30T18:05:47.410638] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 17.4s. Estimated remaining: 3h 53m 24s. Rate: 7.9 symbols/min [2025-09-30T18:05:47.460466] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-30T18:05:47.642900] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:47.643115] [DEBUG] [LOCAL ] CR: No existing data file found in primary storage. [2025-09-30T18:05:47.643234] [WARN ] [MAIN ] CR: No existing data found, performing full refresh instead. [2025-09-30T18:05:47.643366] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-30T18:05:47.643405] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-30T18:05:47.643446] [DEBUG] [LOCAL ] CR: No primary data file found to delete. [2025-09-30T18:05:47.643496] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-30T18:05:48.060676] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:05:48.205002] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T18:05:48.254352] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-30T18:05:48.563401] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T18:05:49.054363] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-30T18:05:49.802342] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T18:05:49.845249] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-30T18:05:49.854305] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-30T18:05:50.654383] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-30T18:05:51.012889] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T18:05:51.454415] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-30T18:05:51.997967] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T18:05:52.254357] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-30T18:05:53.054335] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-30T18:05:53.089245] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T18:05:53.415243] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:05:53.854327] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-30T18:05:53.909388] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T18:05:54.654378] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-30T18:05:55.459453] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-30T18:05:55.474137] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T18:05:55.806442] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T18:05:56.254363] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-30T18:05:57.054391] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-30T18:05:57.333596] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T18:05:57.585894] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T18:05:57.591461] [INFO ] [REMOTE ] CPS: Full fetch complete (36216 records). [2025-09-30T18:05:57.591590] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-30T18:05:57.864690] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-30T18:05:58.009462] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-30T18:05:58.009555] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-30T18:05:58.010117] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-30T18:05:58.010181] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-30T18:05:58.011254] [DEBUG] [LOCAL ] CPS: Trimmed 36216 records to 25989 (keeping 200 days of data) [2025-09-30T18:05:58.171413] [DEBUG] [LOCAL ] CPS: Primary data saved (25989 records). [2025-09-30T18:05:58.171561] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-30T18:05:58.171680] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 28.2s. Estimated remaining: 3h 53m 28s. Rate: 7.9 symbols/min [2025-09-30T18:05:58.350330] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:58.362692] [DEBUG] [LOCAL ] CRBD: Loaded 9005 existing records from primary storage. [2025-09-30T18:05:58.362928] [INFO ] [MAIN ] CRBD: Loaded 9005 existing records. [2025-09-30T18:05:58.565496] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:05:58.565891] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-30T18:05:58.565963] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-30T18:05:58.566203] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-09-30T18:05:58.566262] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-30T18:05:58.661733] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-30T18:05:58.954628] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:05:58.987127] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T18:05:58.997595] [INFO ] [REMOTE ] CPT: Full fetch complete (63839 records). [2025-09-30T18:05:58.997789] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-30T18:05:59.374345] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T18:05:59.449773] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-30T18:05:59.449854] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-30T18:05:59.450577] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-30T18:05:59.450637] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-30T18:05:59.451977] [DEBUG] [LOCAL ] CPT: Trimmed 63839 records to 44325 (keeping 200 days of data) [2025-09-30T18:05:59.454326] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-30T18:05:59.751592] [DEBUG] [LOCAL ] CPT: Primary data saved (44325 records). [2025-09-30T18:05:59.751830] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-30T18:05:59.752001] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPT took 29.8s. Estimated remaining: 3h 52m 59s. Rate: 7.9 symbols/min [2025-09-30T18:05:59.933091] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:05:59.991201] [DEBUG] [LOCAL ] CRBG: Loaded 52335 existing records from primary storage. [2025-09-30T18:05:59.991604] [INFO ] [MAIN ] CRBG: Loaded 52335 existing records. [2025-09-30T18:06:00.196149] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:00.196372] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-30T18:06:00.196421] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-30T18:06:00.196872] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-30T18:06:00.196943] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-30T18:06:00.256414] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-30T18:06:00.621178] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:00.654914] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T18:06:00.666948] [INFO ] [REMOTE ] CPRI: Full fetch complete (76154 records). [2025-09-30T18:06:00.667112] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-30T18:06:01.044608] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T18:06:01.055117] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-30T18:06:01.161472] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-30T18:06:01.161584] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-30T18:06:01.162684] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-30T18:06:01.162868] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-30T18:06:01.165243] [DEBUG] [LOCAL ] CPRI: Trimmed 76154 records to 52547 (keeping 200 days of data) [2025-09-30T18:06:01.301423] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T18:06:01.521173] [DEBUG] [LOCAL ] CPRI: Primary data saved (52547 records). [2025-09-30T18:06:01.521471] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-30T18:06:01.521586] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPRI took 31.5s. Estimated remaining: 3h 52m 31s. Rate: 7.9 symbols/min [2025-09-30T18:06:01.730174] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:01.773801] [DEBUG] [LOCAL ] CRC: Loaded 44146 existing records from primary storage. [2025-09-30T18:06:01.774107] [INFO ] [MAIN ] CRC: Loaded 44146 existing records. [2025-09-30T18:06:01.859472] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-30T18:06:01.974391] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:01.974628] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-30T18:06:01.974717] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-30T18:06:01.975156] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-30T18:06:01.975227] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-30T18:06:02.352753] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:02.654333] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-30T18:06:02.751636] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T18:06:03.140922] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T18:06:03.407501] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T18:06:03.454369] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-30T18:06:04.182691] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T18:06:04.254339] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-30T18:06:04.979562] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T18:06:05.054395] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-30T18:06:05.825143] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T18:06:05.854337] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-30T18:06:06.585956] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T18:06:06.654391] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-30T18:06:07.251863] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T18:06:07.454356] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-30T18:06:08.254409] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-30T18:06:09.060072] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-30T18:06:09.083561] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T18:06:09.337196] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:06:09.854404] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-30T18:06:10.522803] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T18:06:10.654394] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-30T18:06:11.264853] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T18:06:11.454384] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-30T18:06:11.669269] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T18:06:12.254403] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-30T18:06:12.523722] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T18:06:13.054436] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-30T18:06:13.324850] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T18:06:13.854424] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-30T18:06:14.170853] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T18:06:14.654417] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-30T18:06:15.454365] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-30T18:06:15.529920] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T18:06:15.594806] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T18:06:16.254409] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-30T18:06:17.054329] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-30T18:06:17.137564] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T18:06:17.193202] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T18:06:17.854414] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-30T18:06:18.356383] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T18:06:18.362205] [INFO ] [REMOTE ] CR: Full fetch complete (34844 records). [2025-09-30T18:06:18.362354] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-30T18:06:18.475898] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T18:06:18.659554] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-30T18:06:18.791797] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-30T18:06:18.791914] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-30T18:06:18.792481] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-30T18:06:18.792607] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-30T18:06:18.793737] [DEBUG] [LOCAL ] CR: Trimmed 34844 records to 24400 (keeping 200 days of data) [2025-09-30T18:06:18.963312] [DEBUG] [LOCAL ] CR: Primary data saved (24400 records). [2025-09-30T18:06:18.963470] [INFO ] [MAIN ] CR: Full history saved. [2025-09-30T18:06:18.963587] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CR took 31.6s. Estimated remaining: 3h 52m 58s. Rate: 7.9 symbols/min [2025-09-30T18:06:19.156746] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:19.158108] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-30T18:06:19.158342] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-30T18:06:19.158496] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-30T18:06:19.158552] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-30T18:06:19.158598] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-30T18:06:19.158632] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-30T18:06:19.457235] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-30T18:06:19.543704] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:20.242915] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:06:20.254299] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-30T18:06:20.872755] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T18:06:21.054383] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-30T18:06:21.854343] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-30T18:06:22.011600] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:06:22.236537] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:06:22.236922] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-30T18:06:22.237036] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:06:22.237103] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-09-30T18:06:22.237168] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:06:22.237243] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-30T18:06:22.237313] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-30T18:06:22.237366] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-30T18:06:22.237437] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-30T18:06:22.237489] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CRCL took 3.3s. Estimated remaining: 3h 52m 35s. Rate: 7.9 symbols/min [2025-09-30T18:06:22.434442] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:22.494620] [DEBUG] [LOCAL ] CRGY: Loaded 52509 existing records from primary storage. [2025-09-30T18:06:22.495071] [INFO ] [MAIN ] CRGY: Loaded 52509 existing records. [2025-09-30T18:06:22.659533] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-30T18:06:22.709733] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:22.710049] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-30T18:06:22.710170] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-30T18:06:22.711139] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-30T18:06:22.711393] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-30T18:06:23.131697] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:23.149873] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-30T18:06:23.454328] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-30T18:06:23.567001] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T18:06:23.569309] [INFO ] [REMOTE ] CRBD: Full fetch complete (14917 records). [2025-09-30T18:06:23.569393] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-30T18:06:24.019261] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-09-30T18:06:24.019347] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-09-30T18:06:24.019785] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-09-30T18:06:24.019850] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-09-30T18:06:24.020519] [DEBUG] [LOCAL ] CRBD: Trimmed 14917 records to 8991 (keeping 200 days of data) [2025-09-30T18:06:24.083595] [DEBUG] [LOCAL ] CRBD: Primary data saved (8991 records). [2025-09-30T18:06:24.083757] [INFO ] [MAIN ] CRBD: Full history saved. [2025-09-30T18:06:24.083848] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRBD took 25.9s. Estimated remaining: 3h 52m 8s. Rate: 7.9 symbols/min [2025-09-30T18:06:24.259569] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-30T18:06:24.292063] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:24.367694] [DEBUG] [LOCAL ] CRH: Loaded 53463 existing records from primary storage. [2025-09-30T18:06:24.368122] [INFO ] [MAIN ] CRH: Loaded 53463 existing records. [2025-09-30T18:06:24.572494] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:24.572714] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-30T18:06:24.572771] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-30T18:06:24.573132] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-30T18:06:24.573192] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-30T18:06:25.003197] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:25.059455] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-30T18:06:25.075362] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T18:06:25.793288] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T18:06:25.854383] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-30T18:06:26.654374] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-30T18:06:26.956968] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T18:06:27.454372] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-30T18:06:27.752099] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T18:06:28.254372] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-30T18:06:28.411966] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T18:06:28.823807] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T18:06:29.054406] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-30T18:06:29.551305] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T18:06:29.854367] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-30T18:06:30.654383] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-30T18:06:31.014050] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T18:06:31.454387] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-30T18:06:31.737230] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T18:06:32.259462] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-30T18:06:32.280114] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:06:33.054342] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-30T18:06:33.112545] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T18:06:33.854408] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-30T18:06:34.088186] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T18:06:34.099681] [INFO ] [REMOTE ] CRBG: Full fetch complete (75686 records). [2025-09-30T18:06:34.099841] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-30T18:06:34.535421] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-30T18:06:34.535623] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-30T18:06:34.536583] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-30T18:06:34.536696] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-30T18:06:34.538891] [DEBUG] [LOCAL ] CRBG: Trimmed 75686 records to 52349 (keeping 200 days of data) [2025-09-30T18:06:34.660739] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-30T18:06:34.665158] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T18:06:34.926488] [DEBUG] [LOCAL ] CRBG: Primary data saved (52349 records). [2025-09-30T18:06:34.926685] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-30T18:06:34.927326] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRBG took 35.2s. Estimated remaining: 3h 52m 12s. Rate: 7.9 symbols/min [2025-09-30T18:06:35.110219] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:35.158955] [DEBUG] [LOCAL ] CRI: Loaded 49926 existing records from primary storage. [2025-09-30T18:06:35.159292] [INFO ] [MAIN ] CRI: Loaded 49926 existing records. [2025-09-30T18:06:35.359136] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:35.359384] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-30T18:06:35.359453] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-30T18:06:35.359902] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-30T18:06:35.359978] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-30T18:06:35.473093] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-30T18:06:35.807155] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:35.835907] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:06:35.845848] [INFO ] [REMOTE ] CRC: Full fetch complete (62367 records). [2025-09-30T18:06:35.845986] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-30T18:06:36.271112] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-30T18:06:36.275524] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-30T18:06:36.275608] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-30T18:06:36.276617] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-30T18:06:36.276962] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-30T18:06:36.310306] [DEBUG] [LOCAL ] CRC: Trimmed 62367 records to 44118 (keeping 200 days of data) [2025-09-30T18:06:36.312201] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T18:06:36.609410] [DEBUG] [LOCAL ] CRC: Primary data saved (44118 records). [2025-09-30T18:06:36.609561] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-30T18:06:36.609675] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRC took 35.1s. Estimated remaining: 3h 51m 44s. Rate: 7.9 symbols/min [2025-09-30T18:06:36.789694] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:36.840129] [DEBUG] [LOCAL ] CRK: Loaded 52121 existing records from primary storage. [2025-09-30T18:06:36.840488] [INFO ] [MAIN ] CRK: Loaded 52121 existing records. [2025-09-30T18:06:37.032422] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:37.032753] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-30T18:06:37.032814] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-30T18:06:37.033086] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-30T18:06:37.033143] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-30T18:06:37.064052] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-30T18:06:37.424192] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:37.464352] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T18:06:37.854336] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-30T18:06:37.990088] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T18:06:38.597770] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T18:06:38.654343] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-30T18:06:39.454355] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-30T18:06:39.940534] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-30T18:06:40.254376] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-30T18:06:40.308141] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T18:06:41.054382] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-30T18:06:41.121963] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:06:41.732232] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T18:06:41.854337] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-30T18:06:42.517309] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T18:06:42.654365] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-30T18:06:43.140945] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T18:06:43.454360] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-30T18:06:44.254349] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-30T18:06:44.447629] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T18:06:44.530397] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T18:06:45.054346] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-30T18:06:45.644735] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T18:06:45.854349] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-30T18:06:46.654331] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-30T18:06:46.985749] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T18:06:47.454328] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-30T18:06:47.503952] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T18:06:48.254354] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-30T18:06:48.671825] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T18:06:49.054333] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-30T18:06:49.201352] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T18:06:49.854350] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-30T18:06:49.983576] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T18:06:50.654331] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-30T18:06:50.741042] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T18:06:51.454393] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-30T18:06:51.616348] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T18:06:52.029088] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T18:06:52.254374] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-30T18:06:53.054337] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-30T18:06:53.466837] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-30T18:06:53.478270] [INFO ] [REMOTE ] CRH: Full fetch complete (77295 records). [2025-09-30T18:06:53.478436] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-30T18:06:53.860264] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-30T18:06:53.902420] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-30T18:06:53.902544] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-30T18:06:53.903564] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-30T18:06:53.903879] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-30T18:06:53.920841] [DEBUG] [LOCAL ] CRH: Trimmed 77295 records to 53463 (keeping 200 days of data) [2025-09-30T18:06:53.937711] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T18:06:54.300094] [DEBUG] [LOCAL ] CRH: Primary data saved (53463 records). [2025-09-30T18:06:54.300244] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-30T18:06:54.300328] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRH took 30.2s. Estimated remaining: 3h 52m 12s. Rate: 7.9 symbols/min [2025-09-30T18:06:54.487573] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:06:54.537624] [DEBUG] [LOCAL ] CRL: Loaded 43015 existing records from primary storage. [2025-09-30T18:06:54.538018] [INFO ] [MAIN ] CRL: Loaded 43015 existing records. [2025-09-30T18:06:54.662807] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-30T18:06:54.736135] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:06:54.736698] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-30T18:06:54.736867] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-30T18:06:54.737219] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-30T18:06:54.737327] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-30T18:06:54.976472] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T18:06:55.189365] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:06:55.454363] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-30T18:06:55.537068] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T18:06:55.962433] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T18:06:56.254374] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-30T18:06:56.978460] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T18:06:57.054385] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-30T18:06:57.854334] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-30T18:06:58.025466] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T18:06:58.592262] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T18:06:58.654379] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-30T18:06:58.993545] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T18:06:59.454342] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-30T18:07:00.254344] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-30T18:07:00.347691] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T18:07:01.054404] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-30T18:07:01.181530] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T18:07:01.854396] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-30T18:07:02.061508] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:07:02.072762] [INFO ] [REMOTE ] CRGY: Full fetch complete (75577 records). [2025-09-30T18:07:02.072939] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-30T18:07:02.073848] [FATAL] [VALIDATOR ] CRGY: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:07:02.073946] [FATAL] [MAIN ] CRGY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:07:02.073991] [WARN ] [MAIN ] CRGY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:07:02.074061] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-30T18:07:02.074128] [DEBUG] [LOCAL ] CRGY: No primary data file found to delete. [2025-09-30T18:07:02.074164] [INFO ] [LOCAL ] CRGY: Starting deletion of derivative data. [2025-09-30T18:07:02.074457] [DEBUG] [LOCAL ] CRGY: Deleted derivative data file. [2025-09-30T18:07:02.074558] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRGY took 39.8s. Estimated remaining: 3h 52m 5s. Rate: 7.9 symbols/min [2025-09-30T18:07:02.268600] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:02.268874] [DEBUG] [LOCAL ] CRM: No existing data file found in primary storage. [2025-09-30T18:07:02.268924] [WARN ] [MAIN ] CRM: No existing data found, performing full refresh instead. [2025-09-30T18:07:02.269045] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-30T18:07:02.269086] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-30T18:07:02.269126] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-09-30T18:07:02.269158] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-30T18:07:02.663310] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-30T18:07:02.685853] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:02.724487] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T18:07:03.454371] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-30T18:07:03.516575] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T18:07:04.254386] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-30T18:07:04.475011] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:07:04.485960] [INFO ] [REMOTE ] CRI: Full fetch complete (70969 records). [2025-09-30T18:07:04.486131] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-30T18:07:04.917858] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-30T18:07:04.917957] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-30T18:07:04.918898] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-30T18:07:04.918967] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-30T18:07:04.920572] [DEBUG] [LOCAL ] CRI: Trimmed 70969 records to 49913 (keeping 200 days of data) [2025-09-30T18:07:05.105478] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-30T18:07:05.262351] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T18:07:05.285166] [DEBUG] [LOCAL ] CRI: Primary data saved (49913 records). [2025-09-30T18:07:05.285321] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-30T18:07:05.285844] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRI took 30.4s. Estimated remaining: 3h 51m 42s. Rate: 7.9 symbols/min [2025-09-30T18:07:05.466059] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:05.510219] [DEBUG] [LOCAL ] CRS: Loaded 43170 existing records from primary storage. [2025-09-30T18:07:05.510595] [INFO ] [MAIN ] CRS: Loaded 43170 existing records. [2025-09-30T18:07:05.701146] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:07:05.701397] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-30T18:07:05.701455] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-30T18:07:05.701728] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-30T18:07:05.701786] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-30T18:07:05.857909] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-30T18:07:06.089150] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:06.654352] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-30T18:07:06.743699] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T18:07:06.805838] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-30T18:07:07.454377] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-30T18:07:08.087218] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-30T18:07:08.099611] [INFO ] [REMOTE ] CRK: Full fetch complete (75597 records). [2025-09-30T18:07:08.099870] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-30T18:07:08.258972] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-30T18:07:08.496067] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T18:07:08.581590] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-30T18:07:08.581700] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-30T18:07:08.582596] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-30T18:07:08.582665] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-30T18:07:08.584225] [DEBUG] [LOCAL ] CRK: Trimmed 75597 records to 52148 (keeping 200 days of data) [2025-09-30T18:07:08.903236] [DEBUG] [LOCAL ] CRK: Primary data saved (52148 records). [2025-09-30T18:07:08.903387] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-30T18:07:08.903476] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRK took 32.3s. Estimated remaining: 3h 51m 21s. Rate: 7.9 symbols/min [2025-09-30T18:07:09.062481] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-30T18:07:09.093850] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:09.102144] [DEBUG] [LOCAL ] CRT: Loaded 4976 existing records from primary storage. [2025-09-30T18:07:09.102862] [INFO ] [MAIN ] CRT: Loaded 4976 existing records. [2025-09-30T18:07:09.300016] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:07:09.300385] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-30T18:07:09.300520] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-30T18:07:09.300778] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-30T18:07:09.300838] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-30T18:07:09.712136] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:09.751865] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-30T18:07:09.792973] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:07:09.854326] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-30T18:07:10.659555] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-30T18:07:10.673876] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T18:07:11.164382] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:07:11.454385] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-30T18:07:11.493038] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T18:07:12.254484] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-30T18:07:13.049373] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T18:07:13.058092] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-30T18:07:13.582472] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T18:07:13.836222] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T18:07:13.854334] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-30T18:07:14.476357] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T18:07:14.654398] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-30T18:07:15.292240] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-30T18:07:15.454400] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-30T18:07:16.065857] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T18:07:16.254373] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-30T18:07:17.054404] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-30T18:07:17.854394] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-30T18:07:18.009160] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T18:07:18.328816] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-30T18:07:18.654406] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-30T18:07:19.255621] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T18:07:19.359520] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-30T18:07:19.454370] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-30T18:07:19.903695] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T18:07:20.254385] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-30T18:07:21.054439] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-30T18:07:21.854368] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-30T18:07:21.986263] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T18:07:22.592201] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T18:07:22.654423] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-30T18:07:23.137117] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T18:07:23.454417] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-30T18:07:24.254329] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-30T18:07:24.294984] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T18:07:25.054344] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-30T18:07:25.200513] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T18:07:25.759680] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T18:07:25.854365] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-30T18:07:26.551785] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T18:07:26.654346] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-30T18:07:26.683881] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T18:07:26.685847] [INFO ] [REMOTE ] CRT: Full fetch complete (7598 records). [2025-09-30T18:07:26.685924] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-30T18:07:27.071897] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-30T18:07:27.071992] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-30T18:07:27.072261] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-30T18:07:27.072345] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-30T18:07:27.072864] [DEBUG] [LOCAL ] CRT: Trimmed 7598 records to 4979 (keeping 200 days of data) [2025-09-30T18:07:27.104221] [DEBUG] [LOCAL ] CRT: Primary data saved (4979 records). [2025-09-30T18:07:27.104333] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-30T18:07:27.104426] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRT took 18.2s. Estimated remaining: 3h 51m 50s. Rate: 7.9 symbols/min [2025-09-30T18:07:27.296982] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:27.347118] [DEBUG] [LOCAL ] CSAN: Loaded 42412 existing records from primary storage. [2025-09-30T18:07:27.347486] [INFO ] [MAIN ] CSAN: Loaded 42412 existing records. [2025-09-30T18:07:27.455117] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-30T18:07:27.542659] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:07:27.542935] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-30T18:07:27.542999] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-30T18:07:27.543320] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-30T18:07:27.543384] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-30T18:07:27.917623] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:28.254336] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-30T18:07:28.295741] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:07:28.978589] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T18:07:28.988155] [INFO ] [REMOTE ] CRL: Full fetch complete (62817 records). [2025-09-30T18:07:28.988332] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-30T18:07:29.059920] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-30T18:07:29.428008] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-30T18:07:29.428137] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-30T18:07:29.429144] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-30T18:07:29.429226] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-30T18:07:29.430730] [DEBUG] [LOCAL ] CRL: Trimmed 62817 records to 42984 (keeping 200 days of data) [2025-09-30T18:07:29.710995] [DEBUG] [LOCAL ] CRL: Primary data saved (42984 records). [2025-09-30T18:07:29.711129] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-30T18:07:29.711305] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRL took 35.4s. Estimated remaining: 3h 51m 25s. Rate: 7.9 symbols/min [2025-09-30T18:07:29.865814] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-30T18:07:29.902698] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:29.940338] [DEBUG] [LOCAL ] CSL: Loaded 31556 existing records from primary storage. [2025-09-30T18:07:29.940686] [INFO ] [MAIN ] CSL: Loaded 31556 existing records. [2025-09-30T18:07:30.146113] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:07:30.146507] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-30T18:07:30.146567] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-30T18:07:30.147021] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-30T18:07:30.147113] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-30T18:07:30.604002] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:30.643085] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-30T18:07:30.654581] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-30T18:07:30.822272] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T18:07:31.454331] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-30T18:07:31.564329] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T18:07:32.071683] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T18:07:32.254379] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-30T18:07:33.054415] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-30T18:07:33.338597] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T18:07:33.348478] [INFO ] [REMOTE ] CRS: Full fetch complete (62680 records). [2025-09-30T18:07:33.348624] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-30T18:07:33.859243] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:07:33.862755] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-30T18:07:33.862877] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-30T18:07:33.869463] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-30T18:07:33.859357] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-30T18:07:33.871257] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-30T18:07:33.872840] [DEBUG] [LOCAL ] CRS: Trimmed 62680 records to 43193 (keeping 200 days of data) [2025-09-30T18:07:33.984559] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T18:07:34.180539] [DEBUG] [LOCAL ] CRS: Primary data saved (43193 records). [2025-09-30T18:07:34.180699] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-30T18:07:34.181888] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRS took 28.9s. Estimated remaining: 3h 51m 7s. Rate: 7.9 symbols/min [2025-09-30T18:07:34.366222] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:34.383177] [DEBUG] [LOCAL ] CSR: Loaded 12759 existing records from primary storage. [2025-09-30T18:07:34.383413] [INFO ] [MAIN ] CSR: Loaded 12759 existing records. [2025-09-30T18:07:34.575115] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:07:34.575384] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-30T18:07:34.575463] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-30T18:07:34.575730] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-30T18:07:34.575793] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-30T18:07:34.660432] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-30T18:07:34.984023] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:35.454331] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-30T18:07:35.691552] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-30T18:07:35.972825] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T18:07:36.254365] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-30T18:07:36.856686] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T18:07:37.054363] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-30T18:07:37.854373] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-30T18:07:38.152563] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T18:07:38.654368] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-30T18:07:38.709995] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-30T18:07:39.248890] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:07:39.454376] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-30T18:07:39.896761] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T18:07:40.254364] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-30T18:07:41.054366] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-30T18:07:41.141510] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T18:07:41.854382] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-30T18:07:42.205512] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-30T18:07:42.638939] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T18:07:42.654365] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-30T18:07:42.691116] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T18:07:43.454375] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-30T18:07:44.079309] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T18:07:44.254401] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-30T18:07:45.054401] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-30T18:07:45.388473] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-30T18:07:45.400368] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-09-30T18:07:45.400594] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-30T18:07:45.572042] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T18:07:45.855346] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-30T18:07:45.876224] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-30T18:07:45.876317] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-30T18:07:45.877371] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-30T18:07:45.877436] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-30T18:07:45.879122] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 53770 (keeping 200 days of data) [2025-09-30T18:07:46.237163] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-09-30T18:07:46.237302] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-30T18:07:46.237380] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CRM took 44.2s. Estimated remaining: 3h 51m 15s. Rate: 7.9 symbols/min [2025-09-30T18:07:46.417844] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:46.469797] [DEBUG] [LOCAL ] CSTM: Loaded 47545 existing records from primary storage. [2025-09-30T18:07:46.470295] [INFO ] [MAIN ] CSTM: Loaded 47545 existing records. [2025-09-30T18:07:46.655802] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-30T18:07:46.661990] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:07:46.664587] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-30T18:07:46.664791] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-30T18:07:46.665310] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-30T18:07:46.665376] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-30T18:07:46.874604] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T18:07:46.874233] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T18:07:47.112171] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:47.454370] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-30T18:07:48.031808] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T18:07:48.064939] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T18:07:48.254397] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-30T18:07:49.054373] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-30T18:07:49.860112] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-30T18:07:49.865444] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T18:07:50.295449] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T18:07:50.654393] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-30T18:07:50.670296] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T18:07:51.454361] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-30T18:07:51.926370] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T18:07:52.122576] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T18:07:52.254343] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-30T18:07:53.054366] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-30T18:07:53.764052] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T18:07:53.763588] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T18:07:53.854353] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-30T18:07:54.654362] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-30T18:07:55.420505] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T18:07:55.428838] [INFO ] [REMOTE ] CSL: Full fetch complete (45317 records). [2025-09-30T18:07:55.429184] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-30T18:07:55.461968] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-30T18:07:55.648148] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T18:07:55.874851] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-30T18:07:55.874956] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-30T18:07:55.875664] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-30T18:07:55.875746] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-30T18:07:55.876821] [DEBUG] [LOCAL ] CSL: Trimmed 45317 records to 31515 (keeping 200 days of data) [2025-09-30T18:07:56.086758] [DEBUG] [LOCAL ] CSL: Primary data saved (31515 records). [2025-09-30T18:07:56.086910] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-30T18:07:56.087000] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSL took 26.4s. Estimated remaining: 3h 51m 15s. Rate: 7.9 symbols/min [2025-09-30T18:07:56.256676] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-30T18:07:56.281955] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:56.283281] [DEBUG] [LOCAL ] CSV: No existing data file found in primary storage. [2025-09-30T18:07:56.283334] [WARN ] [MAIN ] CSV: No existing data found, performing full refresh instead. [2025-09-30T18:07:56.283546] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-30T18:07:56.283622] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-30T18:07:56.283754] [DEBUG] [LOCAL ] CSV: No primary data file found to delete. [2025-09-30T18:07:56.283836] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-30T18:07:56.670749] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:57.054326] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-30T18:07:57.245693] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T18:07:57.556678] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T18:07:57.691108] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T18:07:57.696681] [INFO ] [REMOTE ] CSR: Full fetch complete (17645 records). [2025-09-30T18:07:57.696837] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-30T18:07:57.859430] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-30T18:07:58.115867] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-30T18:07:58.115946] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-30T18:07:58.116366] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-30T18:07:58.116407] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-30T18:07:58.116995] [DEBUG] [LOCAL ] CSR: Trimmed 17645 records to 12774 (keeping 200 days of data) [2025-09-30T18:07:58.198506] [DEBUG] [LOCAL ] CSR: Primary data saved (12774 records). [2025-09-30T18:07:58.198667] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-30T18:07:58.198788] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSR took 24.0s. Estimated remaining: 3h 50m 49s. Rate: 7.9 symbols/min [2025-09-30T18:07:58.377937] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:07:58.378164] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-30T18:07:58.378234] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-30T18:07:58.378356] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-30T18:07:58.378399] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-30T18:07:58.378442] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-30T18:07:58.378475] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-30T18:07:58.662143] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-30T18:07:58.759378] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:07:59.454363] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-30T18:07:59.509190] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T18:07:59.865396] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T18:08:00.254355] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-30T18:08:00.938951] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T18:08:01.054391] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-30T18:08:01.294706] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T18:08:01.854365] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-30T18:08:02.388933] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T18:08:02.398833] [INFO ] [REMOTE ] CSAN: Full fetch complete (60819 records). [2025-09-30T18:08:02.399008] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-30T18:08:02.659537] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-30T18:08:02.828449] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-30T18:08:02.829313] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T18:08:02.829407] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-30T18:08:02.833565] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-30T18:08:02.833949] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-30T18:08:02.836462] [DEBUG] [LOCAL ] CSAN: Trimmed 60819 records to 42417 (keeping 200 days of data) [2025-09-30T18:08:02.929098] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:08:02.930521] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-30T18:08:02.931196] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:08:02.931833] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-09-30T18:08:02.932205] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:08:02.932882] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-30T18:08:02.933546] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-30T18:08:02.934187] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-30T18:08:02.934939] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-30T18:08:02.935518] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSW took 4.7s. Estimated remaining: 3h 50m 32s. Rate: 7.9 symbols/min [2025-09-30T18:08:03.136464] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:03.149714] [DEBUG] [LOCAL ] CTBB: Loaded 7077 existing records from primary storage. [2025-09-30T18:08:03.150237] [INFO ] [MAIN ] CTBB: Loaded 7077 existing records. [2025-09-30T18:08:03.357019] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:03.357800] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-30T18:08:03.358498] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-30T18:08:03.360156] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-30T18:08:03.360239] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-30T18:08:03.459438] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-30T18:08:03.860889] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:03.901201] [DEBUG] [LOCAL ] CSAN: Primary data saved (42417 records). [2025-09-30T18:08:03.901336] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-30T18:08:03.901420] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSAN took 36.8s. Estimated remaining: 3h 50m 2s. Rate: 8.0 symbols/min [2025-09-30T18:08:04.085067] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:04.094479] [DEBUG] [LOCAL ] CTDD: Loaded 5923 existing records from primary storage. [2025-09-30T18:08:04.094730] [INFO ] [MAIN ] CTDD: Loaded 5923 existing records. [2025-09-30T18:08:04.259457] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-30T18:08:04.294867] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:04.295821] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-30T18:08:04.295874] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-30T18:08:04.296050] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-30T18:08:04.296110] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-30T18:08:04.555558] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T18:08:04.708905] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:05.054364] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-30T18:08:05.790553] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T18:08:05.854321] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-30T18:08:05.964479] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T18:08:06.558257] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T18:08:06.654390] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-30T18:08:07.454349] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-30T18:08:07.691980] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T18:08:08.254405] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-30T18:08:08.837989] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T18:08:09.036413] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:08:09.054313] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-30T18:08:09.854403] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-30T18:08:10.493080] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T18:08:10.654396] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-30T18:08:10.706517] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T18:08:11.305437] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T18:08:11.454402] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-30T18:08:12.257128] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-30T18:08:12.258163] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T18:08:13.054357] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-30T18:08:13.338295] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:08:13.488760] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T18:08:13.854433] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-30T18:08:14.450567] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T18:08:14.654432] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-30T18:08:15.332510] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T18:08:15.454373] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-30T18:08:16.254386] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-30T18:08:16.289855] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T18:08:16.862472] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T18:08:17.054371] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-30T18:08:17.854391] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-30T18:08:18.654399] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-30T18:08:18.703156] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T18:08:18.734948] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T18:08:19.151932] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-30T18:08:19.454462] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-30T18:08:20.254409] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-30T18:08:20.637076] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T18:08:20.753633] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-30T18:08:21.054389] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-30T18:08:21.854412] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-30T18:08:22.348807] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T18:08:22.585779] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:08:22.654351] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-30T18:08:23.454394] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-30T18:08:24.003791] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-30T18:08:24.167932] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T18:08:24.177937] [INFO ] [REMOTE ] CSTM: Full fetch complete (68863 records). [2025-09-30T18:08:24.178125] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-30T18:08:24.179097] [FATAL] [VALIDATOR ] CSTM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:08:24.179204] [FATAL] [MAIN ] CSTM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:08:24.179249] [WARN ] [MAIN ] CSTM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:08:24.179292] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-30T18:08:24.179354] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-09-30T18:08:24.179390] [INFO ] [LOCAL ] CSTM: Starting deletion of derivative data. [2025-09-30T18:08:24.179804] [DEBUG] [LOCAL ] CSTM: Deleted derivative data file. [2025-09-30T18:08:24.179909] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSTM took 37.9s. Estimated remaining: 3h 50m 38s. Rate: 7.9 symbols/min [2025-09-30T18:08:24.259453] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-30T18:08:24.396075] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:24.396304] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-30T18:08:24.396362] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-30T18:08:24.396478] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-30T18:08:24.396521] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-30T18:08:24.396565] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-30T18:08:24.396598] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-30T18:08:24.787791] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:24.918396] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T18:08:25.054360] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-30T18:08:25.635958] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-30T18:08:25.854365] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-30T18:08:26.635898] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T18:08:26.654316] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-30T18:08:27.454392] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-30T18:08:27.468832] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T18:08:28.254354] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-30T18:08:28.372172] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T18:08:28.373984] [INFO ] [REMOTE ] CTDD: Full fetch complete (8501 records). [2025-09-30T18:08:28.374061] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-30T18:08:28.612781] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:08:28.648071] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-30T18:08:28.666445] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:08:28.678003] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-09-30T18:08:28.678084] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:08:28.678174] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-30T18:08:28.678316] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-30T18:08:28.678806] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-30T18:08:28.684308] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-30T18:08:28.694721] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTEST took 4.5s. Estimated remaining: 3h 50m 20s. Rate: 7.9 symbols/min [2025-09-30T18:08:28.886436] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-30T18:08:28.896899] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-30T18:08:28.907965] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-30T18:08:28.908107] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-30T18:08:28.940304] [DEBUG] [LOCAL ] CTDD: Trimmed 8501 records to 5892 (keeping 200 days of data) [2025-09-30T18:08:28.960944] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:28.961406] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-30T18:08:28.961454] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-30T18:08:28.961582] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-30T18:08:28.961681] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-30T18:08:28.962036] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-30T18:08:28.962123] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-30T18:08:29.056434] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-30T18:08:29.274254] [DEBUG] [LOCAL ] CTDD: Primary data saved (5892 records). [2025-09-30T18:08:29.288368] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-30T18:08:29.288518] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTDD took 25.4s. Estimated remaining: 3h 49m 49s. Rate: 7.9 symbols/min [2025-09-30T18:08:29.580103] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:29.599375] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:29.633273] [DEBUG] [LOCAL ] CTO: Loaded 27978 existing records from primary storage. [2025-09-30T18:08:29.633766] [INFO ] [MAIN ] CTO: Loaded 27978 existing records. [2025-09-30T18:08:29.822881] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:29.823197] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-30T18:08:29.823252] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-30T18:08:29.823857] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-30T18:08:29.824100] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-30T18:08:29.859506] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-30T18:08:30.075990] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:08:30.103950] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-30T18:08:30.122956] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:08:30.129218] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-09-30T18:08:30.128978] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T18:08:30.140292] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:08:30.157983] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-30T18:08:30.176605] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-30T18:08:30.181902] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-30T18:08:30.176474] [INFO ] [REMOTE ] CTBB: Full fetch complete (10878 records). [2025-09-30T18:08:30.205020] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-30T18:08:30.205182] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-30T18:08:30.205320] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CTEV took 1.5s. Estimated remaining: 3h 49m 19s. Rate: 8.0 symbols/min [2025-09-30T18:08:30.228720] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:30.605710] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:30.659488] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-30T18:08:30.893854] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-30T18:08:30.894103] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-30T18:08:30.893997] [DEBUG] [LOCAL ] CTOS: Loaded 36520 existing records from primary storage. [2025-09-30T18:08:30.894630] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-30T18:08:30.894754] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-30T18:08:30.895699] [INFO ] [MAIN ] CTOS: Loaded 36520 existing records. [2025-09-30T18:08:30.895850] [DEBUG] [LOCAL ] CTBB: Trimmed 10878 records to 7058 (keeping 200 days of data) [2025-09-30T18:08:31.064472] [DEBUG] [LOCAL ] CTBB: Primary data saved (7058 records). [2025-09-30T18:08:31.074996] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-30T18:08:31.080280] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTBB took 28.1s. Estimated remaining: 3h 48m 49s. Rate: 8.0 symbols/min [2025-09-30T18:08:31.151683] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:31.208339] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-30T18:08:31.208439] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-30T18:08:31.221885] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-30T18:08:31.240463] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-30T18:08:31.457816] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-30T18:08:31.549114] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:31.785539] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:31.826009] [DEBUG] [LOCAL ] CTRA: Loaded 53648 existing records from primary storage. [2025-09-30T18:08:31.826358] [INFO ] [MAIN ] CTRA: Loaded 53648 existing records. [2025-09-30T18:08:32.024187] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:32.024590] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-30T18:08:32.024699] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-30T18:08:32.032406] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-30T18:08:32.044506] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-30T18:08:32.109076] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T18:08:32.255777] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-30T18:08:32.470137] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:32.485588] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T18:08:33.054329] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-30T18:08:33.128747] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T18:08:33.854385] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-30T18:08:34.078010] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T18:08:34.654416] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-30T18:08:35.454386] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-30T18:08:35.651908] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T18:08:35.958568] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T18:08:36.046357] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T18:08:36.049913] [INFO ] [REMOTE ] CSV: Full fetch complete (19429 records). [2025-09-30T18:08:36.050030] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-30T18:08:36.259635] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-30T18:08:36.447480] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-30T18:08:36.447568] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-30T18:08:36.448037] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-30T18:08:36.448101] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-30T18:08:36.448795] [DEBUG] [LOCAL ] CSV: Trimmed 19429 records to 12824 (keeping 200 days of data) [2025-09-30T18:08:36.540988] [DEBUG] [LOCAL ] CSV: Primary data saved (12824 records). [2025-09-30T18:08:36.541142] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-30T18:08:36.541221] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CSV took 40.5s. Estimated remaining: 3h 48m 35s. Rate: 8.0 symbols/min [2025-09-30T18:08:36.732084] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:36.787911] [DEBUG] [LOCAL ] CTRE: Loaded 49220 existing records from primary storage. [2025-09-30T18:08:36.788275] [INFO ] [MAIN ] CTRE: Loaded 49220 existing records. [2025-09-30T18:08:36.975236] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:36.975568] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-30T18:08:36.975673] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-30T18:08:36.976122] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-30T18:08:36.976180] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-30T18:08:37.059521] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-30T18:08:37.371233] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:08:37.854403] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-30T18:08:37.917348] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T18:08:38.278582] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T18:08:38.654365] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-30T18:08:39.184110] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T18:08:39.454437] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-30T18:08:40.234859] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:08:40.254317] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-30T18:08:40.784479] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T18:08:41.054401] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-30T18:08:41.854333] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-30T18:08:41.919176] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T18:08:42.475909] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T18:08:42.627833] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T18:08:42.654351] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-30T18:08:43.454359] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-30T18:08:43.858033] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T18:08:44.254360] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-30T18:08:45.001726] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T18:08:45.054355] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-30T18:08:45.854345] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-30T18:08:45.962954] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T18:08:46.462868] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T18:08:46.654357] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-30T18:08:47.386813] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T18:08:47.454319] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-30T18:08:47.918403] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:08:48.254367] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-30T18:08:48.554246] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T18:08:49.054349] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-30T18:08:49.084990] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T18:08:49.854381] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-30T18:08:50.596348] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:08:50.654316] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-30T18:08:51.280032] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T18:08:51.454371] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-30T18:08:52.254377] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-30T18:08:52.401498] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T18:08:52.570181] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T18:08:53.054353] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-30T18:08:53.658605] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T18:08:53.854359] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-30T18:08:54.654332] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-30T18:08:54.715291] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T18:08:55.454333] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-30T18:08:55.683023] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T18:08:56.099551] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T18:08:56.254394] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-30T18:08:56.792963] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:08:57.054356] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-30T18:08:57.854331] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-30T18:08:57.967331] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T18:08:58.497052] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T18:08:58.505277] [INFO ] [REMOTE ] CTOS: Full fetch complete (53476 records). [2025-09-30T18:08:58.505436] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-30T18:08:58.661577] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-30T18:08:58.864441] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T18:08:58.948870] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-30T18:08:58.949000] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-30T18:08:58.949745] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-30T18:08:58.949852] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-30T18:08:58.951150] [DEBUG] [LOCAL ] CTOS: Trimmed 53476 records to 36496 (keeping 200 days of data) [2025-09-30T18:08:59.166044] [DEBUG] [LOCAL ] CTOS: Primary data saved (36496 records). [2025-09-30T18:08:59.166188] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-30T18:08:59.166275] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTOS took 28.9s. Estimated remaining: 3h 49m 18s. Rate: 8.0 symbols/min [2025-09-30T18:08:59.371405] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:08:59.410624] [DEBUG] [LOCAL ] CTRI: Loaded 38199 existing records from primary storage. [2025-09-30T18:08:59.410962] [INFO ] [MAIN ] CTRI: Loaded 38199 existing records. [2025-09-30T18:08:59.461909] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-30T18:08:59.623529] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:08:59.623801] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-30T18:08:59.623870] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-30T18:08:59.624200] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-30T18:08:59.624260] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-30T18:09:00.035965] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:00.254367] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-30T18:09:00.316265] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T18:09:01.054365] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-30T18:09:01.475334] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T18:09:01.513312] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T18:09:01.854373] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-30T18:09:02.654422] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-30T18:09:02.879265] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T18:09:03.454348] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-30T18:09:03.796459] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T18:09:03.808905] [INFO ] [REMOTE ] CTRA: Full fetch complete (77663 records). [2025-09-30T18:09:03.809182] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-30T18:09:03.889113] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T18:09:03.945679] [INFO ] [REMOTE ] CTO: Full fetch complete (41779 records). [2025-09-30T18:09:03.956378] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-30T18:09:04.269853] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-30T18:09:04.637622] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-30T18:09:04.641173] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-30T18:09:04.642104] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-30T18:09:04.642338] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-30T18:09:04.741520] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-30T18:09:04.741741] [DEBUG] [LOCAL ] CTRA: Trimmed 77663 records to 53648 (keeping 200 days of data) [2025-09-30T18:09:04.741816] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-30T18:09:04.742958] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-30T18:09:04.743455] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-30T18:09:04.833992] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:09:04.871485] [DEBUG] [LOCAL ] CTO: Trimmed 41779 records to 27915 (keeping 200 days of data) [2025-09-30T18:09:05.083464] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-30T18:09:05.211702] [DEBUG] [LOCAL ] CTO: Primary data saved (27915 records). [2025-09-30T18:09:05.213807] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-30T18:09:05.216612] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTO took 35.9s. Estimated remaining: 3h 49m 5s. Rate: 8.0 symbols/min [2025-09-30T18:09:05.484242] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:05.500007] [DEBUG] [LOCAL ] CTRA: Primary data saved (53648 records). [2025-09-30T18:09:05.500166] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-30T18:09:05.500352] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRA took 34.4s. Estimated remaining: 3h 48m 33s. Rate: 8.0 symbols/min [2025-09-30T18:09:05.626134] [DEBUG] [LOCAL ] CTS: Loaded 19346 existing records from primary storage. [2025-09-30T18:09:05.632195] [INFO ] [MAIN ] CTS: Loaded 19346 existing records. [2025-09-30T18:09:05.808882] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:05.912622] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:09:05.913091] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-30T18:09:05.913141] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-30T18:09:05.913338] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-30T18:09:05.913396] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-30T18:09:06.246160] [DEBUG] [LOCAL ] CTVA: Loaded 53232 existing records from primary storage. [2025-09-30T18:09:06.291143] [INFO ] [MAIN ] CTVA: Loaded 53232 existing records. [2025-09-30T18:09:06.452866] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:06.517766] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-30T18:09:06.604137] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T18:09:06.614858] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-30T18:09:06.655314] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-30T18:09:06.750241] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:09:06.751070] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-30T18:09:06.751137] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-30T18:09:06.751905] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-30T18:09:06.751974] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-30T18:09:07.354873] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:07.454443] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-30T18:09:07.640946] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T18:09:07.740542] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T18:09:08.254405] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-30T18:09:09.054375] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-30T18:09:09.138904] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T18:09:09.649071] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T18:09:09.854395] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-30T18:09:10.645574] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T18:09:10.656350] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-30T18:09:10.658295] [INFO ] [REMOTE ] CTRE: Full fetch complete (71128 records). [2025-09-30T18:09:10.658412] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-30T18:09:11.085627] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-30T18:09:11.085745] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-30T18:09:11.086566] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-30T18:09:11.086612] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-30T18:09:11.088093] [DEBUG] [LOCAL ] CTRE: Trimmed 71128 records to 49202 (keeping 200 days of data) [2025-09-30T18:09:11.399722] [DEBUG] [LOCAL ] CTRE: Primary data saved (49202 records). [2025-09-30T18:09:11.399885] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-30T18:09:11.399981] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRE took 34.9s. Estimated remaining: 3h 48m 21s. Rate: 8.0 symbols/min [2025-09-30T18:09:11.458708] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-30T18:09:11.592980] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:11.593445] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-30T18:09:11.593503] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-30T18:09:11.593677] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-30T18:09:11.593756] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-30T18:09:11.593842] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-30T18:09:11.593890] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-30T18:09:11.794520] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-30T18:09:12.039503] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:12.254335] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-30T18:09:12.698619] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-30T18:09:12.901777] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T18:09:13.054354] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-30T18:09:13.854380] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-30T18:09:14.168762] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-30T18:09:14.402110] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T18:09:14.654390] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-30T18:09:15.454412] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-30T18:09:15.792854] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T18:09:16.254342] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-30T18:09:16.409711] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (5.75 seconds). [2025-09-30T18:09:16.630776] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T18:09:16.644533] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-30T18:09:17.054545] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-30T18:09:17.396710] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T18:09:17.854386] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-30T18:09:18.113145] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-30T18:09:18.654332] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-30T18:09:19.454390] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-30T18:09:20.061473] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T18:09:20.254376] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-30T18:09:20.332394] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T18:09:21.054360] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-30T18:09:21.854331] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-30T18:09:21.978346] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T18:09:21.989163] [INFO ] [REMOTE ] CTRI: Full fetch complete (51691 records). [2025-09-30T18:09:21.989318] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-30T18:09:22.394178] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-30T18:09:22.394273] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-30T18:09:22.395037] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-30T18:09:22.395109] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-30T18:09:22.396387] [DEBUG] [LOCAL ] CTRI: Trimmed 51691 records to 38422 (keeping 200 days of data) [2025-09-30T18:09:22.631318] [DEBUG] [LOCAL ] CTRI: Primary data saved (38422 records). [2025-09-30T18:09:22.631469] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-30T18:09:22.631557] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTRI took 23.5s. Estimated remaining: 3h 48m 25s. Rate: 8.0 symbols/min [2025-09-30T18:09:22.665594] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-30T18:09:22.821633] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:22.873127] [DEBUG] [LOCAL ] CUBE: Loaded 50626 existing records from primary storage. [2025-09-30T18:09:22.873466] [INFO ] [MAIN ] CUBE: Loaded 50626 existing records. [2025-09-30T18:09:23.023702] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T18:09:23.084912] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:09:23.091089] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-30T18:09:23.091159] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-30T18:09:23.091483] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-30T18:09:23.091548] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-30T18:09:23.175445] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-30T18:09:23.241837] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-30T18:09:23.459501] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-30T18:09:23.530373] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:23.772434] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-30T18:09:24.254435] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-30T18:09:25.054377] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-30T18:09:25.422553] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-30T18:09:25.854350] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-30T18:09:26.108217] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T18:09:26.191357] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-30T18:09:26.654354] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-30T18:09:27.454400] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-30T18:09:28.254372] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-30T18:09:28.497907] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T18:09:28.724786] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T18:09:29.054330] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-30T18:09:29.077385] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T18:09:29.507417] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-30T18:09:29.508230] [INFO ] [REMOTE ] CUBB: Full fetch complete (929 records). [2025-09-30T18:09:29.508301] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-30T18:09:29.711724] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-30T18:09:29.711923] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:09:29.711995] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:09:29.712069] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-30T18:09:29.712137] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-30T18:09:29.712178] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-30T18:09:29.712238] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-30T18:09:29.712320] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CUBB took 18.3s. Estimated remaining: 3h 48m 16s. Rate: 8.0 symbols/min [2025-09-30T18:09:29.860614] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-30T18:09:29.920629] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:29.948368] [DEBUG] [LOCAL ] CUBI: Loaded 27225 existing records from primary storage. [2025-09-30T18:09:29.948673] [INFO ] [MAIN ] CUBI: Loaded 27225 existing records. [2025-09-30T18:09:30.145889] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:09:30.146371] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-30T18:09:30.146514] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-30T18:09:30.146777] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-30T18:09:30.146837] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-30T18:09:30.534861] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:30.654391] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-30T18:09:31.120477] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:09:31.454380] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-30T18:09:31.863304] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T18:09:32.254358] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-30T18:09:32.835295] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:09:33.054372] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-30T18:09:33.854334] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-30T18:09:33.911557] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T18:09:34.205252] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T18:09:34.583861] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T18:09:34.654324] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-30T18:09:35.454341] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-30T18:09:35.805941] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T18:09:36.254358] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-30T18:09:36.966572] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T18:09:37.054371] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-30T18:09:37.600184] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T18:09:37.850716] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T18:09:37.855377] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-30T18:09:38.654409] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-30T18:09:39.454351] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-30T18:09:39.497626] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T18:09:39.523619] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T18:09:40.254332] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-30T18:09:40.490117] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T18:09:40.494719] [INFO ] [REMOTE ] CTS: Full fetch complete (26709 records). [2025-09-30T18:09:40.494874] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-30T18:09:40.892928] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-30T18:09:40.893017] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-30T18:09:40.893576] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-30T18:09:40.893664] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-30T18:09:40.894466] [DEBUG] [LOCAL ] CTS: Trimmed 26709 records to 19345 (keeping 200 days of data) [2025-09-30T18:09:41.015513] [DEBUG] [LOCAL ] CTS: Primary data saved (19345 records). [2025-09-30T18:09:41.015687] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-30T18:09:41.015871] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CTS took 35.8s. Estimated remaining: 3h 48m 21s. Rate: 8.0 symbols/min [2025-09-30T18:09:41.062170] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-30T18:09:41.206208] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:41.264512] [DEBUG] [LOCAL ] CUK: Loaded 50998 existing records from primary storage. [2025-09-30T18:09:41.264986] [INFO ] [MAIN ] CUK: Loaded 50998 existing records. [2025-09-30T18:09:41.481799] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:09:41.482023] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-30T18:09:41.482074] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-30T18:09:41.482309] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-30T18:09:41.482369] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-30T18:09:41.855361] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-30T18:09:41.925009] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:41.963791] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T18:09:42.654318] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-30T18:09:42.876571] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T18:09:43.130632] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T18:09:43.454393] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-30T18:09:44.254370] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-30T18:09:44.375033] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T18:09:44.774844] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T18:09:45.054395] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-30T18:09:45.854342] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-30T18:09:46.084587] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T18:09:46.577408] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T18:09:46.654363] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-30T18:09:46.891285] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T18:09:47.454376] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-30T18:09:48.139004] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T18:09:48.254330] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-30T18:09:49.054373] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-30T18:09:49.217075] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T18:09:49.228791] [INFO ] [REMOTE ] CTVA: Full fetch complete (76975 records). [2025-09-30T18:09:49.229014] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-30T18:09:49.673545] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-30T18:09:49.673804] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-30T18:09:49.675097] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-30T18:09:49.675223] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-30T18:09:49.687754] [DEBUG] [LOCAL ] CTVA: Trimmed 76975 records to 53236 (keeping 200 days of data) [2025-09-30T18:09:49.709150] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T18:09:49.900117] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-30T18:09:50.056943] [DEBUG] [LOCAL ] CTVA: Primary data saved (53236 records). [2025-09-30T18:09:50.057091] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-30T18:09:50.057280] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CTVA took 44.6s. Estimated remaining: 3h 48m 18s. Rate: 8.0 symbols/min [2025-09-30T18:09:50.247995] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:50.253853] [DEBUG] [LOCAL ] CULP: Loaded 2994 existing records from primary storage. [2025-09-30T18:09:50.254029] [INFO ] [MAIN ] CULP: Loaded 2994 existing records. [2025-09-30T18:09:50.449541] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:09:50.449806] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-30T18:09:50.449868] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-30T18:09:50.450035] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-30T18:09:50.450116] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-30T18:09:50.677176] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-30T18:09:50.843540] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:50.878130] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T18:09:51.454342] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-30T18:09:51.654394] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T18:09:51.806013] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:09:51.818254] [INFO ] [REMOTE ] CUBE: Full fetch complete (73008 records). [2025-09-30T18:09:51.818528] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-30T18:09:52.026611] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-30T18:09:52.262886] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-30T18:09:52.288047] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-30T18:09:52.288130] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-30T18:09:52.289124] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-30T18:09:52.289190] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-30T18:09:52.290823] [DEBUG] [LOCAL ] CUBE: Trimmed 73008 records to 50616 (keeping 200 days of data) [2025-09-30T18:09:52.612260] [DEBUG] [LOCAL ] CUBE: Primary data saved (50616 records). [2025-09-30T18:09:52.612409] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-30T18:09:52.612524] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBE took 30.0s. Estimated remaining: 3h 47m 55s. Rate: 8.0 symbols/min [2025-09-30T18:09:52.734438] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-30T18:09:52.815173] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:09:52.815401] [DEBUG] [LOCAL ] CURB: No existing data file found in primary storage. [2025-09-30T18:09:52.815462] [WARN ] [MAIN ] CURB: No existing data found, performing full refresh instead. [2025-09-30T18:09:52.815624] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-30T18:09:52.815709] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-30T18:09:52.815765] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-09-30T18:09:52.815800] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-30T18:09:53.059563] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-30T18:09:53.214312] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:09:53.854392] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-30T18:09:54.654377] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-30T18:09:54.948895] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T18:09:55.212632] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T18:09:55.454362] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-30T18:09:56.000349] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:09:56.254354] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-30T18:09:56.639299] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T18:09:57.054335] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-30T18:09:57.381549] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T18:09:57.854353] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-30T18:09:58.356750] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T18:09:58.654373] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-30T18:09:59.454386] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-30T18:09:59.653325] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T18:09:59.698251] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T18:09:59.705466] [INFO ] [REMOTE ] CUBI: Full fetch complete (39346 records). [2025-09-30T18:09:59.705693] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-30T18:10:00.245004] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-30T18:10:00.245135] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-30T18:10:00.245945] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-30T18:10:00.246025] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-30T18:10:00.247394] [DEBUG] [LOCAL ] CUBI: Trimmed 39346 records to 27167 (keeping 200 days of data) [2025-09-30T18:10:00.254428] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-30T18:10:00.482856] [DEBUG] [LOCAL ] CUBI: Primary data saved (27167 records). [2025-09-30T18:10:00.483045] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-30T18:10:00.483177] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUBI took 30.8s. Estimated remaining: 3h 47m 48s. Rate: 8.0 symbols/min [2025-09-30T18:10:01.001513] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T18:10:01.054326] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-30T18:10:01.854409] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-30T18:10:02.439489] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T18:10:02.443315] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-30T18:10:02.522236] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T18:10:02.654375] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-30T18:10:03.273348] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T18:10:03.454398] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-30T18:10:04.254375] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-30T18:10:04.727561] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T18:10:04.770122] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-30T18:10:05.054366] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-30T18:10:05.854376] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-30T18:10:06.654366] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-30T18:10:06.972539] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T18:10:07.189459] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-30T18:10:07.396081] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T18:10:07.454406] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-30T18:10:08.254385] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-30T18:10:09.062103] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-30T18:10:09.083804] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T18:10:09.186177] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T18:10:09.647521] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T18:10:09.854386] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-30T18:10:10.654435] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-30T18:10:11.183708] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T18:10:11.454419] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-30T18:10:12.254356] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-30T18:10:12.439445] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T18:10:12.633889] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T18:10:12.641365] [INFO ] [REMOTE ] CURB: Full fetch complete (47204 records). [2025-09-30T18:10:12.641503] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-30T18:10:12.971796] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-30T18:10:13.054695] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-30T18:10:13.068017] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-30T18:10:13.068094] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-30T18:10:13.068902] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-30T18:10:13.068993] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-30T18:10:13.070255] [DEBUG] [LOCAL ] CURB: Trimmed 47204 records to 32587 (keeping 200 days of data) [2025-09-30T18:10:13.275069] [DEBUG] [LOCAL ] CURB: Primary data saved (32587 records). [2025-09-30T18:10:13.275253] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-30T18:10:13.275355] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CURB took 20.7s. Estimated remaining: 3h 47m 58s. Rate: 8.0 symbols/min [2025-09-30T18:10:13.854395] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-30T18:10:14.299152] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T18:10:14.654395] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-30T18:10:14.979578] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T18:10:15.383785] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-30T18:10:15.385384] [INFO ] [REMOTE ] CULP: Full fetch complete (4736 records). [2025-09-30T18:10:15.385503] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-30T18:10:15.460728] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-30T18:10:15.835074] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-30T18:10:15.835164] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-30T18:10:15.835317] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-30T18:10:15.835389] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-30T18:10:15.835893] [DEBUG] [LOCAL ] CULP: Trimmed 4736 records to 2957 (keeping 200 days of data) [2025-09-30T18:10:15.853077] [DEBUG] [LOCAL ] CULP: Primary data saved (2957 records). [2025-09-30T18:10:15.853202] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-30T18:10:15.853283] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CULP took 25.8s. Estimated remaining: 3h 47m 34s. Rate: 8.0 symbols/min [2025-09-30T18:10:19.717241] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (4.26 seconds). [2025-09-30T18:10:19.731840] [INFO ] [REMOTE ] CUK: Full fetch complete (73464 records). [2025-09-30T18:10:19.732074] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-30T18:10:19.733211] [FATAL] [VALIDATOR ] CUK: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:10:19.733366] [FATAL] [MAIN ] CUK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:10:19.733414] [WARN ] [MAIN ] CUK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:10:19.733470] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-30T18:10:19.733558] [DEBUG] [LOCAL ] CUK: No primary data file found to delete. [2025-09-30T18:10:19.733612] [INFO ] [LOCAL ] CUK: Starting deletion of derivative data. [2025-09-30T18:10:19.733923] [DEBUG] [LOCAL ] CUK: Deleted derivative data file. [2025-09-30T18:10:19.734062] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CUK took 38.7s. Estimated remaining: 3h 47m 15s. Rate: 8.0 symbols/min [2025-09-30T18:10:20.442342] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:20.487092] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:20.494289] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:20.595918] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:20.598149] [DEBUG] [LOCAL ] CVEO: Loaded 15098 existing records from primary storage. [2025-09-30T18:10:20.599258] [INFO ] [MAIN ] CVEO: Loaded 15098 existing records. [2025-09-30T18:10:20.827776] [DEBUG] [LOCAL ] CURV: Loaded 26507 existing records from primary storage. [2025-09-30T18:10:20.886477] [DEBUG] [LOCAL ] CUZ: Loaded 49357 existing records from primary storage. [2025-09-30T18:10:20.892109] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:20.886702] [INFO ] [MAIN ] CURV: Loaded 26507 existing records. [2025-09-30T18:10:20.893511] [DEBUG] [LOCAL ] CVE: Loaded 53557 existing records from primary storage. [2025-09-30T18:10:20.893744] [INFO ] [MAIN ] CUZ: Loaded 49357 existing records. [2025-09-30T18:10:20.904728] [INFO ] [MAIN ] CVE: Loaded 53557 existing records. [2025-09-30T18:10:20.893981] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-30T18:10:20.923781] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-30T18:10:20.993868] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-30T18:10:21.082740] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-30T18:10:21.560577] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:21.596589] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:21.628543] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-30T18:10:21.633895] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-30T18:10:21.644025] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-30T18:10:21.649316] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-30T18:10:21.649530] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-30T18:10:21.649462] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-30T18:10:21.643747] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:21.747952] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-30T18:10:21.737487] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-30T18:10:21.758768] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-30T18:10:21.774977] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-30T18:10:21.871732] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-30T18:10:21.920723] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-30T18:10:22.620992] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:22.801733] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-30T18:10:23.083322] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:23.116019] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:23.121908] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-30T18:10:23.139721] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-30T18:10:23.197921] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:23.199940] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-30T18:10:23.885276] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T18:10:23.888380] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-30T18:10:24.525169] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T18:10:24.533417] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-30T18:10:24.652468] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T18:10:24.654841] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-30T18:10:25.032124] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T18:10:25.042141] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-30T18:10:25.322494] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-30T18:10:25.334991] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-30T18:10:25.345712] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T18:10:25.351107] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-30T18:10:25.371920] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T18:10:25.379485] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-30T18:10:26.334240] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T18:10:26.338689] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-30T18:10:26.419589] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T18:10:26.425122] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-30T18:10:26.666560] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T18:10:26.676462] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-30T18:10:27.083099] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T18:10:27.325004] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-30T18:10:27.454376] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-30T18:10:27.604507] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T18:10:27.884699] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T18:10:28.254386] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-30T18:10:28.899323] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T18:10:29.054345] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-30T18:10:29.343499] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T18:10:29.854374] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-30T18:10:30.636140] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:10:30.654340] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-30T18:10:30.970267] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T18:10:31.454333] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-30T18:10:31.619630] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T18:10:32.254412] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-30T18:10:32.390768] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T18:10:33.054410] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-30T18:10:33.834086] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:10:33.854354] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-30T18:10:33.866319] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T18:10:34.654400] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-30T18:10:35.309154] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:10:35.454411] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-30T18:10:36.254444] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-30T18:10:36.440469] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:10:36.796408] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T18:10:37.054397] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-30T18:10:37.854379] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-30T18:10:37.905034] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T18:10:38.654403] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-30T18:10:38.917808] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T18:10:39.306432] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T18:10:39.454408] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-30T18:10:40.254456] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-30T18:10:40.291145] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T18:10:41.054416] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-30T18:10:41.291892] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-30T18:10:41.607410] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T18:10:41.854379] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-30T18:10:41.890771] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T18:10:42.654371] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-30T18:10:43.271996] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T18:10:43.280126] [INFO ] [REMOTE ] CURV: Full fetch complete (39027 records). [2025-09-30T18:10:43.280246] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-30T18:10:43.454339] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-30T18:10:43.687796] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-30T18:10:43.687911] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-30T18:10:43.688606] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-30T18:10:43.688700] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-30T18:10:43.689786] [DEBUG] [LOCAL ] CURV: Trimmed 39027 records to 26521 (keeping 200 days of data) [2025-09-30T18:10:43.849301] [DEBUG] [LOCAL ] CURV: Primary data saved (26521 records). [2025-09-30T18:10:43.849529] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-30T18:10:43.849685] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CURV took 24.1s. Estimated remaining: 3h 48m 1s. Rate: 7.9 symbols/min [2025-09-30T18:10:44.070502] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:44.105545] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T18:10:44.171394] [DEBUG] [LOCAL ] CVI: Loaded 46430 existing records from primary storage. [2025-09-30T18:10:44.171799] [INFO ] [MAIN ] CVI: Loaded 46430 existing records. [2025-09-30T18:10:44.259546] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-30T18:10:44.370819] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:44.371024] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-30T18:10:44.371072] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-30T18:10:44.371420] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-30T18:10:44.371483] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-30T18:10:44.780934] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:45.054411] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-30T18:10:45.399104] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:10:45.854340] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-30T18:10:46.048479] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T18:10:46.485663] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-30T18:10:46.489237] [INFO ] [REMOTE ] CVEO: Full fetch complete (20148 records). [2025-09-30T18:10:46.489352] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-30T18:10:46.489937] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:10:46.490029] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:10:46.490074] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:10:46.490140] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-30T18:10:46.490207] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-09-30T18:10:46.490244] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-09-30T18:10:46.490467] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-09-30T18:10:46.490603] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CVEO took 26.8s. Estimated remaining: 3h 47m 37s. Rate: 7.9 symbols/min [2025-09-30T18:10:46.659746] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-30T18:10:46.691332] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:46.726684] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:10:46.747743] [DEBUG] [LOCAL ] CVLG: Loaded 15540 existing records from primary storage. [2025-09-30T18:10:46.748010] [INFO ] [MAIN ] CVLG: Loaded 15540 existing records. [2025-09-30T18:10:46.949573] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:46.949992] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-30T18:10:46.950054] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-30T18:10:46.950708] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-30T18:10:46.950770] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-30T18:10:47.355895] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:47.454411] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-30T18:10:48.254433] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-30T18:10:48.431305] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:10:48.442791] [INFO ] [REMOTE ] CUZ: Full fetch complete (70862 records). [2025-09-30T18:10:48.442959] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-30T18:10:48.879063] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-30T18:10:48.879331] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-30T18:10:48.880416] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-30T18:10:48.880560] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-30T18:10:48.882401] [DEBUG] [LOCAL ] CUZ: Trimmed 70862 records to 49350 (keeping 200 days of data) [2025-09-30T18:10:49.032675] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T18:10:49.057243] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-30T18:10:49.262704] [DEBUG] [LOCAL ] CUZ: Primary data saved (49350 records). [2025-09-30T18:10:49.262864] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-30T18:10:49.262958] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CUZ took 29.5s. Estimated remaining: 3h 47m 14s. Rate: 8.0 symbols/min [2025-09-30T18:10:49.452006] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:49.505041] [DEBUG] [LOCAL ] CVNA: Loaded 52985 existing records from primary storage. [2025-09-30T18:10:49.505372] [INFO ] [MAIN ] CVNA: Loaded 52985 existing records. [2025-09-30T18:10:49.702456] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:49.702702] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-30T18:10:49.702765] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-30T18:10:49.703009] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-30T18:10:49.703070] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-30T18:10:49.863276] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-30T18:10:49.915795] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T18:10:50.119942] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:50.153868] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-30T18:10:50.654357] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-30T18:10:51.454354] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-30T18:10:51.548132] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:10:52.254370] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-30T18:10:52.647369] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T18:10:53.054331] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-30T18:10:53.367796] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:10:53.384614] [INFO ] [REMOTE ] CVE: Full fetch complete (77554 records). [2025-09-30T18:10:53.384830] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-30T18:10:53.824211] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-30T18:10:53.824429] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-30T18:10:53.825393] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-30T18:10:53.825494] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-30T18:10:53.827407] [DEBUG] [LOCAL ] CVE: Trimmed 77554 records to 53556 (keeping 200 days of data) [2025-09-30T18:10:53.894843] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-30T18:10:53.960219] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T18:10:54.235156] [DEBUG] [LOCAL ] CVE: Primary data saved (53556 records). [2025-09-30T18:10:54.235313] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-30T18:10:54.236355] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CVE took 34.5s. Estimated remaining: 3h 46m 59s. Rate: 8.0 symbols/min [2025-09-30T18:10:54.436122] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:10:54.498838] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-09-30T18:10:54.499170] [INFO ] [MAIN ] CVS: Loaded 53696 existing records. [2025-09-30T18:10:54.660138] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-30T18:10:54.704971] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:10:54.705191] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-30T18:10:54.705240] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-30T18:10:54.705540] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-30T18:10:54.705601] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-30T18:10:55.115153] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:10:55.168321] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T18:10:55.176130] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-30T18:10:55.454380] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-30T18:10:56.231917] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T18:10:56.254365] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-30T18:10:56.566593] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T18:10:57.054372] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-30T18:10:57.854375] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-30T18:10:58.659360] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-30T18:10:58.666769] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-30T18:10:58.676089] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T18:10:59.000429] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-30T18:10:59.454389] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-30T18:11:00.232787] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T18:11:00.260843] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-30T18:11:00.266450] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T18:11:01.054411] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-30T18:11:01.854396] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-30T18:11:02.580846] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-30T18:11:02.654365] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-30T18:11:02.845621] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T18:11:03.177746] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-30T18:11:03.454374] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-30T18:11:04.254389] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-30T18:11:04.957477] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-30T18:11:05.054359] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-30T18:11:05.493546] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T18:11:05.615220] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-30T18:11:05.854409] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-30T18:11:06.654369] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-30T18:11:06.820837] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T18:11:06.903313] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T18:11:07.454349] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-30T18:11:08.254319] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-30T18:11:08.413342] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T18:11:08.636538] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T18:11:09.054385] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-30T18:11:09.578662] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T18:11:09.854374] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-30T18:11:10.654322] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-30T18:11:10.740970] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T18:11:11.196190] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T18:11:11.454413] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-30T18:11:12.243762] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T18:11:12.257525] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-30T18:11:13.054383] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-30T18:11:13.201561] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T18:11:13.205089] [INFO ] [REMOTE ] CVLG: Full fetch complete (20863 records). [2025-09-30T18:11:13.205197] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-30T18:11:13.629637] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-30T18:11:13.678231] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-30T18:11:13.678333] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-30T18:11:13.679088] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-30T18:11:13.679142] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-30T18:11:13.680281] [DEBUG] [LOCAL ] CVLG: Trimmed 20863 records to 15513 (keeping 200 days of data) [2025-09-30T18:11:13.781319] [DEBUG] [LOCAL ] CVLG: Primary data saved (15513 records). [2025-09-30T18:11:13.781469] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-30T18:11:13.781571] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 27.3s. Estimated remaining: 3h 47m 29s. Rate: 7.9 symbols/min [2025-09-30T18:11:13.861168] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-30T18:11:13.966068] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:14.028291] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-30T18:11:14.028784] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-09-30T18:11:14.217704] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:14.217981] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-30T18:11:14.218040] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-30T18:11:14.222105] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-30T18:11:14.222172] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-30T18:11:14.612034] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:14.654332] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-30T18:11:14.927402] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T18:11:14.938118] [INFO ] [REMOTE ] CVI: Full fetch complete (67322 records). [2025-09-30T18:11:14.938309] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-30T18:11:15.359406] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-30T18:11:15.359529] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-30T18:11:15.360488] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-30T18:11:15.360562] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-30T18:11:15.362170] [DEBUG] [LOCAL ] CVI: Trimmed 67322 records to 46463 (keeping 200 days of data) [2025-09-30T18:11:15.459036] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-30T18:11:15.664355] [DEBUG] [LOCAL ] CVI: Primary data saved (46463 records). [2025-09-30T18:11:15.664489] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-30T18:11:15.664571] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVI took 31.8s. Estimated remaining: 3h 47m 4s. Rate: 7.9 symbols/min [2025-09-30T18:11:15.854305] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:15.891905] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T18:11:15.921385] [DEBUG] [LOCAL ] CW: Loaded 22246 existing records from primary storage. [2025-09-30T18:11:15.921707] [INFO ] [MAIN ] CW: Loaded 22246 existing records. [2025-09-30T18:11:16.121898] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:16.122156] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-30T18:11:16.122214] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-30T18:11:16.122500] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-30T18:11:16.122561] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-30T18:11:16.259609] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-30T18:11:16.536514] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:16.747500] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-30T18:11:17.054422] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-30T18:11:17.780369] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-30T18:11:17.854365] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-30T18:11:18.485048] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-30T18:11:18.654410] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-30T18:11:19.339931] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-30T18:11:19.454394] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-30T18:11:20.150606] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-30T18:11:20.254368] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-30T18:11:21.071385] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-30T18:11:21.075535] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-30T18:11:21.364126] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-30T18:11:21.702820] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-30T18:11:21.854427] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-30T18:11:22.654386] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-30T18:11:23.061986] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-30T18:11:23.093822] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T18:11:23.454384] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-30T18:11:24.254401] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-30T18:11:24.808068] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T18:11:24.819851] [INFO ] [REMOTE ] CVNA: Full fetch complete (76676 records). [2025-09-30T18:11:24.820037] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-30T18:11:25.075633] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-30T18:11:25.256029] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-30T18:11:25.256171] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-30T18:11:25.257248] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-30T18:11:25.257355] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-30T18:11:25.259394] [DEBUG] [LOCAL ] CVNA: Trimmed 76676 records to 52980 (keeping 200 days of data) [2025-09-30T18:11:25.371733] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T18:11:25.623001] [DEBUG] [LOCAL ] CVNA: Primary data saved (52980 records). [2025-09-30T18:11:25.623159] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-30T18:11:25.623251] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVNA took 36.4s. Estimated remaining: 3h 47m 4s. Rate: 7.9 symbols/min [2025-09-30T18:11:25.815606] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:25.851632] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-30T18:11:25.862505] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-30T18:11:25.915060] [DEBUG] [LOCAL ] CWAN: Loaded 52393 existing records from primary storage. [2025-09-30T18:11:25.915424] [INFO ] [MAIN ] CWAN: Loaded 52393 existing records. [2025-09-30T18:11:26.108802] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:26.109010] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-30T18:11:26.109058] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-30T18:11:26.109347] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-30T18:11:26.109406] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-30T18:11:26.506611] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:26.654411] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-30T18:11:26.717192] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T18:11:26.908295] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T18:11:26.920328] [INFO ] [REMOTE ] CVS: Full fetch complete (77813 records). [2025-09-30T18:11:26.920463] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-30T18:11:27.338509] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-30T18:11:27.338604] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-30T18:11:27.339601] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-30T18:11:27.339730] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-30T18:11:27.341456] [DEBUG] [LOCAL ] CVS: Trimmed 77813 records to 53696 (keeping 200 days of data) [2025-09-30T18:11:27.458305] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-30T18:11:27.685761] [DEBUG] [LOCAL ] CVS: Primary data saved (53696 records). [2025-09-30T18:11:27.685940] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-30T18:11:27.686609] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVS took 33.5s. Estimated remaining: 3h 46m 39s. Rate: 8.0 symbols/min [2025-09-30T18:11:27.867398] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:27.912616] [DEBUG] [LOCAL ] CWEN: Loaded 44991 existing records from primary storage. [2025-09-30T18:11:27.912969] [INFO ] [MAIN ] CWEN: Loaded 44991 existing records. [2025-09-30T18:11:28.108403] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:28.108680] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-30T18:11:28.108789] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-30T18:11:28.109285] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-30T18:11:28.109348] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-30T18:11:28.261794] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-30T18:11:28.510015] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:28.540862] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T18:11:29.054365] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-30T18:11:29.470347] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T18:11:29.854356] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-30T18:11:29.911417] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-30T18:11:30.654351] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-30T18:11:30.823323] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T18:11:31.122727] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T18:11:31.454400] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-30T18:11:32.254401] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-30T18:11:32.946487] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T18:11:33.054388] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-30T18:11:33.279012] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-30T18:11:33.503065] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:11:33.854362] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-30T18:11:34.598972] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T18:11:34.654432] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-30T18:11:35.035219] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T18:11:35.454388] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-30T18:11:36.254399] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-30T18:11:37.054379] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-30T18:11:37.104011] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-30T18:11:37.854372] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-30T18:11:38.694493] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-30T18:11:38.700385] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-30T18:11:39.229005] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (3.77 seconds). [2025-09-30T18:11:39.454318] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-30T18:11:39.625364] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:11:39.714386] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T18:11:40.071991] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (3.02 seconds). [2025-09-30T18:11:40.254362] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-30T18:11:40.992286] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T18:11:41.054387] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-30T18:11:41.854330] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-30T18:11:41.887535] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:11:42.604357] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T18:11:42.654386] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-30T18:11:43.454381] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-30T18:11:44.101614] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T18:11:44.265876] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-30T18:11:44.272995] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-30T18:11:44.748843] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T18:11:44.753785] [INFO ] [REMOTE ] CW: Full fetch complete (33400 records). [2025-09-30T18:11:44.753943] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-30T18:11:45.059682] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-30T18:11:45.175543] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-30T18:11:45.175678] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-30T18:11:45.176425] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-30T18:11:45.176472] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-30T18:11:45.177775] [DEBUG] [LOCAL ] CW: Trimmed 33400 records to 22254 (keeping 200 days of data) [2025-09-30T18:11:45.330330] [DEBUG] [LOCAL ] CW: Primary data saved (22254 records). [2025-09-30T18:11:45.330540] [INFO ] [MAIN ] CW: Full history saved. [2025-09-30T18:11:45.330678] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CW took 29.7s. Estimated remaining: 3h 47m 3s. Rate: 7.9 symbols/min [2025-09-30T18:11:45.525297] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:45.557040] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T18:11:45.618861] [DEBUG] [LOCAL ] CWH: Loaded 51377 existing records from primary storage. [2025-09-30T18:11:45.619251] [INFO ] [MAIN ] CWH: Loaded 51377 existing records. [2025-09-30T18:11:45.819144] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:45.819388] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-30T18:11:45.819436] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-30T18:11:45.821093] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-30T18:11:45.821185] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-30T18:11:45.859527] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-30T18:11:46.252584] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:46.654403] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-30T18:11:47.454358] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-30T18:11:48.506094] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-30T18:11:48.517609] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-30T18:11:48.727805] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (3.67 seconds). [2025-09-30T18:11:49.054369] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-30T18:11:49.498835] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-09-30T18:11:49.854412] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-30T18:11:50.511605] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (3.06 seconds). [2025-09-30T18:11:50.654358] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-30T18:11:51.047212] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-30T18:11:51.414966] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-30T18:11:51.426885] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-09-30T18:11:51.427056] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-30T18:11:51.460811] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-30T18:11:51.870083] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-30T18:11:51.870323] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-30T18:11:51.871294] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-30T18:11:51.880535] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-30T18:11:51.900063] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-30T18:11:51.910773] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 53760 (keeping 200 days of data) [2025-09-30T18:11:52.254568] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-30T18:11:52.279610] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-09-30T18:11:52.279815] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-30T18:11:52.279909] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CVX took 38.5s. Estimated remaining: 3h 46m 54s. Rate: 7.9 symbols/min [2025-09-30T18:11:52.477477] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:52.533342] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T18:11:52.561525] [DEBUG] [LOCAL ] CWK: Loaded 49419 existing records from primary storage. [2025-09-30T18:11:52.561999] [INFO ] [MAIN ] CWK: Loaded 49419 existing records. [2025-09-30T18:11:52.783249] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:52.783617] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-30T18:11:52.783708] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-30T18:11:52.785396] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-30T18:11:52.785462] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-30T18:11:53.056736] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-30T18:11:53.190539] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:53.383792] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T18:11:53.756852] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T18:11:53.767205] [INFO ] [REMOTE ] CWEN: Full fetch complete (64518 records). [2025-09-30T18:11:53.767343] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-30T18:11:53.859630] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-30T18:11:54.196329] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-30T18:11:54.196507] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-30T18:11:54.197483] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-30T18:11:54.197613] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-30T18:11:54.199156] [DEBUG] [LOCAL ] CWEN: Trimmed 64518 records to 44975 (keeping 200 days of data) [2025-09-30T18:11:54.501501] [DEBUG] [LOCAL ] CWEN: Primary data saved (44975 records). [2025-09-30T18:11:54.501667] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-30T18:11:54.502768] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWEN took 26.8s. Estimated remaining: 3h 46m 30s. Rate: 7.9 symbols/min [2025-09-30T18:11:54.664858] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-30T18:11:54.704217] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:54.732505] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:11:54.767010] [DEBUG] [LOCAL ] CWT: Loaded 27821 existing records from primary storage. [2025-09-30T18:11:54.767364] [INFO ] [MAIN ] CWT: Loaded 27821 existing records. [2025-09-30T18:11:54.962285] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:54.962577] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-30T18:11:54.962627] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-30T18:11:54.963820] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-30T18:11:54.963882] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-30T18:11:55.349705] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:55.454368] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-30T18:11:55.775469] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-30T18:11:55.787215] [INFO ] [REMOTE ] CWAN: Full fetch complete (75114 records). [2025-09-30T18:11:55.787397] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-30T18:11:56.224795] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-30T18:11:56.224902] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-30T18:11:56.226193] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-30T18:11:56.226344] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-30T18:11:56.228428] [DEBUG] [LOCAL ] CWAN: Trimmed 75114 records to 52400 (keeping 200 days of data) [2025-09-30T18:11:56.278905] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-30T18:11:56.356184] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T18:11:56.622696] [DEBUG] [LOCAL ] CWAN: Primary data saved (52400 records). [2025-09-30T18:11:56.622873] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-30T18:11:56.623008] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWAN took 31.0s. Estimated remaining: 3h 46m 5s. Rate: 8.0 symbols/min [2025-09-30T18:11:56.854730] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:11:56.871752] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T18:11:56.927884] [DEBUG] [LOCAL ] CX: Loaded 52822 existing records from primary storage. [2025-09-30T18:11:56.928243] [INFO ] [MAIN ] CX: Loaded 52822 existing records. [2025-09-30T18:11:57.059524] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-30T18:11:57.125730] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:11:57.125933] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-30T18:11:57.125983] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-30T18:11:57.127528] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-30T18:11:57.127604] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-30T18:11:57.506538] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:11:57.854378] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-30T18:11:58.035182] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T18:11:58.435492] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:11:58.654366] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-30T18:11:59.454392] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-30T18:11:59.547726] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T18:12:00.250638] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T18:12:00.259539] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-30T18:12:01.054378] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-30T18:12:01.211247] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:12:01.859497] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-30T18:12:01.883892] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T18:12:02.611630] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T18:12:02.654391] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-30T18:12:03.454378] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-30T18:12:03.695124] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T18:12:04.260328] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-30T18:12:04.291516] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T18:12:05.054427] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-30T18:12:05.217101] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T18:12:05.604246] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T18:12:05.854367] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-30T18:12:06.352234] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T18:12:06.654407] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-30T18:12:07.253433] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T18:12:07.454367] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-30T18:12:08.183795] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T18:12:08.254341] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-30T18:12:09.054403] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-30T18:12:09.271804] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T18:12:09.800233] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T18:12:09.854379] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-30T18:12:10.666923] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-30T18:12:10.702136] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T18:12:10.820494] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T18:12:11.454394] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-30T18:12:12.254447] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-30T18:12:12.318173] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T18:12:13.054385] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-30T18:12:13.365747] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:12:13.386631] [INFO ] [REMOTE ] CWH: Full fetch complete (72930 records). [2025-09-30T18:12:13.387081] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-30T18:12:13.543513] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T18:12:13.867463] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-30T18:12:13.872818] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-30T18:12:13.872978] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-30T18:12:13.874240] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-30T18:12:13.874510] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-30T18:12:13.876765] [DEBUG] [LOCAL ] CWH: Trimmed 72930 records to 51357 (keeping 200 days of data) [2025-09-30T18:12:14.232224] [DEBUG] [LOCAL ] CWH: Primary data saved (51357 records). [2025-09-30T18:12:14.232459] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-30T18:12:14.232665] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWH took 28.9s. Estimated remaining: 3h 46m 29s. Rate: 7.9 symbols/min [2025-09-30T18:12:14.412781] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:12:14.465273] [DEBUG] [LOCAL ] CXE: Loaded 6813 existing records from primary storage. [2025-09-30T18:12:14.468335] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T18:12:14.468873] [INFO ] [MAIN ] CXE: Loaded 6813 existing records. [2025-09-30T18:12:14.659580] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-30T18:12:14.664289] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:12:14.665722] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-30T18:12:14.665813] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-30T18:12:14.666258] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-30T18:12:14.666357] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-30T18:12:15.057274] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:12:15.145198] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T18:12:15.454438] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-30T18:12:16.254348] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-30T18:12:16.447841] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T18:12:16.669176] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T18:12:17.054634] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-30T18:12:17.777180] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:12:17.799476] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T18:12:17.854379] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-30T18:12:18.654476] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-30T18:12:19.445353] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T18:12:19.456011] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-30T18:12:19.531945] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T18:12:20.254376] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-30T18:12:20.752819] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T18:12:20.759193] [INFO ] [REMOTE ] CWT: Full fetch complete (40375 records). [2025-09-30T18:12:20.759339] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-30T18:12:21.057714] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-30T18:12:21.111412] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T18:12:21.191702] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-30T18:12:21.191802] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-30T18:12:21.192937] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-30T18:12:21.193015] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-30T18:12:21.194090] [DEBUG] [LOCAL ] CWT: Trimmed 40375 records to 27865 (keeping 200 days of data) [2025-09-30T18:12:21.365096] [DEBUG] [LOCAL ] CWT: Primary data saved (27865 records). [2025-09-30T18:12:21.365240] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-30T18:12:21.365339] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWT took 26.9s. Estimated remaining: 3h 46m 20s. Rate: 7.9 symbols/min [2025-09-30T18:12:21.546865] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:12:21.554316] [DEBUG] [LOCAL ] CXH: Loaded 4413 existing records from primary storage. [2025-09-30T18:12:21.554667] [INFO ] [MAIN ] CXH: Loaded 4413 existing records. [2025-09-30T18:12:21.752977] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:12:21.753232] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-30T18:12:21.753303] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-30T18:12:21.753618] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-30T18:12:21.753750] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-30T18:12:21.862958] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-30T18:12:22.146254] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:12:22.654352] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-30T18:12:22.786546] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T18:12:22.829625] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T18:12:23.379615] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T18:12:23.454362] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-30T18:12:24.254397] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-30T18:12:24.718638] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-30T18:12:25.054423] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-30T18:12:25.254460] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T18:12:25.266315] [INFO ] [REMOTE ] CWK: Full fetch complete (70926 records). [2025-09-30T18:12:25.266475] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-30T18:12:25.667922] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-30T18:12:25.668021] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-30T18:12:25.669010] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-30T18:12:25.669080] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-30T18:12:25.670587] [DEBUG] [LOCAL ] CWK: Trimmed 70926 records to 49415 (keeping 200 days of data) [2025-09-30T18:12:25.874587] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-30T18:12:25.896705] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-30T18:12:25.980826] [DEBUG] [LOCAL ] CWK: Primary data saved (49415 records). [2025-09-30T18:12:25.981024] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-30T18:12:25.981234] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWK took 33.7s. Estimated remaining: 3h 46m 3s. Rate: 7.9 symbols/min [2025-09-30T18:12:26.156434] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:12:26.207548] [DEBUG] [LOCAL ] CXM: Loaded 47791 existing records from primary storage. [2025-09-30T18:12:26.208032] [INFO ] [MAIN ] CXM: Loaded 47791 existing records. [2025-09-30T18:12:26.359389] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-30T18:12:26.399478] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:12:26.399819] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-30T18:12:26.399877] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-30T18:12:26.401309] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-30T18:12:26.401373] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-30T18:12:26.659679] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-30T18:12:26.771377] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:12:27.454397] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-30T18:12:27.890235] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-30T18:12:28.254387] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-30T18:12:28.422690] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:12:28.743155] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T18:12:29.054356] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-30T18:12:29.854370] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-30T18:12:30.501087] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T18:12:30.654382] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-30T18:12:30.814220] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T18:12:31.067108] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-30T18:12:31.454378] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-30T18:12:32.254390] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-30T18:12:32.862559] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T18:12:32.998756] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T18:12:33.054365] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-30T18:12:33.854384] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-30T18:12:34.505274] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T18:12:34.654357] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-30T18:12:34.842388] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T18:12:35.385814] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T18:12:35.454363] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-30T18:12:36.254400] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-30T18:12:37.056854] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-30T18:12:37.063952] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T18:12:37.076488] [INFO ] [REMOTE ] CX: Full fetch complete (76388 records). [2025-09-30T18:12:37.076706] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-30T18:12:37.172186] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T18:12:37.506381] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-30T18:12:37.506497] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-30T18:12:37.507506] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-30T18:12:37.507610] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-30T18:12:37.509305] [DEBUG] [LOCAL ] CX: Trimmed 76388 records to 52828 (keeping 200 days of data) [2025-09-30T18:12:37.848080] [DEBUG] [LOCAL ] CX: Primary data saved (52828 records). [2025-09-30T18:12:37.848274] [INFO ] [MAIN ] CX: Full history saved. [2025-09-30T18:12:37.848400] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CX took 41.2s. Estimated remaining: 3h 46m 9s. Rate: 7.9 symbols/min [2025-09-30T18:12:37.860695] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-30T18:12:38.043479] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:12:38.076244] [DEBUG] [LOCAL ] CXT: Loaded 31002 existing records from primary storage. [2025-09-30T18:12:38.076521] [INFO ] [MAIN ] CXT: Loaded 31002 existing records. [2025-09-30T18:12:38.280443] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:12:38.280858] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-30T18:12:38.280917] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-30T18:12:38.282232] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-30T18:12:38.282296] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-30T18:12:38.659208] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-30T18:12:38.714878] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:12:38.747753] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T18:12:38.796505] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T18:12:38.798983] [INFO ] [REMOTE ] CXE: Full fetch complete (11914 records). [2025-09-30T18:12:38.799057] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-30T18:12:39.237258] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-30T18:12:39.237351] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-30T18:12:39.237707] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-30T18:12:39.237771] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-30T18:12:39.238472] [DEBUG] [LOCAL ] CXE: Trimmed 11914 records to 6726 (keeping 200 days of data) [2025-09-30T18:12:39.280736] [DEBUG] [LOCAL ] CXE: Primary data saved (6726 records). [2025-09-30T18:12:39.280875] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-30T18:12:39.280962] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CXE took 25.0s. Estimated remaining: 3h 45m 43s. Rate: 7.9 symbols/min [2025-09-30T18:12:39.459585] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-30T18:12:39.464196] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:12:39.516008] [DEBUG] [LOCAL ] CXW: Loaded 44141 existing records from primary storage. [2025-09-30T18:12:39.516366] [INFO ] [MAIN ] CXW: Loaded 44141 existing records. [2025-09-30T18:12:39.712960] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:12:39.720315] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-30T18:12:39.721432] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-30T18:12:39.721286] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T18:12:39.723752] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-30T18:12:39.724560] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-30T18:12:40.110347] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:12:40.254391] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-30T18:12:40.748612] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T18:12:40.914671] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-30T18:12:41.054393] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-30T18:12:41.734818] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T18:12:41.736465] [INFO ] [REMOTE ] CXH: Full fetch complete (5469 records). [2025-09-30T18:12:41.736546] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-30T18:12:41.859467] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-30T18:12:42.133523] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-30T18:12:42.133612] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-30T18:12:42.133798] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-30T18:12:42.133855] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-30T18:12:42.134255] [DEBUG] [LOCAL ] CXH: Trimmed 5469 records to 4412 (keeping 200 days of data) [2025-09-30T18:12:42.161457] [DEBUG] [LOCAL ] CXH: Primary data saved (4412 records). [2025-09-30T18:12:42.161596] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-30T18:12:42.161709] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXH took 20.8s. Estimated remaining: 3h 45m 21s. Rate: 8.0 symbols/min [2025-09-30T18:12:42.351003] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:12:42.380204] [DEBUG] [LOCAL ] CYD: Loaded 26601 existing records from primary storage. [2025-09-30T18:12:42.380492] [INFO ] [MAIN ] CYD: Loaded 26601 existing records. [2025-09-30T18:12:42.577594] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:12:42.577860] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-30T18:12:42.577909] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-30T18:12:42.579666] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-30T18:12:42.579730] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-30T18:12:42.659481] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-30T18:12:42.968810] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:12:43.454337] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-30T18:12:43.681198] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T18:12:44.183659] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T18:12:44.254361] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-30T18:12:44.384315] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T18:12:45.054359] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-30T18:12:45.854339] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-30T18:12:45.937263] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:12:46.394779] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T18:12:46.654361] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-30T18:12:47.258516] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T18:12:47.454376] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-30T18:12:47.564980] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T18:12:48.254357] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-30T18:12:48.996511] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T18:12:49.054329] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-30T18:12:49.096405] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T18:12:49.854367] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-30T18:12:50.407939] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T18:12:50.654350] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-30T18:12:51.454355] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-30T18:12:51.608512] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T18:12:51.717034] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T18:12:52.254381] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-30T18:12:52.976239] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T18:12:53.054368] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-30T18:12:53.540876] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T18:12:53.854364] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-30T18:12:54.463828] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T18:12:54.659480] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-30T18:12:54.674523] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-30T18:12:55.454425] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-30T18:12:56.254388] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-30T18:12:56.429577] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:12:56.473285] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T18:12:57.054423] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-30T18:12:57.812219] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-30T18:12:57.854583] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-30T18:12:58.545265] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T18:12:58.654390] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-30T18:12:59.223380] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T18:12:59.454448] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-30T18:13:00.254329] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-30T18:13:00.486615] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T18:13:01.049360] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T18:13:01.058962] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-30T18:13:01.606849] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:13:01.854374] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-30T18:13:02.642564] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T18:13:02.654312] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-30T18:13:03.244107] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T18:13:03.454370] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-30T18:13:04.254330] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-30T18:13:04.299263] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T18:13:04.947904] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T18:13:05.042462] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T18:13:05.054358] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-30T18:13:05.854377] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-30T18:13:06.654359] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-30T18:13:06.777925] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T18:13:06.788671] [INFO ] [REMOTE ] CXM: Full fetch complete (68834 records). [2025-09-30T18:13:06.788829] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-30T18:13:07.192329] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T18:13:07.241063] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-30T18:13:07.241166] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-30T18:13:07.242052] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-30T18:13:07.242121] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-30T18:13:07.244037] [DEBUG] [LOCAL ] CXM: Trimmed 68834 records to 47695 (keeping 200 days of data) [2025-09-30T18:13:07.454526] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-30T18:13:07.543537] [DEBUG] [LOCAL ] CXM: Primary data saved (47695 records). [2025-09-30T18:13:07.543757] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-30T18:13:07.543907] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXM took 41.6s. Estimated remaining: 3h 46m 8s. Rate: 7.9 symbols/min [2025-09-30T18:13:07.755768] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:07.801741] [DEBUG] [LOCAL ] CYH: Loaded 47561 existing records from primary storage. [2025-09-30T18:13:07.802088] [INFO ] [MAIN ] CYH: Loaded 47561 existing records. [2025-09-30T18:13:08.016953] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:08.017198] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-30T18:13:08.017248] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-30T18:13:08.018590] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-30T18:13:08.018680] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-30T18:13:08.257915] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-30T18:13:08.387897] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T18:13:08.475106] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:08.653275] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T18:13:09.054353] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-30T18:13:09.524344] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T18:13:09.531793] [INFO ] [REMOTE ] CXT: Full fetch complete (45363 records). [2025-09-30T18:13:09.531923] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-30T18:13:09.859518] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-30T18:13:09.938972] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-30T18:13:09.939095] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-30T18:13:09.939848] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-30T18:13:09.939944] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-30T18:13:09.941435] [DEBUG] [LOCAL ] CXT: Trimmed 45363 records to 30998 (keeping 200 days of data) [2025-09-30T18:13:10.136160] [DEBUG] [LOCAL ] CXT: Primary data saved (30998 records). [2025-09-30T18:13:10.136313] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-30T18:13:10.136405] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXT took 32.3s. Estimated remaining: 3h 45m 45s. Rate: 7.9 symbols/min [2025-09-30T18:13:10.318428] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:10.371667] [DEBUG] [LOCAL ] D: Loaded 53646 existing records from primary storage. [2025-09-30T18:13:10.372031] [INFO ] [MAIN ] D: Loaded 53646 existing records. [2025-09-30T18:13:10.567266] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:10.567488] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-30T18:13:10.567540] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-30T18:13:10.569193] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-30T18:13:10.569255] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-30T18:13:10.666871] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-30T18:13:11.018860] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:11.022443] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-30T18:13:11.173768] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T18:13:11.454372] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-30T18:13:12.254336] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-30T18:13:12.352518] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T18:13:12.474194] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T18:13:12.480931] [INFO ] [REMOTE ] CYD: Full fetch complete (32980 records). [2025-09-30T18:13:12.481033] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-30T18:13:12.879280] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-30T18:13:12.879386] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-30T18:13:12.879986] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-30T18:13:12.880052] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-30T18:13:12.881059] [DEBUG] [LOCAL ] CYD: Trimmed 32980 records to 26499 (keeping 200 days of data) [2025-09-30T18:13:13.046076] [DEBUG] [LOCAL ] CYD: Primary data saved (26499 records). [2025-09-30T18:13:13.046213] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-30T18:13:13.046296] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CYD took 30.9s. Estimated remaining: 3h 45m 23s. Rate: 7.9 symbols/min [2025-09-30T18:13:13.059613] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-30T18:13:13.221879] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:13.234977] [DEBUG] [LOCAL ] DAC: Loaded 12571 existing records from primary storage. [2025-09-30T18:13:13.235213] [INFO ] [MAIN ] DAC: Loaded 12571 existing records. [2025-09-30T18:13:13.420259] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:13.420537] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-30T18:13:13.420592] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-30T18:13:13.421122] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-30T18:13:13.421195] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-30T18:13:13.801999] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:13.832061] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T18:13:13.854334] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-30T18:13:14.654390] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-30T18:13:14.863065] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T18:13:14.877951] [INFO ] [REMOTE ] CXW: Full fetch complete (64879 records). [2025-09-30T18:13:14.878203] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-30T18:13:15.320773] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-30T18:13:15.320895] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-30T18:13:15.321977] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-30T18:13:15.322076] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-30T18:13:15.323778] [DEBUG] [LOCAL ] CXW: Trimmed 64879 records to 44024 (keeping 200 days of data) [2025-09-30T18:13:15.454719] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-30T18:13:15.458876] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T18:13:15.648799] [DEBUG] [LOCAL ] CXW: Primary data saved (44024 records). [2025-09-30T18:13:15.648946] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-30T18:13:15.649038] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CXW took 36.4s. Estimated remaining: 3h 45m 1s. Rate: 8.0 symbols/min [2025-09-30T18:13:15.827906] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:15.885076] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-30T18:13:15.885535] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-09-30T18:13:16.066743] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:16.067048] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-30T18:13:16.067099] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-30T18:13:16.069034] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-30T18:13:16.069103] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-30T18:13:16.283693] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-30T18:13:16.444397] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:16.488732] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T18:13:17.054370] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-30T18:13:17.537556] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-09-30T18:13:17.849886] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T18:13:17.859480] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-30T18:13:17.901089] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T18:13:18.654446] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-30T18:13:19.454417] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-30T18:13:20.058825] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T18:13:20.127499] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-30T18:13:20.254382] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-30T18:13:21.054364] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-30T18:13:21.346504] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T18:13:21.854335] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-30T18:13:22.039627] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:13:22.083481] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T18:13:22.654396] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-30T18:13:23.454425] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-30T18:13:23.499926] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T18:13:23.660704] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T18:13:24.254372] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-30T18:13:25.054327] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-30T18:13:25.240011] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T18:13:25.854357] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-30T18:13:26.033411] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T18:13:26.183905] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-30T18:13:26.654388] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-30T18:13:27.454338] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-30T18:13:27.540698] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T18:13:27.673290] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T18:13:28.254420] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-30T18:13:29.054433] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-30T18:13:29.619109] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T18:13:29.807402] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T18:13:29.854316] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-30T18:13:30.515833] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T18:13:30.654379] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-30T18:13:31.386536] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T18:13:31.454327] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-30T18:13:31.572229] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T18:13:32.254371] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-30T18:13:33.054360] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-30T18:13:33.215839] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T18:13:33.535012] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-30T18:13:33.854384] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-30T18:13:34.654367] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-30T18:13:34.909271] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T18:13:35.287392] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T18:13:35.454354] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-30T18:13:36.254366] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-30T18:13:36.867569] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-30T18:13:36.992014] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T18:13:37.001933] [INFO ] [REMOTE ] CYH: Full fetch complete (70065 records). [2025-09-30T18:13:37.002110] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-30T18:13:37.066476] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-30T18:13:37.428282] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-30T18:13:37.428387] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-30T18:13:37.429379] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-30T18:13:37.429461] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-30T18:13:37.431345] [DEBUG] [LOCAL ] CYH: Trimmed 70065 records to 47503 (keeping 200 days of data) [2025-09-30T18:13:37.713752] [DEBUG] [LOCAL ] CYH: Primary data saved (47503 records). [2025-09-30T18:13:37.713908] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-30T18:13:37.714002] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. CYH took 30.2s. Estimated remaining: 3h 45m 38s. Rate: 7.9 symbols/min [2025-09-30T18:13:37.855214] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-30T18:13:37.936686] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:37.947538] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T18:13:37.983667] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T18:13:38.036823] [DEBUG] [LOCAL ] DAN: Loaded 48995 existing records from primary storage. [2025-09-30T18:13:38.037168] [INFO ] [MAIN ] DAN: Loaded 48995 existing records. [2025-09-30T18:13:38.227816] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:38.228043] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-30T18:13:38.228091] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-30T18:13:38.229441] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-30T18:13:38.229502] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-30T18:13:38.611264] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:38.654344] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-30T18:13:39.454387] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-30T18:13:39.826028] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-30T18:13:40.254378] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-30T18:13:40.377737] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T18:13:40.395749] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T18:13:40.398605] [INFO ] [REMOTE ] DAC: Full fetch complete (19532 records). [2025-09-30T18:13:40.398710] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-30T18:13:40.804451] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-30T18:13:40.804530] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-30T18:13:40.805046] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-30T18:13:40.805112] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-30T18:13:40.805776] [DEBUG] [LOCAL ] DAC: Trimmed 19532 records to 12536 (keeping 200 days of data) [2025-09-30T18:13:40.885284] [DEBUG] [LOCAL ] DAC: Primary data saved (12536 records). [2025-09-30T18:13:40.885425] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-30T18:13:40.885510] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. DAC took 27.8s. Estimated remaining: 3h 45m 17s. Rate: 7.9 symbols/min [2025-09-30T18:13:41.058199] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-30T18:13:41.079568] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:41.101154] [DEBUG] [LOCAL ] DAO: Loaded 21017 existing records from primary storage. [2025-09-30T18:13:41.101431] [INFO ] [MAIN ] DAO: Loaded 21017 existing records. [2025-09-30T18:13:41.295309] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:41.295550] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-30T18:13:41.295604] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-30T18:13:41.296286] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-30T18:13:41.296355] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-30T18:13:41.696576] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:41.854362] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-30T18:13:42.189514] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:13:42.566453] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T18:13:42.654359] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-30T18:13:43.454353] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-30T18:13:43.651506] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T18:13:43.845096] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T18:13:44.254351] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-30T18:13:45.056612] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-30T18:13:45.061863] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T18:13:45.318752] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T18:13:45.854382] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-30T18:13:46.654371] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-30T18:13:46.872427] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T18:13:47.062175] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T18:13:47.454367] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-30T18:13:48.254364] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-30T18:13:48.521553] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T18:13:48.858965] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-30T18:13:49.054366] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-30T18:13:49.543466] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T18:13:49.854336] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-30T18:13:49.893265] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-30T18:13:50.654412] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-30T18:13:51.454363] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-30T18:13:51.809997] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T18:13:51.823984] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-09-30T18:13:51.824142] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-30T18:13:52.253950] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-30T18:13:52.254166] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-30T18:13:52.255352] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-30T18:13:52.254348] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-30T18:13:52.255606] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-30T18:13:52.258588] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 53753 (keeping 200 days of data) [2025-09-30T18:13:52.391784] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T18:13:52.651926] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-09-30T18:13:52.652114] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-30T18:13:52.652257] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. DAL took 37.0s. Estimated remaining: 3h 45m 22s. Rate: 7.9 symbols/min [2025-09-30T18:13:52.849599] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:52.898501] [DEBUG] [LOCAL ] DAR: Loaded 51851 existing records from primary storage. [2025-09-30T18:13:52.898883] [INFO ] [MAIN ] DAR: Loaded 51851 existing records. [2025-09-30T18:13:53.058916] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-30T18:13:53.101801] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:53.102340] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-30T18:13:53.102487] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-30T18:13:53.105089] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-30T18:13:53.105161] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-30T18:13:53.363366] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:13:53.409120] [INFO ] [REMOTE ] D: Full fetch complete (77655 records). [2025-09-30T18:13:53.474592] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-30T18:13:53.573582] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T18:13:53.740802] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:53.862518] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-30T18:13:54.058865] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-30T18:13:54.058958] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-30T18:13:54.059977] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-30T18:13:54.060066] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-30T18:13:54.061814] [DEBUG] [LOCAL ] D: Trimmed 77655 records to 53645 (keeping 200 days of data) [2025-09-30T18:13:54.439594] [DEBUG] [LOCAL ] D: Primary data saved (53645 records). [2025-09-30T18:13:54.439771] [INFO ] [MAIN ] D: Full history saved. [2025-09-30T18:13:54.439924] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. D took 44.3s. Estimated remaining: 3h 44m 57s. Rate: 7.9 symbols/min [2025-09-30T18:13:54.631392] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:13:54.655274] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-30T18:13:54.674250] [DEBUG] [LOCAL ] DAVA: Loaded 40816 existing records from primary storage. [2025-09-30T18:13:54.674596] [INFO ] [MAIN ] DAVA: Loaded 40816 existing records. [2025-09-30T18:13:54.874555] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:13:54.875258] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-30T18:13:54.875325] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-30T18:13:54.887144] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-30T18:13:54.903126] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-30T18:13:54.981908] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T18:13:55.333894] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:13:55.454416] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-30T18:13:55.643369] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T18:13:55.679615] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T18:13:56.254405] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-30T18:13:57.054331] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-30T18:13:57.106436] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T18:13:57.601235] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T18:13:57.854374] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-30T18:13:57.958032] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T18:13:58.654383] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-30T18:13:59.454403] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-30T18:13:59.572113] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T18:14:00.059705] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T18:14:00.254356] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-30T18:14:00.483322] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T18:14:01.054374] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-30T18:14:01.854389] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-30T18:14:02.077161] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T18:14:02.654391] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-30T18:14:02.940690] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T18:14:02.985988] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T18:14:02.991234] [INFO ] [REMOTE ] DAO: Full fetch complete (32765 records). [2025-09-30T18:14:02.991401] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-30T18:14:02.992158] [FATAL] [VALIDATOR ] DAO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:14:02.992266] [FATAL] [MAIN ] DAO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:14:02.992318] [WARN ] [MAIN ] DAO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:14:02.992372] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-30T18:14:02.992468] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-09-30T18:14:02.992555] [INFO ] [LOCAL ] DAO: Starting deletion of derivative data. [2025-09-30T18:14:02.992983] [DEBUG] [LOCAL ] DAO: Deleted derivative data file. [2025-09-30T18:14:02.993140] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAO took 22.1s. Estimated remaining: 3h 44m 52s. Rate: 7.9 symbols/min [2025-09-30T18:14:03.182348] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:03.233607] [DEBUG] [LOCAL ] DAY: Loaded 49690 existing records from primary storage. [2025-09-30T18:14:03.233978] [INFO ] [MAIN ] DAY: Loaded 49690 existing records. [2025-09-30T18:14:03.433437] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:14:03.433710] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-30T18:14:03.433780] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-30T18:14:03.435254] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-30T18:14:03.435354] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-30T18:14:03.459544] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-30T18:14:03.842504] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:04.254133] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T18:14:04.261191] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-30T18:14:05.054324] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-30T18:14:05.331807] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T18:14:05.342620] [INFO ] [REMOTE ] DAN: Full fetch complete (70813 records). [2025-09-30T18:14:05.342803] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-30T18:14:05.777333] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-30T18:14:05.777471] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-30T18:14:05.778429] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-30T18:14:05.778497] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-30T18:14:05.780027] [DEBUG] [LOCAL ] DAN: Trimmed 70813 records to 48978 (keeping 200 days of data) [2025-09-30T18:14:05.876242] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-30T18:14:06.156374] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T18:14:06.152934] [DEBUG] [LOCAL ] DAN: Primary data saved (48978 records). [2025-09-30T18:14:06.168763] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-30T18:14:06.169117] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAN took 28.5s. Estimated remaining: 3h 44m 31s. Rate: 7.9 symbols/min [2025-09-30T18:14:06.379588] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T18:14:06.385975] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:06.452067] [DEBUG] [LOCAL ] DB: Loaded 52583 existing records from primary storage. [2025-09-30T18:14:06.452561] [INFO ] [MAIN ] DB: Loaded 52583 existing records. [2025-09-30T18:14:06.648931] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:14:06.649181] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-30T18:14:06.649246] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-30T18:14:06.650793] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-30T18:14:06.650856] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-30T18:14:06.662386] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-30T18:14:07.050776] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:07.454417] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-30T18:14:07.543868] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:14:07.708832] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T18:14:08.254404] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-30T18:14:09.054324] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-30T18:14:09.225607] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T18:14:09.599313] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T18:14:09.854390] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-30T18:14:10.495029] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T18:14:10.654391] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-30T18:14:11.454362] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-30T18:14:11.519676] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:14:12.070343] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T18:14:12.254424] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-30T18:14:13.054366] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-30T18:14:13.232600] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T18:14:13.769585] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:14:13.854363] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-30T18:14:14.470347] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T18:14:14.654362] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-30T18:14:15.464312] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-30T18:14:15.469561] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T18:14:16.254387] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-30T18:14:16.479941] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T18:14:17.054368] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-30T18:14:17.193729] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T18:14:17.528982] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T18:14:17.854383] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-30T18:14:18.654344] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-30T18:14:18.693130] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:14:19.454378] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-30T18:14:19.498439] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T18:14:20.254418] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-30T18:14:20.409941] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:14:21.054348] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-30T18:14:21.161277] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T18:14:21.594591] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:14:21.854404] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-30T18:14:22.654403] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-30T18:14:22.877108] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T18:14:23.454391] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-30T18:14:23.826183] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T18:14:23.838035] [INFO ] [REMOTE ] DAR: Full fetch complete (74568 records). [2025-09-30T18:14:23.838282] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-30T18:14:24.269407] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-30T18:14:24.269530] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-30T18:14:24.269934] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-30T18:14:24.272048] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-30T18:14:24.272289] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-30T18:14:24.273955] [DEBUG] [LOCAL ] DAR: Trimmed 74568 records to 51847 (keeping 200 days of data) [2025-09-30T18:14:24.575439] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-30T18:14:24.624476] [INFO ] [REMOTE ] DAVA: Full fetch complete (55798 records). [2025-09-30T18:14:24.640280] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-30T18:14:24.963757] [DEBUG] [LOCAL ] DAR: Primary data saved (51847 records). [2025-09-30T18:14:24.977261] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-30T18:14:25.004788] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAR took 32.4s. Estimated remaining: 3h 44m 58s. Rate: 7.9 symbols/min [2025-09-30T18:14:25.179892] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-30T18:14:25.202984] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-30T18:14:25.222465] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-30T18:14:25.222762] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-30T18:14:25.333877] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:25.337136] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T18:14:25.337360] [DEBUG] [LOCAL ] DAVA: Trimmed 55798 records to 40904 (keeping 200 days of data) [2025-09-30T18:14:25.335015] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-30T18:14:25.337511] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-30T18:14:25.338346] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-30T18:14:25.338697] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-30T18:14:25.338769] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-30T18:14:25.338804] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-30T18:14:25.535729] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-30T18:14:25.921463] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:25.923998] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-30T18:14:26.061351] [DEBUG] [LOCAL ] DAVA: Primary data saved (40904 records). [2025-09-30T18:14:26.061481] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-30T18:14:26.061563] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAVA took 31.6s. Estimated remaining: 3h 44m 31s. Rate: 7.9 symbols/min [2025-09-30T18:14:26.246326] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:26.246704] [DEBUG] [LOCAL ] DBI: No existing data file found in primary storage. [2025-09-30T18:14:26.246801] [WARN ] [MAIN ] DBI: No existing data found, performing full refresh instead. [2025-09-30T18:14:26.246951] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-30T18:14:26.247014] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-30T18:14:26.247149] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-09-30T18:14:26.247205] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-30T18:14:26.646588] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:26.669327] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-30T18:14:26.666364] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-30T18:14:26.722511] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T18:14:26.884765] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:14:27.454338] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-30T18:14:28.254376] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-30T18:14:28.463985] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T18:14:29.054384] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-30T18:14:29.265111] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T18:14:29.854415] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-30T18:14:30.187728] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T18:14:30.248534] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T18:14:30.654399] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-30T18:14:31.454354] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-30T18:14:31.744300] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T18:14:31.754717] [INFO ] [REMOTE ] DAY: Full fetch complete (71619 records). [2025-09-30T18:14:31.754892] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-30T18:14:32.213141] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-30T18:14:32.213388] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-30T18:14:32.214349] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-30T18:14:32.214484] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-30T18:14:32.216285] [DEBUG] [LOCAL ] DAY: Trimmed 71619 records to 49614 (keeping 200 days of data) [2025-09-30T18:14:32.276954] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-30T18:14:32.338447] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T18:14:32.570053] [DEBUG] [LOCAL ] DAY: Primary data saved (49614 records). [2025-09-30T18:14:32.570199] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-30T18:14:32.571264] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DAY took 29.6s. Estimated remaining: 3h 44m 20s. Rate: 7.9 symbols/min [2025-09-30T18:14:32.764022] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:32.776902] [DEBUG] [LOCAL ] DBL: Loaded 9252 existing records from primary storage. [2025-09-30T18:14:32.777146] [INFO ] [MAIN ] DBL: Loaded 9252 existing records. [2025-09-30T18:14:32.981828] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:14:32.982373] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-30T18:14:32.982548] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-30T18:14:32.991246] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-30T18:14:32.991552] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T18:14:32.991699] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-30T18:14:33.070305] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-30T18:14:33.116022] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T18:14:33.431821] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:33.854369] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-30T18:14:34.638525] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T18:14:34.654317] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-30T18:14:34.855140] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T18:14:35.136443] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T18:14:35.454377] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-30T18:14:36.254361] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-30T18:14:37.046901] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T18:14:37.054301] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-30T18:14:37.116974] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T18:14:37.847398] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-30T18:14:37.854294] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-30T18:14:38.654369] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-30T18:14:38.915321] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T18:14:39.410083] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T18:14:39.454355] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-30T18:14:40.254378] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-30T18:14:40.877032] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T18:14:41.054374] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-30T18:14:41.287975] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T18:14:41.839227] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T18:14:41.854330] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-30T18:14:42.654360] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-30T18:14:42.891701] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T18:14:43.318879] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T18:14:43.454398] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-30T18:14:44.254365] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-30T18:14:45.055911] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-30T18:14:45.058897] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T18:14:45.391045] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T18:14:45.854331] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-30T18:14:46.123624] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T18:14:46.654362] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-30T18:14:47.458966] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-30T18:14:47.466036] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T18:14:47.554292] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T18:14:48.254395] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-30T18:14:48.286828] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T18:14:49.054384] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-30T18:14:49.854375] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-30T18:14:49.901319] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T18:14:49.962493] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T18:14:50.654401] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-30T18:14:51.454329] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-30T18:14:51.741001] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T18:14:51.916598] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T18:14:52.254368] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-30T18:14:52.304558] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T18:14:53.054352] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-30T18:14:53.246537] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T18:14:53.249148] [INFO ] [REMOTE ] DBL: Full fetch complete (12592 records). [2025-09-30T18:14:53.249266] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-30T18:14:53.646476] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-30T18:14:53.646562] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-30T18:14:53.646934] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-30T18:14:53.646999] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-30T18:14:53.647531] [DEBUG] [LOCAL ] DBL: Trimmed 12592 records to 9317 (keeping 200 days of data) [2025-09-30T18:14:53.708844] [DEBUG] [LOCAL ] DBL: Primary data saved (9317 records). [2025-09-30T18:14:53.708992] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-30T18:14:53.709078] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DBL took 21.1s. Estimated remaining: 3h 44m 53s. Rate: 7.9 symbols/min [2025-09-30T18:14:53.863513] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-30T18:14:53.901199] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:53.901535] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-09-30T18:14:53.901582] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-09-30T18:14:53.901771] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-30T18:14:53.901815] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-30T18:14:53.901898] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-09-30T18:14:53.901957] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-30T18:14:54.298093] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:54.585015] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:14:54.654407] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-30T18:14:55.454365] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-30T18:14:56.114887] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-30T18:14:56.126340] [INFO ] [REMOTE ] DB: Full fetch complete (74494 records). [2025-09-30T18:14:56.126504] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-30T18:14:56.255540] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-30T18:14:56.533432] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T18:14:56.619690] [INFO ] [REMOTE ] DBI: Full fetch complete (65971 records). [2025-09-30T18:14:56.623668] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-30T18:14:56.624014] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-30T18:14:56.624222] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-30T18:14:56.625268] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-30T18:14:56.659710] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-30T18:14:56.741705] [DEBUG] [LOCAL ] DB: Trimmed 74494 records to 52581 (keeping 200 days of data) [2025-09-30T18:14:57.167147] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-30T18:14:57.169492] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-30T18:14:57.170871] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-30T18:14:57.171323] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-30T18:14:57.181124] [DEBUG] [LOCAL ] DBI: Trimmed 65971 records to 44637 (keeping 200 days of data) [2025-09-30T18:14:57.440900] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T18:14:57.455752] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-30T18:14:57.453171] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T18:14:57.473792] [INFO ] [REMOTE ] DBD: Full fetch complete (30729 records). [2025-09-30T18:14:57.474978] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-30T18:14:57.478248] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:14:57.478861] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:14:57.479554] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:14:57.480955] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-30T18:14:57.481719] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-30T18:14:57.482948] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-30T18:14:57.484726] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-30T18:14:57.485136] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DBD took 32.5s. Estimated remaining: 3h 44m 34s. Rate: 7.9 symbols/min [2025-09-30T18:14:57.788826] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:57.789860] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-09-30T18:14:57.789940] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-09-30T18:14:57.824413] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-30T18:14:57.830586] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-30T18:14:57.849334] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-09-30T18:14:57.850355] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-30T18:14:58.291825] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:14:58.296603] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-30T18:14:58.300871] [DEBUG] [LOCAL ] DBI: Primary data saved (44637 records). [2025-09-30T18:14:58.301799] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-30T18:14:58.303121] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBI took 32.2s. Estimated remaining: 3h 44m 6s. Rate: 7.9 symbols/min [2025-09-30T18:14:58.420177] [DEBUG] [LOCAL ] DB: Primary data saved (52581 records). [2025-09-30T18:14:58.420418] [INFO ] [MAIN ] DB: Full history saved. [2025-09-30T18:14:58.420562] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DB took 52.3s. Estimated remaining: 3h 43m 36s. Rate: 7.9 symbols/min [2025-09-30T18:14:58.616846] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:58.707007] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:14:58.713771] [DEBUG] [LOCAL ] DCO: Loaded 13831 existing records from primary storage. [2025-09-30T18:14:58.714063] [INFO ] [MAIN ] DCO: Loaded 13831 existing records. [2025-09-30T18:14:58.957420] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:14:58.958008] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-30T18:14:58.958091] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-30T18:14:58.959415] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-30T18:14:58.959533] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-30T18:14:59.122403] [DEBUG] [LOCAL ] DD: Loaded 52829 existing records from primary storage. [2025-09-30T18:14:59.150256] [INFO ] [MAIN ] DD: Loaded 52829 existing records. [2025-09-30T18:14:59.758203] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:14:59.764827] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-30T18:14:59.767520] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-30T18:14:59.789275] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-30T18:14:59.823332] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-30T18:14:59.829302] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-30T18:14:59.835751] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-30T18:15:00.017835] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:00.037886] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-30T18:15:00.168235] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T18:15:00.265446] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-30T18:15:00.406035] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:00.982639] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T18:15:01.054357] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-30T18:15:01.497830] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:15:01.854373] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-30T18:15:01.930855] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T18:15:02.056714] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T18:15:02.654396] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-30T18:15:03.454385] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-30T18:15:03.569178] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T18:15:03.697136] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T18:15:04.097225] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T18:15:04.254423] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-30T18:15:05.054394] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-30T18:15:05.854403] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-30T18:15:05.880639] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T18:15:05.914540] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T18:15:06.654408] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-30T18:15:07.374704] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:15:07.454404] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-30T18:15:08.254365] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-30T18:15:08.762736] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T18:15:08.999605] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T18:15:09.054341] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-30T18:15:09.854361] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-30T18:15:10.089662] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T18:15:10.634381] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T18:15:10.654327] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-30T18:15:10.967088] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T18:15:11.454363] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-30T18:15:12.254391] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-30T18:15:12.538837] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:15:12.540192] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T18:15:13.054372] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-30T18:15:13.843002] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T18:15:13.854587] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-30T18:15:14.020859] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T18:15:14.654372] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-30T18:15:15.454369] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-30T18:15:15.487403] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T18:15:16.058336] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T18:15:16.254386] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-30T18:15:17.039778] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T18:15:17.054313] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-30T18:15:17.313086] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T18:15:17.854387] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-30T18:15:18.654362] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-30T18:15:18.826286] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:15:19.354373] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T18:15:19.454423] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-30T18:15:20.254387] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-30T18:15:20.717263] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-30T18:15:21.054338] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-30T18:15:21.322164] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T18:15:21.573115] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-30T18:15:21.854355] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-30T18:15:22.622707] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T18:15:22.654337] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-30T18:15:23.454408] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-30T18:15:24.157559] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T18:15:24.168389] [INFO ] [REMOTE ] DBRG: Full fetch complete (72265 records). [2025-09-30T18:15:24.168578] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-30T18:15:24.263839] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-30T18:15:24.676118] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-30T18:15:24.676244] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-30T18:15:24.677387] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-30T18:15:24.677515] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-30T18:15:24.702582] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-09-30T18:15:24.711194] [DEBUG] [LOCAL ] DBRG: Trimmed 72265 records to 49722 (keeping 200 days of data) [2025-09-30T18:15:24.712847] [INFO ] [REMOTE ] DCI: Full fetch complete (54012 records). [2025-09-30T18:15:24.712983] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-30T18:15:25.243313] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-30T18:15:25.243696] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-30T18:15:25.245133] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-30T18:15:25.245594] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-30T18:15:25.252075] [DEBUG] [LOCAL ] DCI: Trimmed 54012 records to 37357 (keeping 200 days of data) [2025-09-30T18:15:25.690355] [DEBUG] [LOCAL ] DCI: Primary data saved (37357 records). [2025-09-30T18:15:25.692867] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-30T18:15:25.693361] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DCI took 28.2s. Estimated remaining: 3h 44m 28s. Rate: 7.9 symbols/min [2025-09-30T18:15:25.801953] [DEBUG] [LOCAL ] DBRG: Primary data saved (49722 records). [2025-09-30T18:15:25.802171] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-30T18:15:25.812844] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DBRG took 32.1s. Estimated remaining: 3h 43m 58s. Rate: 7.9 symbols/min [2025-09-30T18:15:25.857675] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T18:15:25.920707] [INFO ] [REMOTE ] DCO: Full fetch complete (19277 records). [2025-09-30T18:15:25.930078] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-30T18:15:25.948433] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-30T18:15:25.962580] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:15:25.989365] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-30T18:15:26.341472] [DEBUG] [LOCAL ] DDD: Loaded 50893 existing records from primary storage. [2025-09-30T18:15:26.364452] [INFO ] [MAIN ] DDD: Loaded 50893 existing records. [2025-09-30T18:15:26.538578] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-30T18:15:26.538848] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-30T18:15:26.539420] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-30T18:15:26.539862] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-30T18:15:26.556739] [DEBUG] [LOCAL ] DCO: Trimmed 19277 records to 13877 (keeping 200 days of data) [2025-09-30T18:15:26.724867] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:15:26.726299] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-30T18:15:26.727786] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-30T18:15:26.731508] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-30T18:15:26.731592] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-30T18:15:26.969006] [DEBUG] [LOCAL ] DCO: Primary data saved (13877 records). [2025-09-30T18:15:26.979630] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-30T18:15:27.013049] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCO took 28.7s. Estimated remaining: 3h 43m 31s. Rate: 7.9 symbols/min [2025-09-30T18:15:27.173884] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:27.174265] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-30T18:15:29.284369] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-30T18:15:29.295432] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-30T18:15:29.420146] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (3.43 seconds). [2025-09-30T18:15:29.432299] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-30T18:15:31.218723] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-30T18:15:31.230287] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-30T18:15:31.417971] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T18:15:31.430074] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-30T18:15:32.832045] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T18:15:32.842193] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-30T18:15:33.916216] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-30T18:15:33.929461] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-30T18:15:34.839038] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-30T18:15:34.850594] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-30T18:15:35.965732] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T18:15:35.978030] [INFO ] [REMOTE ] DD: Full fetch complete (76303 records). [2025-09-30T18:15:35.978317] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-30T18:15:36.402436] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-30T18:15:36.402552] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-30T18:15:36.403686] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-30T18:15:36.403775] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-30T18:15:36.405532] [DEBUG] [LOCAL ] DD: Trimmed 76303 records to 52829 (keeping 200 days of data) [2025-09-30T18:15:36.667357] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T18:15:36.680710] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-30T18:15:36.794861] [DEBUG] [LOCAL ] DD: Primary data saved (52829 records). [2025-09-30T18:15:36.795013] [INFO ] [MAIN ] DD: Full history saved. [2025-09-30T18:15:36.795095] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 38.4s. Estimated remaining: 3h 43m 30s. Rate: 7.9 symbols/min [2025-09-30T18:15:38.603192] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T18:15:38.615461] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-30T18:15:40.529058] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-30T18:15:40.539882] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-30T18:15:43.190761] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-30T18:15:43.202811] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-30T18:15:45.111427] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T18:15:45.122996] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-30T18:15:47.219868] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T18:15:47.231366] [INFO ] [REMOTE ] DDD: Full fetch complete (73700 records). [2025-09-30T18:15:47.231540] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-30T18:15:47.648732] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-30T18:15:47.648829] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-30T18:15:47.649694] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-30T18:15:47.649801] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-30T18:15:47.651447] [DEBUG] [LOCAL ] DDD: Trimmed 73700 records to 50892 (keeping 200 days of data) [2025-09-30T18:15:47.960522] [DEBUG] [LOCAL ] DDD: Primary data saved (50892 records). [2025-09-30T18:15:47.960700] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-30T18:15:47.960804] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 22.3s. Estimated remaining: 3h 43m 33s. Rate: 7.9 symbols/min [2025-09-30T18:15:48.689078] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:15:48.708561] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:15:48.750860] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:15:48.752123] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:15:48.759376] [DEBUG] [LOCAL ] DDT: Loaded 2094 existing records from primary storage. [2025-09-30T18:15:48.759999] [INFO ] [MAIN ] DDT: Loaded 2094 existing records. [2025-09-30T18:15:48.868884] [DEBUG] [LOCAL ] DDS: Loaded 13100 existing records from primary storage. [2025-09-30T18:15:48.897015] [INFO ] [MAIN ] DDS: Loaded 13100 existing records. [2025-09-30T18:15:49.064752] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:15:49.081446] [DEBUG] [LOCAL ] DDL: Loaded 36597 existing records from primary storage. [2025-09-30T18:15:49.091364] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-30T18:15:49.108363] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-30T18:15:49.119016] [INFO ] [MAIN ] DDL: Loaded 36597 existing records. [2025-09-30T18:15:49.132401] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-30T18:15:49.197682] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-30T18:15:49.245702] [DEBUG] [LOCAL ] DE: Loaded 47576 existing records from primary storage. [2025-09-30T18:15:49.321405] [INFO ] [MAIN ] DE: Loaded 47576 existing records. [2025-09-30T18:15:49.439568] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:15:49.520364] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-30T18:15:49.599982] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-30T18:15:49.657247] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-30T18:15:49.685937] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:15:49.697138] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-30T18:15:49.691740] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-30T18:15:49.741462] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-30T18:15:49.894397] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-30T18:15:49.898671] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-30T18:15:49.953750] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:15:49.959163] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-30T18:15:49.968664] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-30T18:15:50.019210] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-30T18:15:50.092047] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-30T18:15:50.906277] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:50.939910] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-30T18:15:51.143056] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:51.232264] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-30T18:15:51.231953] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:51.288825] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-30T18:15:51.425732] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:51.426153] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-30T18:15:51.591229] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T18:15:51.592723] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-30T18:15:51.926320] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-30T18:15:51.927668] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-30T18:15:52.383834] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-30T18:15:52.386066] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-30T18:15:52.463170] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T18:15:52.467082] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-30T18:15:52.635535] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T18:15:52.645743] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-30T18:15:52.696995] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-30T18:15:52.698780] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-30T18:15:52.984040] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T18:15:52.999240] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-30T18:15:53.128976] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T18:15:53.131895] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-30T18:15:53.146110] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T18:15:53.153185] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-30T18:15:53.601596] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-30T18:15:53.603210] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-30T18:15:53.922559] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-30T18:15:53.929945] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-30T18:15:54.051479] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T18:15:54.052987] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-30T18:15:54.140425] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T18:15:54.143759] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-30T18:15:54.437865] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T18:15:54.451389] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-30T18:15:54.525687] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T18:15:54.527333] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-30T18:15:54.964368] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T18:15:54.965492] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-30T18:15:55.148904] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T18:15:55.153332] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-30T18:15:55.245181] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:15:55.253110] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-30T18:15:55.393277] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-30T18:15:55.394298] [INFO ] [REMOTE ] DDT: Full fetch complete (2907 records). [2025-09-30T18:15:55.394374] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-30T18:15:55.816380] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-30T18:15:55.816530] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-30T18:15:55.816783] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-30T18:15:55.816990] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-30T18:15:55.817510] [DEBUG] [LOCAL ] DDT: Trimmed 2907 records to 2083 (keeping 200 days of data) [2025-09-30T18:15:55.831581] [DEBUG] [LOCAL ] DDT: Primary data saved (2083 records). [2025-09-30T18:15:55.831703] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-30T18:15:55.831929] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 7.9s. Estimated remaining: 3h 43m 27s. Rate: 7.9 symbols/min [2025-09-30T18:15:55.957552] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T18:15:56.037042] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-30T18:15:56.041797] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:15:56.075624] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T18:15:56.085776] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-30T18:15:56.120572] [DEBUG] [LOCAL ] DEA: Loaded 40957 existing records from primary storage. [2025-09-30T18:15:56.120902] [INFO ] [MAIN ] DEA: Loaded 40957 existing records. [2025-09-30T18:15:56.314433] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:15:56.314744] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-30T18:15:56.314836] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-30T18:15:56.315460] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-30T18:15:56.315520] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-30T18:15:56.657077] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T18:15:56.751533] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-30T18:15:56.751137] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:15:56.752668] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-30T18:15:56.764449] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T18:15:57.054412] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-30T18:15:57.722839] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T18:15:57.854384] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-30T18:15:57.978536] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T18:15:58.187058] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T18:15:58.340167] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T18:15:58.407851] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T18:15:58.654386] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-30T18:15:59.454409] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-30T18:16:00.254385] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-30T18:16:00.460353] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T18:16:01.009639] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T18:16:01.054389] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-30T18:16:01.232320] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T18:16:01.854387] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-30T18:16:02.482596] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T18:16:02.654400] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-30T18:16:03.152799] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T18:16:03.454373] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-30T18:16:04.254407] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-30T18:16:04.440684] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:16:04.831502] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T18:16:05.054367] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-30T18:16:05.377716] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T18:16:05.381021] [INFO ] [REMOTE ] DDS: Full fetch complete (19112 records). [2025-09-30T18:16:05.381107] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-30T18:16:05.790727] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-30T18:16:05.790888] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-30T18:16:05.791357] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-30T18:16:05.791438] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-30T18:16:05.792263] [DEBUG] [LOCAL ] DDS: Trimmed 19112 records to 13079 (keeping 200 days of data) [2025-09-30T18:16:05.854777] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-30T18:16:05.882456] [DEBUG] [LOCAL ] DDS: Primary data saved (13079 records). [2025-09-30T18:16:05.882706] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-30T18:16:05.882805] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 17.9s. Estimated remaining: 3h 43m 26s. Rate: 7.9 symbols/min [2025-09-30T18:16:06.075363] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:06.108917] [DEBUG] [LOCAL ] DEC: Loaded 30417 existing records from primary storage. [2025-09-30T18:16:06.109224] [INFO ] [MAIN ] DEC: Loaded 30417 existing records. [2025-09-30T18:16:06.307968] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:16:06.308244] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-30T18:16:06.308304] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-30T18:16:06.308765] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-30T18:16:06.308827] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-30T18:16:06.669967] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-30T18:16:06.717707] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:07.256753] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-30T18:16:07.454402] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-30T18:16:07.776122] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T18:16:08.008943] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:16:08.254377] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-30T18:16:08.308946] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T18:16:09.054426] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-30T18:16:09.854335] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-30T18:16:09.888963] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T18:16:09.898886] [INFO ] [REMOTE ] DDL: Full fetch complete (53288 records). [2025-09-30T18:16:09.899055] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-30T18:16:10.367886] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-30T18:16:10.368037] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-30T18:16:10.369382] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-30T18:16:10.370286] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-30T18:16:10.370203] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:16:10.377446] [DEBUG] [LOCAL ] DDL: Trimmed 53288 records to 36643 (keeping 200 days of data) [2025-09-30T18:16:10.592302] [DEBUG] [LOCAL ] DDL: Primary data saved (36643 records). [2025-09-30T18:16:10.592461] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-30T18:16:10.592585] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 22.6s. Estimated remaining: 3h 43m 10s. Rate: 7.9 symbols/min [2025-09-30T18:16:10.664355] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-30T18:16:10.795318] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:10.849530] [DEBUG] [LOCAL ] DECK: Loaded 53297 existing records from primary storage. [2025-09-30T18:16:10.849933] [INFO ] [MAIN ] DECK: Loaded 53297 existing records. [2025-09-30T18:16:11.047192] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:16:11.047452] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-30T18:16:11.047511] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-30T18:16:11.047828] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-30T18:16:11.047890] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-30T18:16:11.441783] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:11.454302] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-30T18:16:11.645531] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T18:16:12.254365] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-30T18:16:12.523552] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T18:16:12.955365] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T18:16:13.054367] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-30T18:16:13.610066] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T18:16:13.854371] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-30T18:16:14.654415] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-30T18:16:14.942494] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T18:16:15.395546] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:16:15.454403] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-30T18:16:16.012087] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T18:16:16.254374] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-30T18:16:17.054371] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-30T18:16:17.347190] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T18:16:17.808797] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T18:16:17.854415] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-30T18:16:18.628230] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T18:16:18.654355] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-30T18:16:19.454412] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-30T18:16:19.619588] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:16:19.630808] [INFO ] [REMOTE ] DE: Full fetch complete (69549 records). [2025-09-30T18:16:19.630974] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-30T18:16:20.081048] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-30T18:16:20.081166] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-30T18:16:20.082062] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-30T18:16:20.082141] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-30T18:16:20.083880] [DEBUG] [LOCAL ] DE: Trimmed 69549 records to 47556 (keeping 200 days of data) [2025-09-30T18:16:20.207165] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T18:16:20.255210] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-30T18:16:20.432160] [DEBUG] [LOCAL ] DE: Primary data saved (47556 records). [2025-09-30T18:16:20.432435] [INFO ] [MAIN ] DE: Full history saved. [2025-09-30T18:16:20.432677] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DE took 32.5s. Estimated remaining: 3h 43m 10s. Rate: 7.9 symbols/min [2025-09-30T18:16:20.625465] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:20.648829] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T18:16:20.702576] [DEBUG] [LOCAL ] DEI: Loaded 48386 existing records from primary storage. [2025-09-30T18:16:20.702962] [INFO ] [MAIN ] DEI: Loaded 48386 existing records. [2025-09-30T18:16:20.904879] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:16:20.905170] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-30T18:16:20.905228] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-30T18:16:20.905876] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-30T18:16:20.905939] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-30T18:16:21.059547] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-30T18:16:21.306963] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:21.854376] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-30T18:16:21.900257] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T18:16:22.654369] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-30T18:16:23.362944] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-30T18:16:23.454335] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-30T18:16:23.717192] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T18:16:24.254369] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-30T18:16:24.312460] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T18:16:24.321446] [INFO ] [REMOTE ] DEA: Full fetch complete (62631 records). [2025-09-30T18:16:24.321599] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-30T18:16:24.734295] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-30T18:16:24.734396] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-30T18:16:24.735243] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-30T18:16:24.735313] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-30T18:16:24.736862] [DEBUG] [LOCAL ] DEA: Trimmed 62631 records to 40928 (keeping 200 days of data) [2025-09-30T18:16:25.001315] [DEBUG] [LOCAL ] DEA: Primary data saved (40928 records). [2025-09-30T18:16:25.001525] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-30T18:16:25.001630] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEA took 29.2s. Estimated remaining: 3h 42m 53s. Rate: 7.9 symbols/min [2025-09-30T18:16:25.061257] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-30T18:16:25.197537] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:25.252223] [DEBUG] [LOCAL ] DELL: Loaded 53735 existing records from primary storage. [2025-09-30T18:16:25.252568] [INFO ] [MAIN ] DELL: Loaded 53735 existing records. [2025-09-30T18:16:25.477998] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:16:25.478974] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-30T18:16:25.479115] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-30T18:16:25.479796] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-30T18:16:25.479913] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-30T18:16:25.725337] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-30T18:16:25.865276] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-30T18:16:25.929312] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T18:16:26.003985] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:26.461282] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T18:16:26.654370] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-30T18:16:27.454387] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-30T18:16:27.674757] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T18:16:27.952854] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T18:16:28.254387] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-30T18:16:29.054374] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-30T18:16:29.625325] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T18:16:29.854398] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-30T18:16:29.963718] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-30T18:16:30.654378] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-30T18:16:31.185930] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T18:16:31.260587] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-30T18:16:31.454357] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-30T18:16:32.254366] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-30T18:16:32.853624] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-30T18:16:33.038868] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T18:16:33.045097] [INFO ] [REMOTE ] DEC: Full fetch complete (42852 records). [2025-09-30T18:16:33.045203] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-30T18:16:33.047430] [FATAL] [VALIDATOR ] DEC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:16:33.047555] [FATAL] [MAIN ] DEC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:16:33.047668] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:16:33.047765] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-30T18:16:33.047871] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-09-30T18:16:33.047925] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-09-30T18:16:33.048622] [DEBUG] [LOCAL ] DEC: Deleted derivative data file. [2025-09-30T18:16:33.048750] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEC took 27.2s. Estimated remaining: 3h 42m 47s. Rate: 7.9 symbols/min [2025-09-30T18:16:33.061281] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-30T18:16:33.239193] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:33.239388] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-09-30T18:16:33.239434] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-09-30T18:16:33.239547] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-30T18:16:33.239589] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-30T18:16:33.239634] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-09-30T18:16:33.239709] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-30T18:16:33.636713] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:33.854350] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-30T18:16:33.890314] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T18:16:34.654362] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-30T18:16:35.386195] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-30T18:16:35.454340] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-30T18:16:35.497056] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:16:36.254316] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-30T18:16:36.374970] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T18:16:36.840219] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:16:37.054412] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-30T18:16:37.854389] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-30T18:16:38.576507] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-30T18:16:38.654355] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-30T18:16:38.898274] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T18:16:39.438016] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:16:39.454318] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-30T18:16:40.254363] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-30T18:16:41.054382] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-30T18:16:41.090471] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T18:16:41.148808] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-30T18:16:41.854361] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-30T18:16:42.434446] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T18:16:42.654375] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-30T18:16:42.748859] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T18:16:43.280878] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T18:16:43.454398] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-30T18:16:44.254350] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-30T18:16:44.363773] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T18:16:45.054380] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-30T18:16:45.222069] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:16:45.854437] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-30T18:16:46.208065] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T18:16:46.654425] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-30T18:16:46.990020] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T18:16:47.001484] [INFO ] [REMOTE ] DECK: Full fetch complete (76656 records). [2025-09-30T18:16:47.001720] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-30T18:16:47.456810] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-30T18:16:47.457081] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-30T18:16:47.458092] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-30T18:16:47.459085] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-30T18:16:47.459340] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-30T18:16:47.461359] [DEBUG] [LOCAL ] DECK: Trimmed 76656 records to 53295 (keeping 200 days of data) [2025-09-30T18:16:47.589340] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T18:16:47.842932] [DEBUG] [LOCAL ] DECK: Primary data saved (53295 records). [2025-09-30T18:16:47.843091] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-30T18:16:47.845048] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DECK took 37.3s. Estimated remaining: 3h 43m 0s. Rate: 7.9 symbols/min [2025-09-30T18:16:48.028526] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:48.066452] [DEBUG] [LOCAL ] DFH: Loaded 32389 existing records from primary storage. [2025-09-30T18:16:48.066809] [INFO ] [MAIN ] DFH: Loaded 32389 existing records. [2025-09-30T18:16:48.256286] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-30T18:16:48.270962] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:16:48.271484] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-30T18:16:48.271583] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-30T18:16:48.271940] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-30T18:16:48.272020] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-30T18:16:48.687162] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:48.725925] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-30T18:16:48.910939] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T18:16:49.054401] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-30T18:16:49.854336] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-30T18:16:49.962911] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-30T18:16:50.659437] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-30T18:16:50.676082] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T18:16:51.454394] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-30T18:16:52.034020] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T18:16:52.254371] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-30T18:16:52.302666] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:16:52.964818] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T18:16:53.054391] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-30T18:16:53.854342] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-30T18:16:54.036328] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T18:16:54.047246] [INFO ] [REMOTE ] DEI: Full fetch complete (69662 records). [2025-09-30T18:16:54.047415] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-30T18:16:54.410774] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T18:16:54.524687] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-30T18:16:54.524795] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-30T18:16:54.525737] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-30T18:16:54.525810] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-30T18:16:54.527697] [DEBUG] [LOCAL ] DEI: Trimmed 69662 records to 48388 (keeping 200 days of data) [2025-09-30T18:16:54.655127] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-30T18:16:54.845434] [DEBUG] [LOCAL ] DEI: Primary data saved (48388 records). [2025-09-30T18:16:54.845665] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-30T18:16:54.845816] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DEI took 34.4s. Estimated remaining: 3h 42m 51s. Rate: 7.9 symbols/min [2025-09-30T18:16:55.028463] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:55.052915] [DEBUG] [LOCAL ] DFIN: Loaded 23167 existing records from primary storage. [2025-09-30T18:16:55.053238] [INFO ] [MAIN ] DFIN: Loaded 23167 existing records. [2025-09-30T18:16:55.252344] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:16:55.252592] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-30T18:16:55.252667] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-30T18:16:55.253064] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-30T18:16:55.253136] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-30T18:16:55.485453] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-30T18:16:55.653001] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:56.049790] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T18:16:56.234276] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-30T18:16:56.254338] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-30T18:16:57.059525] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-30T18:16:57.077869] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T18:16:57.854395] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-30T18:16:58.518990] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T18:16:58.637197] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-30T18:16:58.650383] [INFO ] [REMOTE ] DELL: Full fetch complete (77430 records). [2025-09-30T18:16:58.650557] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-30T18:16:58.651484] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:16:58.651601] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:16:58.651704] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:16:58.651829] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-30T18:16:58.651940] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-30T18:16:58.651999] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-09-30T18:16:58.652276] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-09-30T18:16:58.652386] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DELL took 33.7s. Estimated remaining: 3h 42m 33s. Rate: 7.9 symbols/min [2025-09-30T18:16:58.665969] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-30T18:16:58.846949] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:16:58.847146] [DEBUG] [LOCAL ] DFP: No existing data file found in primary storage. [2025-09-30T18:16:58.847186] [WARN ] [MAIN ] DFP: No existing data found, performing full refresh instead. [2025-09-30T18:16:58.847369] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-30T18:16:58.847449] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-30T18:16:58.847522] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-09-30T18:16:58.847560] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-30T18:16:59.226199] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:16:59.454326] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-30T18:16:59.679335] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T18:16:59.884812] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-30T18:17:00.254353] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-30T18:17:00.944093] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T18:17:01.054407] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-30T18:17:01.506855] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:17:01.854404] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-30T18:17:02.654375] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-30T18:17:02.989908] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T18:17:03.072751] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T18:17:03.084333] [INFO ] [REMOTE ] DEO: Full fetch complete (71512 records). [2025-09-30T18:17:03.084521] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-30T18:17:03.462190] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-30T18:17:03.527900] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-30T18:17:03.528035] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-30T18:17:03.529126] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-30T18:17:03.529192] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-30T18:17:03.530767] [DEBUG] [LOCAL ] DEO: Trimmed 71512 records to 49007 (keeping 200 days of data) [2025-09-30T18:17:03.676149] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T18:17:03.865839] [DEBUG] [LOCAL ] DEO: Primary data saved (49007 records). [2025-09-30T18:17:03.866008] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-30T18:17:03.866132] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DEO took 30.8s. Estimated remaining: 3h 42m 18s. Rate: 7.9 symbols/min [2025-09-30T18:17:04.051480] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:04.109313] [DEBUG] [LOCAL ] DG: Loaded 53284 existing records from primary storage. [2025-09-30T18:17:04.109701] [INFO ] [MAIN ] DG: Loaded 53284 existing records. [2025-09-30T18:17:04.264528] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-30T18:17:04.312826] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:17:04.313134] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-30T18:17:04.313219] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-30T18:17:04.313673] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-30T18:17:04.313738] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-30T18:17:04.743425] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:04.763677] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T18:17:05.054384] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-30T18:17:05.075560] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T18:17:05.854383] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-30T18:17:06.290182] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T18:17:06.654421] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-30T18:17:07.424711] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T18:17:07.454349] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-30T18:17:07.742343] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T18:17:08.254392] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-30T18:17:08.304138] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T18:17:09.054389] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-30T18:17:09.854344] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-30T18:17:09.866764] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T18:17:10.201810] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T18:17:10.654423] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-30T18:17:11.393515] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T18:17:11.454415] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-30T18:17:12.257141] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-30T18:17:12.262899] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T18:17:12.832507] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T18:17:13.054372] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-30T18:17:13.368242] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T18:17:13.854416] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-30T18:17:14.654446] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-30T18:17:15.109939] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T18:17:15.412734] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T18:17:15.454326] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-30T18:17:15.705130] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T18:17:16.254365] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-30T18:17:16.731373] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T18:17:17.054416] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-30T18:17:17.854400] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-30T18:17:18.153675] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T18:17:18.160257] [INFO ] [REMOTE ] DFH: Full fetch complete (48798 records). [2025-09-30T18:17:18.160405] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-30T18:17:18.614060] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-30T18:17:18.614226] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-30T18:17:18.614900] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-30T18:17:18.615011] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-30T18:17:18.616510] [DEBUG] [LOCAL ] DFH: Trimmed 48798 records to 32312 (keeping 200 days of data) [2025-09-30T18:17:18.677514] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-30T18:17:18.750707] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-30T18:17:18.871163] [DEBUG] [LOCAL ] DFH: Primary data saved (32312 records). [2025-09-30T18:17:18.871415] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-30T18:17:18.872106] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFH took 31.0s. Estimated remaining: 3h 42m 32s. Rate: 7.9 symbols/min [2025-09-30T18:17:19.042936] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T18:17:19.076855] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:19.123621] [DEBUG] [LOCAL ] DGX: Loaded 44954 existing records from primary storage. [2025-09-30T18:17:19.124000] [INFO ] [MAIN ] DGX: Loaded 44954 existing records. [2025-09-30T18:17:19.333803] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:17:19.334086] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-30T18:17:19.334140] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-30T18:17:19.334590] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-30T18:17:19.334686] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-30T18:17:19.462940] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-30T18:17:19.751396] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:19.764502] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T18:17:20.185418] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T18:17:20.254416] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-30T18:17:21.054366] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-30T18:17:21.854428] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-30T18:17:21.988709] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T18:17:22.202434] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T18:17:22.654361] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-30T18:17:22.736027] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T18:17:23.454380] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-30T18:17:24.254347] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-30T18:17:24.303279] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T18:17:24.449971] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T18:17:25.054321] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-30T18:17:25.222945] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T18:17:25.228041] [INFO ] [REMOTE ] DFIN: Full fetch complete (33635 records). [2025-09-30T18:17:25.228203] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-30T18:17:25.642853] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-30T18:17:25.642975] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-30T18:17:25.643563] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-30T18:17:25.643623] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-30T18:17:25.644554] [DEBUG] [LOCAL ] DFIN: Trimmed 33635 records to 23061 (keeping 200 days of data) [2025-09-30T18:17:25.742384] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T18:17:25.748831] [INFO ] [REMOTE ] DFP: Full fetch complete (16077 records). [2025-09-30T18:17:25.750788] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-30T18:17:25.755584] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:17:25.759958] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:17:25.762964] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:17:25.764173] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-30T18:17:25.764924] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-09-30T18:17:25.765808] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-09-30T18:17:25.766582] [DEBUG] [LOCAL ] DFP: No derivative data file found to delete. [2025-09-30T18:17:25.767326] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFP took 27.1s. Estimated remaining: 3h 42m 22s. Rate: 7.9 symbols/min [2025-09-30T18:17:25.859956] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-30T18:17:25.981816] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:26.016002] [DEBUG] [LOCAL ] DFIN: Primary data saved (23061 records). [2025-09-30T18:17:26.016165] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-30T18:17:26.016264] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFIN took 31.2s. Estimated remaining: 3h 41m 54s. Rate: 7.9 symbols/min [2025-09-30T18:17:26.124681] [DEBUG] [LOCAL ] DHF: Loaded 20678 existing records from primary storage. [2025-09-30T18:17:26.136452] [INFO ] [MAIN ] DHF: Loaded 20678 existing records. [2025-09-30T18:17:26.334229] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:26.427777] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:17:26.428059] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-30T18:17:26.428109] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-30T18:17:26.428563] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-30T18:17:26.428631] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-30T18:17:26.673627] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-30T18:17:26.704912] [DEBUG] [LOCAL ] DHI: Loaded 53361 existing records from primary storage. [2025-09-30T18:17:26.745806] [INFO ] [MAIN ] DHI: Loaded 53361 existing records. [2025-09-30T18:17:27.025468] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:27.093685] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:17:27.093946] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-30T18:17:27.093999] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-30T18:17:27.096019] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-30T18:17:27.096102] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-30T18:17:27.457337] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-30T18:17:27.498751] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:27.540906] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T18:17:28.254340] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-30T18:17:28.531210] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T18:17:28.683472] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T18:17:29.054368] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-30T18:17:29.727421] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T18:17:29.854368] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-30T18:17:30.654365] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-30T18:17:30.693482] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:17:31.454377] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-30T18:17:31.478281] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T18:17:31.733503] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T18:17:32.254391] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-30T18:17:33.054408] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-30T18:17:33.347540] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T18:17:33.854337] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-30T18:17:34.014828] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T18:17:34.331559] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-30T18:17:34.343382] [INFO ] [REMOTE ] DG: Full fetch complete (77215 records). [2025-09-30T18:17:34.343592] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-30T18:17:34.659435] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-30T18:17:34.849295] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-30T18:17:34.849429] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-30T18:17:34.850294] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-30T18:17:34.850360] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-30T18:17:34.851966] [DEBUG] [LOCAL ] DG: Trimmed 77215 records to 53284 (keeping 200 days of data) [2025-09-30T18:17:35.233838] [DEBUG] [LOCAL ] DG: Primary data saved (53284 records). [2025-09-30T18:17:35.234010] [INFO ] [MAIN ] DG: Full history saved. [2025-09-30T18:17:35.234117] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DG took 31.4s. Estimated remaining: 3h 41m 51s. Rate: 7.9 symbols/min [2025-09-30T18:17:35.425792] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:35.425998] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-09-30T18:17:35.426149] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-09-30T18:17:35.426332] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-30T18:17:35.426508] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-30T18:17:35.426665] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-30T18:17:35.426869] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-30T18:17:35.461332] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-30T18:17:35.760609] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-30T18:17:35.839367] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T18:17:35.908073] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:36.254375] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-30T18:17:36.867501] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T18:17:37.054366] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-30T18:17:37.854327] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-30T18:17:38.155673] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T18:17:38.268148] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T18:17:38.654397] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-30T18:17:39.414550] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T18:17:39.454386] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-30T18:17:40.254331] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-30T18:17:40.535528] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T18:17:40.604836] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T18:17:41.054389] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-30T18:17:41.854361] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-30T18:17:42.393480] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T18:17:42.654337] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-30T18:17:42.868783] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T18:17:42.908629] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T18:17:43.454397] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-30T18:17:44.254355] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-30T18:17:44.412269] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:17:45.054336] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-30T18:17:45.147379] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-30T18:17:45.182811] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T18:17:45.854403] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-30T18:17:46.654391] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-30T18:17:46.772428] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T18:17:46.977320] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T18:17:47.454407] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-30T18:17:48.254419] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-30T18:17:48.772692] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-30T18:17:48.924137] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T18:17:49.054338] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-30T18:17:49.370030] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T18:17:49.375199] [INFO ] [REMOTE ] DHF: Full fetch complete (29696 records). [2025-09-30T18:17:49.375281] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-30T18:17:49.784565] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-30T18:17:49.784662] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-30T18:17:49.785223] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-30T18:17:49.785284] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-30T18:17:49.786194] [DEBUG] [LOCAL ] DHF: Trimmed 29696 records to 20733 (keeping 200 days of data) [2025-09-30T18:17:49.874760] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-30T18:17:49.919463] [DEBUG] [LOCAL ] DHF: Primary data saved (20733 records). [2025-09-30T18:17:49.919600] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-30T18:17:49.919731] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DHF took 24.2s. Estimated remaining: 3h 42m 4s. Rate: 7.9 symbols/min [2025-09-30T18:17:50.096529] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:50.145433] [DEBUG] [LOCAL ] DHT: Loaded 47882 existing records from primary storage. [2025-09-30T18:17:50.145794] [INFO ] [MAIN ] DHT: Loaded 47882 existing records. [2025-09-30T18:17:50.352363] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:17:50.352576] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-30T18:17:50.352626] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-30T18:17:50.353084] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-30T18:17:50.353145] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-30T18:17:50.655734] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-30T18:17:50.760556] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:50.985744] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T18:17:51.454385] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-30T18:17:51.565184] [DEBUG] [REMOTE ] DHT: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-30T18:17:51.565548] [WARN ] [REMOTE ] DHT: No data returned for month 2024-12 [2025-09-30T18:17:51.565677] [FATAL] [REMOTE ] DHT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:17:51.565758] [FATAL] [MAIN ] DHT: Failed to fetch primary data. [2025-09-30T18:17:51.565826] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:17:51.565901] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-30T18:17:51.565971] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-30T18:17:51.566011] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-09-30T18:17:51.566289] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-09-30T18:17:51.566391] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DHT took 1.6s. Estimated remaining: 3h 41m 39s. Rate: 7.9 symbols/min [2025-09-30T18:17:51.764492] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:51.779537] [DEBUG] [LOCAL ] DHX: Loaded 13104 existing records from primary storage. [2025-09-30T18:17:51.779795] [INFO ] [MAIN ] DHX: Loaded 13104 existing records. [2025-09-30T18:17:51.922916] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-30T18:17:52.019213] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:17:52.019447] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-30T18:17:52.019497] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-30T18:17:52.019719] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-30T18:17:52.019807] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-30T18:17:52.259743] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-30T18:17:52.421017] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:52.600071] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:17:53.054394] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-30T18:17:53.854395] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-30T18:17:53.905262] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T18:17:54.654409] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-30T18:17:54.886472] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T18:17:55.446622] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T18:17:55.455738] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-30T18:17:55.597152] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T18:17:56.254373] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-30T18:17:57.054355] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-30T18:17:57.105828] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T18:17:57.144511] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T18:17:57.854483] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-30T18:17:58.645089] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T18:17:58.657445] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-30T18:17:58.660181] [INFO ] [REMOTE ] DGX: Full fetch complete (64747 records). [2025-09-30T18:17:58.660427] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-30T18:17:58.661630] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:17:58.661783] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:17:58.661862] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:17:58.661954] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-30T18:17:58.662043] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-09-30T18:17:58.662090] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-09-30T18:17:58.662404] [DEBUG] [LOCAL ] DGX: Deleted derivative data file. [2025-09-30T18:17:58.662535] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DGX took 39.8s. Estimated remaining: 3h 41m 30s. Rate: 7.9 symbols/min [2025-09-30T18:17:58.865986] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:17:58.866177] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-09-30T18:17:58.866216] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-09-30T18:17:58.866330] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-30T18:17:58.866373] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-30T18:17:58.866416] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-30T18:17:58.866449] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-30T18:17:59.247425] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:17:59.416142] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T18:17:59.454366] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-30T18:18:00.254359] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-30T18:18:00.681062] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-30T18:18:01.054436] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-30T18:18:01.389290] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T18:18:01.787055] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-30T18:18:01.854368] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-30T18:18:01.999800] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T18:18:02.654390] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-30T18:18:03.454347] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-30T18:18:03.593903] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T18:18:03.973022] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T18:18:03.985051] [INFO ] [REMOTE ] DHI: Full fetch complete (77214 records). [2025-09-30T18:18:03.985254] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-30T18:18:04.259534] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-30T18:18:04.405823] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-30T18:18:04.405962] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-30T18:18:04.407320] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-30T18:18:04.407403] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-30T18:18:04.411631] [DEBUG] [LOCAL ] DHI: Trimmed 77214 records to 53349 (keeping 200 days of data) [2025-09-30T18:18:04.783074] [DEBUG] [LOCAL ] DHI: Primary data saved (53349 records). [2025-09-30T18:18:04.783278] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-30T18:18:04.783387] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHI took 38.8s. Estimated remaining: 3h 41m 19s. Rate: 7.9 symbols/min [2025-09-30T18:18:04.956794] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T18:18:04.975421] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:05.024220] [DEBUG] [LOCAL ] DIN: Loaded 37181 existing records from primary storage. [2025-09-30T18:18:05.024627] [INFO ] [MAIN ] DIN: Loaded 37181 existing records. [2025-09-30T18:18:05.059510] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-30T18:18:05.233176] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:18:05.233668] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-30T18:18:05.233771] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-30T18:18:05.234408] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-30T18:18:05.234554] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-30T18:18:05.443896] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T18:18:05.670159] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:05.854401] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-30T18:18:06.204768] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T18:18:06.654479] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-30T18:18:07.133810] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T18:18:07.316129] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-30T18:18:07.454420] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-30T18:18:08.083083] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T18:18:08.254415] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-30T18:18:09.054400] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-30T18:18:09.792422] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T18:18:09.854354] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-30T18:18:09.900228] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T18:18:10.654370] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-30T18:18:11.436396] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T18:18:11.454314] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-30T18:18:12.123715] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-30T18:18:12.135369] [INFO ] [REMOTE ] DHR: Full fetch complete (77269 records). [2025-09-30T18:18:12.135546] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-30T18:18:12.259481] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-30T18:18:12.480107] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T18:18:12.607836] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-30T18:18:12.607957] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-30T18:18:12.609100] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-30T18:18:12.609220] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-30T18:18:12.611363] [DEBUG] [LOCAL ] DHR: Trimmed 77269 records to 53365 (keeping 200 days of data) [2025-09-30T18:18:12.973249] [DEBUG] [LOCAL ] DHR: Primary data saved (53365 records). [2025-09-30T18:18:12.973427] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-30T18:18:12.973520] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHR took 37.7s. Estimated remaining: 3h 41m 13s. Rate: 7.9 symbols/min [2025-09-30T18:18:13.059518] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-30T18:18:13.165014] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:13.217249] [DEBUG] [LOCAL ] DINO: Loaded 52952 existing records from primary storage. [2025-09-30T18:18:13.217615] [INFO ] [MAIN ] DINO: Loaded 52952 existing records. [2025-09-30T18:18:13.426557] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:18:13.426960] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-30T18:18:13.427017] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-30T18:18:13.427435] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-30T18:18:13.427497] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-30T18:18:13.804057] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:13.819822] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T18:18:13.854322] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-30T18:18:14.023011] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T18:18:14.654417] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-30T18:18:15.454420] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-30T18:18:16.063514] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-30T18:18:16.244212] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:18:16.254335] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-30T18:18:16.393052] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T18:18:17.054493] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-30T18:18:17.854372] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-30T18:18:17.993054] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T18:18:18.650792] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T18:18:18.654415] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-30T18:18:18.680993] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:18:19.454384] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-30T18:18:19.621263] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T18:18:20.145210] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T18:18:20.149586] [INFO ] [REMOTE ] DIAX: Full fetch complete (17397 records). [2025-09-30T18:18:20.149851] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-30T18:18:20.150554] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:18:20.150698] [FATAL] [MAIN ] DIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:18:20.150754] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:18:20.150800] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-30T18:18:20.150868] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-30T18:18:20.150906] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-09-30T18:18:20.151173] [DEBUG] [LOCAL ] DIAX: No derivative data file found to delete. [2025-09-30T18:18:20.151527] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DIAX took 21.5s. Estimated remaining: 3h 41m 4s. Rate: 7.9 symbols/min [2025-09-30T18:18:20.259705] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-30T18:18:20.352238] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:20.414664] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-30T18:18:20.415063] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-09-30T18:18:20.616173] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:18:20.616408] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-30T18:18:20.616457] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-30T18:18:20.618109] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-30T18:18:20.618281] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-30T18:18:21.003269] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:21.054371] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-30T18:18:21.812887] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T18:18:21.854384] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-30T18:18:22.654412] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-30T18:18:22.686968] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T18:18:23.454412] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-30T18:18:23.528047] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-30T18:18:24.074409] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T18:18:24.254394] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-30T18:18:24.873115] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T18:18:25.054401] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-30T18:18:25.114058] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T18:18:25.854374] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-30T18:18:26.654410] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-30T18:18:27.169866] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T18:18:27.173935] [INFO ] [REMOTE ] DHX: Full fetch complete (20816 records). [2025-09-30T18:18:27.174114] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-30T18:18:27.459474] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-30T18:18:27.625512] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-30T18:18:27.625701] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-30T18:18:27.626381] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-30T18:18:27.626894] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-30T18:18:27.628345] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-30T18:18:27.640843] [DEBUG] [LOCAL ] DHX: Trimmed 20816 records to 13063 (keeping 200 days of data) [2025-09-30T18:18:27.717527] [DEBUG] [LOCAL ] DHX: Primary data saved (13063 records). [2025-09-30T18:18:27.717742] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-30T18:18:27.717842] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DHX took 36.2s. Estimated remaining: 3h 40m 56s. Rate: 7.9 symbols/min [2025-09-30T18:18:27.901235] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:27.901563] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-30T18:18:27.901622] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-30T18:18:27.901760] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-30T18:18:27.901803] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-30T18:18:27.901845] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-30T18:18:27.901878] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-30T18:18:28.257258] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-30T18:18:28.301535] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:28.322874] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T18:18:29.054381] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-30T18:18:29.434746] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-30T18:18:29.854352] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-30T18:18:30.487493] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T18:18:30.594639] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-30T18:18:30.654371] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-30T18:18:31.030535] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-30T18:18:31.454320] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-30T18:18:31.529563] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T18:18:32.254360] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-30T18:18:33.054380] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-30T18:18:33.354947] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-30T18:18:33.859367] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-30T18:18:33.876225] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-30T18:18:33.921041] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T18:18:34.221439] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-30T18:18:34.654363] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-30T18:18:35.082490] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-30T18:18:35.454352] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-30T18:18:35.887888] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T18:18:36.254367] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-30T18:18:37.054408] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-30T18:18:37.854361] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-30T18:18:38.156005] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T18:18:38.548742] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T18:18:38.654404] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-30T18:18:39.454400] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-30T18:18:39.796664] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-30T18:18:40.262243] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-30T18:18:40.285021] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-30T18:18:40.385216] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T18:18:40.394000] [INFO ] [REMOTE ] DIN: Full fetch complete (55165 records). [2025-09-30T18:18:40.394146] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-30T18:18:40.703085] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T18:18:40.833080] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-30T18:18:40.833166] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-30T18:18:40.833897] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-30T18:18:40.833962] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-30T18:18:40.835217] [DEBUG] [LOCAL ] DIN: Trimmed 55165 records to 37165 (keeping 200 days of data) [2025-09-30T18:18:41.054467] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-30T18:18:41.076833] [DEBUG] [LOCAL ] DIN: Primary data saved (37165 records). [2025-09-30T18:18:41.077002] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-30T18:18:41.077094] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIN took 36.3s. Estimated remaining: 3h 41m 5s. Rate: 7.9 symbols/min [2025-09-30T18:18:41.266815] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:41.318312] [DEBUG] [LOCAL ] DK: Loaded 49324 existing records from primary storage. [2025-09-30T18:18:41.318708] [INFO ] [MAIN ] DK: Loaded 49324 existing records. [2025-09-30T18:18:41.517699] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:18:41.517921] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-30T18:18:41.517970] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-30T18:18:41.519410] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-30T18:18:41.519474] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-30T18:18:41.859511] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-30T18:18:41.922849] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:42.487145] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T18:18:42.654372] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-30T18:18:42.824111] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T18:18:43.454417] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-30T18:18:44.254400] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-30T18:18:44.588158] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-30T18:18:45.054339] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-30T18:18:45.159350] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T18:18:45.254324] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-30T18:18:45.854385] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-30T18:18:46.654324] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-30T18:18:47.154430] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T18:18:47.166050] [INFO ] [REMOTE ] DINO: Full fetch complete (76301 records). [2025-09-30T18:18:47.166223] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-30T18:18:47.167139] [FATAL] [VALIDATOR ] DINO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:18:47.167235] [FATAL] [MAIN ] DINO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:18:47.167279] [WARN ] [MAIN ] DINO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:18:47.167320] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-30T18:18:47.167379] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-09-30T18:18:47.167415] [INFO ] [LOCAL ] DINO: Starting deletion of derivative data. [2025-09-30T18:18:47.167771] [DEBUG] [LOCAL ] DINO: Deleted derivative data file. [2025-09-30T18:18:47.167885] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DINO took 34.2s. Estimated remaining: 3h 40m 53s. Rate: 7.9 symbols/min [2025-09-30T18:18:47.372913] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:47.390342] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T18:18:47.427838] [DEBUG] [LOCAL ] DKL: Loaded 18836 existing records from primary storage. [2025-09-30T18:18:47.428273] [INFO ] [MAIN ] DKL: Loaded 18836 existing records. [2025-09-30T18:18:47.459583] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-30T18:18:47.665164] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:18:47.665445] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-30T18:18:47.665528] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-30T18:18:47.666268] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-30T18:18:47.666334] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-30T18:18:48.127019] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T18:18:48.128680] [INFO ] [REMOTE ] DIVY: Full fetch complete (1711 records). [2025-09-30T18:18:48.128838] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-30T18:18:48.129438] [FATAL] [VALIDATOR ] DIVY: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:18:48.149604] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:18:48.158603] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:18:48.158822] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-30T18:18:48.158926] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-30T18:18:48.158988] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-30T18:18:48.159058] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-30T18:18:48.159167] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIVY took 20.4s. Estimated remaining: 3h 40m 27s. Rate: 7.9 symbols/min [2025-09-30T18:18:48.280065] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-30T18:18:48.432118] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:48.584632] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:18:48.662087] [DEBUG] [LOCAL ] DKS: Loaded 49803 existing records from primary storage. [2025-09-30T18:18:48.662574] [INFO ] [MAIN ] DKS: Loaded 49803 existing records. [2025-09-30T18:18:48.909270] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:18:48.943092] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-30T18:18:48.947795] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-30T18:18:48.950337] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-30T18:18:48.950414] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-30T18:18:48.950602] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-30T18:18:49.059519] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-30T18:18:49.383042] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:18:49.854350] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-30T18:18:49.906493] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:18:50.346008] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T18:18:50.654361] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-30T18:18:51.250514] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T18:18:51.454414] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-30T18:18:51.692181] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T18:18:52.254400] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-30T18:18:53.054393] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-30T18:18:53.407191] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T18:18:53.737070] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-30T18:18:53.854380] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-30T18:18:54.274814] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-30T18:18:54.654372] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-30T18:18:55.454330] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-30T18:18:55.545790] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T18:18:56.254401] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-30T18:18:57.054354] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-30T18:18:57.192973] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T18:18:57.208955] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-30T18:18:57.406328] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T18:18:57.854368] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-30T18:18:58.354696] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T18:18:58.654376] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-30T18:18:59.454407] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-30T18:19:00.044536] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-30T18:19:00.057111] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-09-30T18:19:00.057342] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-30T18:19:00.257627] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-30T18:19:00.513921] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-30T18:19:00.514030] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-30T18:19:00.514966] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-30T18:19:00.515137] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-30T18:19:00.517095] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 53788 (keeping 200 days of data) [2025-09-30T18:19:00.646234] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T18:19:00.917361] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-09-30T18:19:00.917738] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-30T18:19:00.919937] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DIS took 40.8s. Estimated remaining: 3h 40m 34s. Rate: 7.9 symbols/min [2025-09-30T18:19:01.058575] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-30T18:19:01.112982] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:01.134615] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T18:19:01.174957] [DEBUG] [LOCAL ] DLB: Loaded 31993 existing records from primary storage. [2025-09-30T18:19:01.175255] [INFO ] [MAIN ] DLB: Loaded 31993 existing records. [2025-09-30T18:19:01.365602] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:01.365886] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-30T18:19:01.365942] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-30T18:19:01.367002] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-30T18:19:01.367078] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-30T18:19:01.775639] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:01.854362] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-30T18:19:02.149146] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T18:19:02.654377] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-30T18:19:03.074303] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T18:19:03.441864] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T18:19:03.454300] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-30T18:19:03.726256] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T18:19:04.254433] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-30T18:19:04.851847] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T18:19:05.054372] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-30T18:19:05.854342] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-30T18:19:06.299311] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-30T18:19:06.415201] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T18:19:06.654358] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-30T18:19:06.854411] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T18:19:07.454376] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-30T18:19:07.985815] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T18:19:08.254407] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-30T18:19:09.054418] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-30T18:19:09.259556] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T18:19:09.643061] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T18:19:09.854375] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-30T18:19:10.460951] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T18:19:10.654406] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-30T18:19:11.454395] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-30T18:19:11.600234] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T18:19:11.708937] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T18:19:12.059110] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T18:19:12.254362] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-30T18:19:13.054380] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-30T18:19:13.651620] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T18:19:13.854403] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-30T18:19:14.366399] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:19:14.654405] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-30T18:19:15.454369] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-30T18:19:15.705492] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T18:19:15.718916] [INFO ] [REMOTE ] DK: Full fetch complete (70760 records). [2025-09-30T18:19:15.719136] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-30T18:19:16.038070] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T18:19:16.206710] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-30T18:19:16.206821] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-30T18:19:16.208247] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-30T18:19:16.208329] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-30T18:19:16.210388] [DEBUG] [LOCAL ] DK: Trimmed 70760 records to 49340 (keeping 200 days of data) [2025-09-30T18:19:16.267965] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-30T18:19:16.522418] [DEBUG] [LOCAL ] DK: Primary data saved (49340 records). [2025-09-30T18:19:16.522565] [INFO ] [MAIN ] DK: Full history saved. [2025-09-30T18:19:16.522758] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DK took 35.4s. Estimated remaining: 3h 40m 49s. Rate: 7.9 symbols/min [2025-09-30T18:19:16.731809] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:16.741188] [DEBUG] [LOCAL ] DLNG: Loaded 6117 existing records from primary storage. [2025-09-30T18:19:16.741489] [INFO ] [MAIN ] DLNG: Loaded 6117 existing records. [2025-09-30T18:19:16.932276] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:16.932731] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-30T18:19:16.933041] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-30T18:19:16.933391] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-30T18:19:16.933468] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-30T18:19:17.059464] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-30T18:19:17.332577] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:17.354531] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T18:19:17.392327] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:19:17.813926] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T18:19:17.854317] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-30T18:19:18.654365] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-30T18:19:19.313888] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T18:19:19.454343] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-30T18:19:19.534537] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T18:19:20.254357] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-30T18:19:20.361851] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T18:19:20.365148] [INFO ] [REMOTE ] DKL: Full fetch complete (28777 records). [2025-09-30T18:19:20.365291] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-30T18:19:20.365856] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:19:20.365974] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:19:20.366020] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:19:20.366091] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-30T18:19:20.366171] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-09-30T18:19:20.366241] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-09-30T18:19:20.366506] [DEBUG] [LOCAL ] DKL: Deleted derivative data file. [2025-09-30T18:19:20.366624] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKL took 33.2s. Estimated remaining: 3h 40m 31s. Rate: 7.9 symbols/min [2025-09-30T18:19:20.549277] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:20.625781] [DEBUG] [LOCAL ] DLR: Loaded 51011 existing records from primary storage. [2025-09-30T18:19:20.626175] [INFO ] [MAIN ] DLR: Loaded 51011 existing records. [2025-09-30T18:19:20.821851] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:20.822111] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-30T18:19:20.822170] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-30T18:19:20.824128] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-30T18:19:20.824192] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-30T18:19:21.054846] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-30T18:19:21.212225] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:21.277420] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T18:19:21.854359] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-30T18:19:22.304922] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T18:19:22.312427] [INFO ] [REMOTE ] DLB: Full fetch complete (46874 records). [2025-09-30T18:19:22.312558] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-30T18:19:22.492135] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T18:19:22.659508] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-30T18:19:22.761380] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-30T18:19:22.761490] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-30T18:19:22.762268] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-30T18:19:22.762357] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-30T18:19:22.763900] [DEBUG] [LOCAL ] DLB: Trimmed 46874 records to 31999 (keeping 200 days of data) [2025-09-30T18:19:22.974793] [DEBUG] [LOCAL ] DLB: Primary data saved (31999 records). [2025-09-30T18:19:22.974936] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-30T18:19:22.975596] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DLB took 22.1s. Estimated remaining: 3h 40m 10s. Rate: 7.9 symbols/min [2025-09-30T18:19:23.160240] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:23.194933] [DEBUG] [LOCAL ] DLX: Loaded 28625 existing records from primary storage. [2025-09-30T18:19:23.195210] [INFO ] [MAIN ] DLX: Loaded 28625 existing records. [2025-09-30T18:19:23.408905] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:23.409141] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-30T18:19:23.409211] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-30T18:19:23.410067] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-30T18:19:23.410129] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-30T18:19:23.459504] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-30T18:19:23.794170] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:24.167926] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T18:19:24.254368] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-30T18:19:24.341910] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T18:19:25.054382] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-30T18:19:25.797834] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T18:19:25.854723] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-30T18:19:26.263567] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T18:19:26.654372] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-30T18:19:27.454406] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-30T18:19:27.625733] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T18:19:28.254311] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-30T18:19:28.410792] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T18:19:28.447300] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T18:19:28.458711] [INFO ] [REMOTE ] DKS: Full fetch complete (71603 records). [2025-09-30T18:19:28.458912] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-30T18:19:28.900785] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-30T18:19:28.900879] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-30T18:19:28.901794] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-30T18:19:28.901866] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-30T18:19:28.903403] [DEBUG] [LOCAL ] DKS: Trimmed 71603 records to 49778 (keeping 200 days of data) [2025-09-30T18:19:29.102113] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-30T18:19:29.243813] [DEBUG] [LOCAL ] DKS: Primary data saved (49778 records). [2025-09-30T18:19:29.243957] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-30T18:19:29.244084] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DKS took 41.1s. Estimated remaining: 3h 39m 58s. Rate: 7.9 symbols/min [2025-09-30T18:19:29.421666] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:29.444045] [DEBUG] [LOCAL ] DLY: Loaded 19652 existing records from primary storage. [2025-09-30T18:19:29.444387] [INFO ] [MAIN ] DLY: Loaded 19652 existing records. [2025-09-30T18:19:29.632538] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:29.632859] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-30T18:19:29.632914] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-30T18:19:29.633628] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-30T18:19:29.633729] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-30T18:19:29.861632] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-30T18:19:30.007572] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:30.074353] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T18:19:30.075039] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T18:19:30.654378] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-30T18:19:30.725906] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T18:19:31.454420] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-30T18:19:32.245797] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T18:19:32.256902] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-30T18:19:32.790852] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T18:19:33.054359] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-30T18:19:33.495762] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T18:19:33.854372] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-30T18:19:34.066199] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T18:19:34.654395] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-30T18:19:34.683300] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T18:19:35.454428] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-30T18:19:35.939088] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T18:19:36.055135] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T18:19:36.254353] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-30T18:19:37.054405] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-30T18:19:37.653186] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T18:19:37.784957] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:19:37.854369] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-30T18:19:38.561071] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-30T18:19:38.654373] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-30T18:19:39.271832] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T18:19:39.454414] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-30T18:19:40.230601] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T18:19:40.254312] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-30T18:19:40.904589] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T18:19:40.906721] [INFO ] [REMOTE ] DLNG: Full fetch complete (11957 records). [2025-09-30T18:19:40.906856] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-30T18:19:40.907545] [FATAL] [VALIDATOR ] DLNG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:19:40.907679] [FATAL] [MAIN ] DLNG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:19:40.907753] [WARN ] [MAIN ] DLNG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:19:40.907853] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-30T18:19:40.907978] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-09-30T18:19:40.908038] [INFO ] [LOCAL ] DLNG: Starting deletion of derivative data. [2025-09-30T18:19:40.908325] [DEBUG] [LOCAL ] DLNG: Deleted derivative data file. [2025-09-30T18:19:40.908454] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLNG took 24.4s. Estimated remaining: 3h 40m 2s. Rate: 7.9 symbols/min [2025-09-30T18:19:41.059701] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-30T18:19:41.192731] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:41.203187] [DEBUG] [LOCAL ] DMA: Loaded 4526 existing records from primary storage. [2025-09-30T18:19:41.203537] [INFO ] [MAIN ] DMA: Loaded 4526 existing records. [2025-09-30T18:19:41.532743] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:41.533147] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-30T18:19:41.533229] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-30T18:19:41.533706] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-30T18:19:41.533786] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-30T18:19:41.859450] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-30T18:19:41.976952] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:42.369932] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:19:42.654321] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-30T18:19:43.051957] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T18:19:43.454384] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-30T18:19:43.947800] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T18:19:44.101677] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T18:19:44.254418] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-30T18:19:44.816536] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T18:19:45.054405] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-30T18:19:45.854366] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-30T18:19:46.079515] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T18:19:46.357546] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-30T18:19:46.654356] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-30T18:19:47.216010] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T18:19:47.454394] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-30T18:19:48.022591] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T18:19:48.254374] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-30T18:19:49.054400] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-30T18:19:49.266280] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T18:19:49.854401] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-30T18:19:50.654404] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-30T18:19:50.867693] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T18:19:50.911031] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T18:19:51.454374] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-30T18:19:51.476774] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T18:19:52.254728] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-30T18:19:53.054333] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-30T18:19:53.196456] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T18:19:53.451699] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T18:19:53.458009] [INFO ] [REMOTE ] DLX: Full fetch complete (41364 records). [2025-09-30T18:19:53.458156] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-30T18:19:53.760097] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T18:19:53.859511] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-30T18:19:53.907202] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-30T18:19:53.907336] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-30T18:19:53.908032] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-30T18:19:53.908100] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-30T18:19:53.914197] [DEBUG] [LOCAL ] DLX: Trimmed 41364 records to 28553 (keeping 200 days of data) [2025-09-30T18:19:54.106808] [DEBUG] [LOCAL ] DLX: Primary data saved (28553 records). [2025-09-30T18:19:54.106938] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-30T18:19:54.107468] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLX took 31.1s. Estimated remaining: 3h 40m 10s. Rate: 7.9 symbols/min [2025-09-30T18:19:54.295712] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:54.309748] [DEBUG] [LOCAL ] DMB: Loaded 10202 existing records from primary storage. [2025-09-30T18:19:54.309992] [INFO ] [MAIN ] DMB: Loaded 10202 existing records. [2025-09-30T18:19:54.513209] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:19:54.513450] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-30T18:19:54.513500] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-30T18:19:54.514110] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-30T18:19:54.514175] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-30T18:19:54.659531] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-30T18:19:54.917556] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:55.339678] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-30T18:19:55.454386] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-30T18:19:55.743104] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-30T18:19:56.032037] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T18:19:56.254377] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-30T18:19:57.054391] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-30T18:19:57.496410] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T18:19:57.854398] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-30T18:19:58.012560] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T18:19:58.546519] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T18:19:58.548511] [INFO ] [REMOTE ] DMA: Full fetch complete (6640 records). [2025-09-30T18:19:58.548601] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-30T18:19:58.654488] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-30T18:19:58.933412] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-30T18:19:58.933513] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-30T18:19:58.933794] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-30T18:19:58.933881] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-30T18:19:58.934372] [DEBUG] [LOCAL ] DMA: Trimmed 6640 records to 4549 (keeping 200 days of data) [2025-09-30T18:19:58.963695] [DEBUG] [LOCAL ] DMA: Primary data saved (4549 records). [2025-09-30T18:19:58.963860] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-30T18:19:58.963964] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DMA took 18.1s. Estimated remaining: 3h 39m 55s. Rate: 7.9 symbols/min [2025-09-30T18:19:59.148943] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:19:59.149160] [DEBUG] [LOCAL ] DMO: No existing data file found in primary storage. [2025-09-30T18:19:59.149205] [WARN ] [MAIN ] DMO: No existing data found, performing full refresh instead. [2025-09-30T18:19:59.149344] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-30T18:19:59.149386] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-30T18:19:59.149426] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-09-30T18:19:59.149459] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-30T18:19:59.458715] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-30T18:19:59.530390] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:19:59.817314] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T18:20:00.254401] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-30T18:20:01.054376] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-30T18:20:01.172598] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T18:20:01.337895] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T18:20:01.354924] [INFO ] [REMOTE ] DLR: Full fetch complete (74110 records). [2025-09-30T18:20:01.355995] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-30T18:20:01.787181] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-30T18:20:01.787284] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-30T18:20:01.788267] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-30T18:20:01.788344] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-30T18:20:01.790206] [DEBUG] [LOCAL ] DLR: Trimmed 74110 records to 50973 (keeping 200 days of data) [2025-09-30T18:20:01.859014] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-30T18:20:02.155182] [DEBUG] [LOCAL ] DLR: Primary data saved (50973 records). [2025-09-30T18:20:02.155355] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-30T18:20:02.155444] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DLR took 41.8s. Estimated remaining: 3h 39m 35s. Rate: 7.9 symbols/min [2025-09-30T18:20:02.376344] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:02.389325] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T18:20:02.398432] [INFO ] [REMOTE ] DLY: Full fetch complete (28198 records). [2025-09-30T18:20:02.398636] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-30T18:20:02.659265] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-30T18:20:02.755096] [DEBUG] [LOCAL ] DNA: Loaded 48248 existing records from primary storage. [2025-09-30T18:20:02.775906] [INFO ] [MAIN ] DNA: Loaded 48248 existing records. [2025-09-30T18:20:02.882247] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T18:20:03.023054] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-30T18:20:03.042843] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-30T18:20:03.043511] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-30T18:20:03.043920] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-30T18:20:03.137016] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:03.137255] [DEBUG] [LOCAL ] DLY: Trimmed 28198 records to 19680 (keeping 200 days of data) [2025-09-30T18:20:03.137883] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-30T18:20:03.137947] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-30T18:20:03.138972] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-30T18:20:03.139034] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-30T18:20:03.471796] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-30T18:20:03.482551] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T18:20:03.697433] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:03.714807] [DEBUG] [LOCAL ] DLY: Primary data saved (19680 records). [2025-09-30T18:20:03.714988] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-30T18:20:03.715159] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DLY took 34.5s. Estimated remaining: 3h 39m 11s. Rate: 7.9 symbols/min [2025-09-30T18:20:03.898219] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:03.947764] [DEBUG] [LOCAL ] DNOW: Loaded 43639 existing records from primary storage. [2025-09-30T18:20:03.948096] [INFO ] [MAIN ] DNOW: Loaded 43639 existing records. [2025-09-30T18:20:04.159765] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:04.160023] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-30T18:20:04.160088] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-30T18:20:04.160595] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-30T18:20:04.160697] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-30T18:20:04.259422] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-30T18:20:04.369671] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T18:20:04.580332] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:05.054357] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-30T18:20:05.226074] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T18:20:05.854358] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-30T18:20:05.872082] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T18:20:06.654500] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-30T18:20:06.663455] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T18:20:07.454362] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-30T18:20:07.994804] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T18:20:08.254373] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-30T18:20:08.286153] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T18:20:09.054440] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-30T18:20:09.854325] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-30T18:20:10.122685] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T18:20:10.561527] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T18:20:10.651906] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T18:20:10.654361] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-30T18:20:11.434293] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T18:20:11.454326] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-30T18:20:12.254331] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-30T18:20:12.402554] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T18:20:13.054379] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-30T18:20:13.623677] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T18:20:13.854336] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-30T18:20:14.050277] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T18:20:14.439481] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T18:20:14.654403] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-30T18:20:15.454425] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-30T18:20:16.254378] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-30T18:20:16.555342] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-30T18:20:16.648718] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T18:20:16.992524] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T18:20:17.054357] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-30T18:20:17.832775] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T18:20:17.854333] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-30T18:20:18.654371] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-30T18:20:19.454382] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-30T18:20:19.582267] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T18:20:19.613867] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T18:20:20.254365] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-30T18:20:20.839522] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:20:21.054362] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-30T18:20:21.095979] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T18:20:21.771605] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-30T18:20:21.854363] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-30T18:20:22.654388] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-30T18:20:23.342438] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T18:20:23.454371] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-30T18:20:24.230893] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:20:24.254349] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-30T18:20:25.054327] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-30T18:20:25.461449] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T18:20:25.854354] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-30T18:20:25.957386] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T18:20:25.961404] [INFO ] [REMOTE ] DMB: Full fetch complete (14986 records). [2025-09-30T18:20:25.961609] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-30T18:20:25.976933] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:20:25.988815] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:20:25.990543] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T18:20:25.989333] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:20:26.000152] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-30T18:20:26.000413] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-09-30T18:20:26.000471] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-09-30T18:20:26.001090] [DEBUG] [LOCAL ] DMB: Deleted derivative data file. [2025-09-30T18:20:26.001199] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMB took 31.9s. Estimated remaining: 3h 39m 44s. Rate: 7.9 symbols/min [2025-09-30T18:20:26.201791] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:26.246786] [DEBUG] [LOCAL ] DNP: Loaded 33167 existing records from primary storage. [2025-09-30T18:20:26.247133] [INFO ] [MAIN ] DNP: Loaded 33167 existing records. [2025-09-30T18:20:26.457925] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:26.458146] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-30T18:20:26.458244] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-30T18:20:26.458799] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-30T18:20:26.458861] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-30T18:20:26.663574] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-30T18:20:26.895925] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:26.904295] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T18:20:26.907275] [INFO ] [REMOTE ] DMO: Full fetch complete (14642 records). [2025-09-30T18:20:26.907383] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-30T18:20:27.305151] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-30T18:20:27.305283] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-30T18:20:27.305682] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-30T18:20:27.305747] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-30T18:20:27.306924] [DEBUG] [LOCAL ] DMO: Trimmed 14642 records to 9860 (keeping 200 days of data) [2025-09-30T18:20:27.389907] [DEBUG] [LOCAL ] DMO: Primary data saved (9860 records). [2025-09-30T18:20:27.390093] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-30T18:20:27.390202] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DMO took 28.4s. Estimated remaining: 3h 39m 19s. Rate: 7.9 symbols/min [2025-09-30T18:20:27.459572] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-30T18:20:27.628945] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:27.699608] [DEBUG] [LOCAL ] DOC: Loaded 53542 existing records from primary storage. [2025-09-30T18:20:27.699992] [INFO ] [MAIN ] DOC: Loaded 53542 existing records. [2025-09-30T18:20:27.882884] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:27.883182] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-30T18:20:27.883239] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-30T18:20:27.884388] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-30T18:20:27.884477] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-30T18:20:28.274109] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:28.268047] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-30T18:20:28.304967] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T18:20:28.780688] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T18:20:29.054349] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-30T18:20:29.697376] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T18:20:29.854355] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-30T18:20:30.654379] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-30T18:20:31.020786] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-30T18:20:31.454398] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-30T18:20:31.579222] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T18:20:32.254355] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-30T18:20:32.643764] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T18:20:32.733894] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-30T18:20:33.054397] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-30T18:20:33.854397] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-30T18:20:34.353451] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T18:20:34.571818] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-30T18:20:34.654451] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-30T18:20:35.093214] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T18:20:35.454416] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-30T18:20:36.254351] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-30T18:20:36.354450] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T18:20:36.365084] [INFO ] [REMOTE ] DNA: Full fetch complete (70884 records). [2025-09-30T18:20:36.365358] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-30T18:20:36.826857] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-30T18:20:36.827077] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-30T18:20:36.828240] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-30T18:20:36.828387] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-30T18:20:36.830705] [DEBUG] [LOCAL ] DNA: Trimmed 70884 records to 48267 (keeping 200 days of data) [2025-09-30T18:20:36.951662] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T18:20:37.075687] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-30T18:20:37.167691] [DEBUG] [LOCAL ] DNA: Primary data saved (48267 records). [2025-09-30T18:20:37.167893] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-30T18:20:37.168011] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNA took 35.0s. Estimated remaining: 3h 39m 18s. Rate: 7.9 symbols/min [2025-09-30T18:20:37.676515] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T18:20:37.686763] [INFO ] [REMOTE ] DNOW: Full fetch complete (62805 records). [2025-09-30T18:20:37.686926] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-30T18:20:37.864876] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-30T18:20:38.136151] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-30T18:20:38.136237] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-30T18:20:38.137238] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-30T18:20:38.137307] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-30T18:20:38.138803] [DEBUG] [LOCAL ] DNOW: Trimmed 62805 records to 43657 (keeping 200 days of data) [2025-09-30T18:20:38.414344] [DEBUG] [LOCAL ] DNOW: Primary data saved (43657 records). [2025-09-30T18:20:38.414477] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-30T18:20:38.414561] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNOW took 34.7s. Estimated remaining: 3h 38m 53s. Rate: 7.9 symbols/min [2025-09-30T18:20:38.740347] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T18:20:38.753040] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-30T18:20:39.089559] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-30T18:20:39.454355] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-30T18:20:40.717161] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T18:20:40.729441] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-30T18:20:40.757590] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-30T18:20:41.054358] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-30T18:20:42.402759] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T18:20:42.416087] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T18:20:42.416555] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-30T18:20:42.654417] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-30T18:20:43.535921] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T18:20:43.545020] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-30T18:20:44.362714] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T18:20:44.374488] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-30T18:20:45.043548] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T18:20:45.054301] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-30T18:20:46.075747] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:20:46.087195] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-30T18:20:46.398278] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:20:46.654412] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-30T18:20:48.023012] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:20:48.056503] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-30T18:20:48.058932] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T18:20:48.066466] [INFO ] [REMOTE ] DNP: Full fetch complete (49359 records). [2025-09-30T18:20:48.066575] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-30T18:20:48.497621] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-30T18:20:48.497746] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-30T18:20:48.498498] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-30T18:20:48.498570] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-30T18:20:48.499941] [DEBUG] [LOCAL ] DNP: Trimmed 49359 records to 33200 (keeping 200 days of data) [2025-09-30T18:20:48.706254] [DEBUG] [LOCAL ] DNP: Primary data saved (33200 records). [2025-09-30T18:20:48.706447] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-30T18:20:48.707150] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DNP took 22.7s. Estimated remaining: 3h 38m 53s. Rate: 7.9 symbols/min [2025-09-30T18:20:49.773948] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T18:20:49.786181] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-30T18:20:51.628721] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T18:20:51.640580] [INFO ] [REMOTE ] DOC: Full fetch complete (77389 records). [2025-09-30T18:20:51.640769] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-30T18:20:52.074791] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-30T18:20:52.074881] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-30T18:20:52.075820] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-30T18:20:52.075892] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-30T18:20:52.077403] [DEBUG] [LOCAL ] DOC: Trimmed 77389 records to 53542 (keeping 200 days of data) [2025-09-30T18:20:52.430078] [DEBUG] [LOCAL ] DOC: Primary data saved (53542 records). [2025-09-30T18:20:52.430230] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-30T18:20:52.430317] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DOC took 25.0s. Estimated remaining: 3h 38m 35s. Rate: 7.9 symbols/min [2025-09-30T18:20:53.074815] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:53.162378] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:53.246138] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:53.283210] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-09-30T18:20:53.298800] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-09-30T18:20:53.306529] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:20:53.308520] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-30T18:20:53.309133] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-30T18:20:53.309209] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-09-30T18:20:53.309249] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-30T18:20:53.554237] [DEBUG] [LOCAL ] DOLE: Loaded 38140 existing records from primary storage. [2025-09-30T18:20:53.621021] [DEBUG] [LOCAL ] DOCN: Loaded 50511 existing records from primary storage. [2025-09-30T18:20:53.619703] [DEBUG] [LOCAL ] DOUG: Loaded 34627 existing records from primary storage. [2025-09-30T18:20:53.626991] [INFO ] [MAIN ] DOLE: Loaded 38140 existing records. [2025-09-30T18:20:53.627269] [INFO ] [MAIN ] DOCN: Loaded 50511 existing records. [2025-09-30T18:20:53.670809] [INFO ] [MAIN ] DOUG: Loaded 34627 existing records. [2025-09-30T18:20:54.348022] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:54.442878] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:54.438570] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:54.443191] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-30T18:20:54.447101] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:20:54.411001] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-30T18:20:54.448552] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-30T18:20:54.448708] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-30T18:20:54.448490] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-30T18:20:54.448804] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-30T18:20:54.449004] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-30T18:20:54.449417] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-30T18:20:54.449507] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-30T18:20:54.449478] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-30T18:20:54.455007] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-30T18:20:54.461612] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-30T18:20:54.473864] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-30T18:20:55.541248] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:55.567090] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-30T18:20:55.689817] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:55.707467] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-30T18:20:55.765845] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:20:55.766454] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-30T18:20:56.053884] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:20:56.064586] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-30T18:20:57.102503] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T18:20:57.111771] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-30T18:20:57.156687] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T18:20:57.164331] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-30T18:20:57.355565] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T18:20:57.366964] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-30T18:20:57.840083] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-30T18:20:57.849317] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-30T18:20:58.132545] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T18:20:58.140801] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-30T18:20:58.714526] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:20:58.724431] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-30T18:20:59.034448] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T18:20:59.041331] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-30T18:20:59.225288] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:20:59.234007] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-30T18:20:59.268728] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-30T18:20:59.454411] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-30T18:21:00.327470] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T18:21:00.336181] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-30T18:21:00.486790] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T18:21:00.662736] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T18:21:01.054396] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-30T18:21:01.471917] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T18:21:01.612494] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T18:21:01.854375] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-30T18:21:02.405710] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T18:21:02.654429] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-30T18:21:03.305145] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:21:03.454376] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-30T18:21:03.965801] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T18:21:04.254417] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-30T18:21:05.054369] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-30T18:21:05.093826] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T18:21:05.830176] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T18:21:05.854336] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-30T18:21:06.540218] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T18:21:06.654325] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-30T18:21:07.315448] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T18:21:07.454396] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-30T18:21:08.254334] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-30T18:21:08.532730] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T18:21:09.054371] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-30T18:21:09.124555] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T18:21:09.728690] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T18:21:09.854385] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-30T18:21:10.654330] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-30T18:21:10.845602] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T18:21:11.259079] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T18:21:11.454364] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-30T18:21:12.169437] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T18:21:12.254352] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-30T18:21:13.054394] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-30T18:21:13.133405] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T18:21:13.854392] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-30T18:21:14.026611] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:21:14.036670] [INFO ] [REMOTE ] DOLE: Full fetch complete (53655 records). [2025-09-30T18:21:14.036836] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-30T18:21:14.472467] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-30T18:21:14.472576] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-30T18:21:14.473602] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-30T18:21:14.473701] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-30T18:21:14.475534] [DEBUG] [LOCAL ] DOLE: Trimmed 53655 records to 38292 (keeping 200 days of data) [2025-09-30T18:21:14.661404] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-30T18:21:14.740222] [DEBUG] [LOCAL ] DOLE: Primary data saved (38292 records). [2025-09-30T18:21:14.740978] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-30T18:21:14.742159] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOLE took 22.3s. Estimated remaining: 3h 39m 7s. Rate: 7.9 symbols/min [2025-09-30T18:21:14.995569] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:15.003373] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-30T18:21:15.064613] [DEBUG] [LOCAL ] DOV: Loaded 45536 existing records from primary storage. [2025-09-30T18:21:15.065023] [INFO ] [MAIN ] DOV: Loaded 45536 existing records. [2025-09-30T18:21:15.303990] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:21:15.304395] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-30T18:21:15.304453] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-30T18:21:15.305955] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-30T18:21:15.306018] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-30T18:21:15.468449] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-30T18:21:15.744408] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:15.780721] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T18:21:16.062958] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T18:21:16.254420] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-30T18:21:16.944144] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T18:21:16.955071] [INFO ] [REMOTE ] DOCS: Full fetch complete (73792 records). [2025-09-30T18:21:16.955268] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-30T18:21:16.956275] [FATAL] [VALIDATOR ] DOCS: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:21:16.956368] [FATAL] [MAIN ] DOCS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:21:16.956496] [WARN ] [MAIN ] DOCS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:21:16.956574] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-30T18:21:16.956663] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-09-30T18:21:16.956724] [INFO ] [LOCAL ] DOCS: Starting deletion of derivative data. [2025-09-30T18:21:16.956795] [DEBUG] [LOCAL ] DOCS: No derivative data file found to delete. [2025-09-30T18:21:16.956881] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOCS took 24.5s. Estimated remaining: 3h 38m 45s. Rate: 7.9 symbols/min [2025-09-30T18:21:17.059635] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-30T18:21:17.147794] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:17.148025] [DEBUG] [LOCAL ] DOW: No existing data file found in primary storage. [2025-09-30T18:21:17.148069] [WARN ] [MAIN ] DOW: No existing data found, performing full refresh instead. [2025-09-30T18:21:17.148220] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-30T18:21:17.148274] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-30T18:21:17.148319] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-09-30T18:21:17.148352] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-30T18:21:17.576943] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:17.854337] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-30T18:21:17.962460] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-30T18:21:18.461300] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T18:21:18.654395] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-30T18:21:19.454427] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-30T18:21:19.944834] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-30T18:21:20.254357] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-30T18:21:20.576439] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T18:21:21.054357] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-30T18:21:21.144564] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T18:21:21.802852] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:21:21.854338] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-30T18:21:22.408849] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T18:21:22.416586] [INFO ] [REMOTE ] DOUG: Full fetch complete (51269 records). [2025-09-30T18:21:22.416751] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-30T18:21:22.661316] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-30T18:21:22.841091] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-30T18:21:22.841254] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-30T18:21:22.842202] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-30T18:21:22.842271] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-30T18:21:22.843481] [DEBUG] [LOCAL ] DOUG: Trimmed 51269 records to 34546 (keeping 200 days of data) [2025-09-30T18:21:23.046144] [DEBUG] [LOCAL ] DOUG: Primary data saved (34546 records). [2025-09-30T18:21:23.046300] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-30T18:21:23.046392] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOUG took 30.6s. Estimated remaining: 3h 38m 33s. Rate: 7.9 symbols/min [2025-09-30T18:21:23.234217] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:23.250131] [DEBUG] [LOCAL ] DPG: Loaded 13524 existing records from primary storage. [2025-09-30T18:21:23.250374] [INFO ] [MAIN ] DPG: Loaded 13524 existing records. [2025-09-30T18:21:23.447835] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:21:23.448242] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-30T18:21:23.448380] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-30T18:21:23.449029] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-30T18:21:23.449089] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-30T18:21:23.460567] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-30T18:21:23.707518] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T18:21:23.925177] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:24.259511] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-30T18:21:24.284857] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T18:21:25.054334] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-30T18:21:25.218909] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T18:21:25.461796] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T18:21:25.854356] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-30T18:21:26.654391] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-30T18:21:27.211553] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T18:21:27.375506] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T18:21:27.454396] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-30T18:21:28.254474] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-30T18:21:28.586619] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T18:21:28.604167] [INFO ] [REMOTE ] DOCN: Full fetch complete (71601 records). [2025-09-30T18:21:28.604444] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-30T18:21:29.065529] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-30T18:21:29.120692] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-30T18:21:29.121085] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-30T18:21:29.134213] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-30T18:21:29.136106] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-30T18:21:29.135834] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T18:21:29.143168] [DEBUG] [LOCAL ] DOCN: Trimmed 71601 records to 50539 (keeping 200 days of data) [2025-09-30T18:21:29.266136] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T18:21:29.495694] [DEBUG] [LOCAL ] DOCN: Primary data saved (50539 records). [2025-09-30T18:21:29.495862] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-30T18:21:29.495990] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCN took 37.1s. Estimated remaining: 3h 38m 22s. Rate: 7.9 symbols/min [2025-09-30T18:21:29.693069] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:29.693267] [DEBUG] [LOCAL ] DQ: No existing data file found in primary storage. [2025-09-30T18:21:29.693307] [WARN ] [MAIN ] DQ: No existing data found, performing full refresh instead. [2025-09-30T18:21:29.693460] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-30T18:21:29.693502] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-30T18:21:29.693676] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-09-30T18:21:29.693732] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-30T18:21:29.865963] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-30T18:21:30.114258] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:30.634979] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T18:21:30.654335] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-30T18:21:31.394332] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-30T18:21:31.454377] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-30T18:21:31.500605] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T18:21:32.254368] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-30T18:21:33.054376] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-30T18:21:33.348271] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-30T18:21:33.854327] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-30T18:21:34.422720] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-30T18:21:34.462711] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T18:21:34.654426] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-30T18:21:35.128754] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T18:21:35.454406] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-30T18:21:35.847524] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T18:21:36.254407] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-30T18:21:36.529447] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T18:21:37.054382] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-30T18:21:37.854733] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-30T18:21:37.858679] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T18:21:38.654352] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-30T18:21:39.013765] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-30T18:21:39.314831] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T18:21:39.400941] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T18:21:39.454393] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-30T18:21:40.254409] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-30T18:21:41.054333] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-30T18:21:41.083744] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T18:21:41.854398] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-30T18:21:41.871274] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T18:21:41.976416] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T18:21:42.654405] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-30T18:21:43.454377] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-30T18:21:43.598500] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T18:21:43.952755] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-30T18:21:44.254399] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-30T18:21:45.054353] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-30T18:21:45.147907] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T18:21:45.370554] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T18:21:45.854394] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-30T18:21:46.654414] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-30T18:21:47.213220] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-30T18:21:47.454340] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-30T18:21:47.943870] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-30T18:21:48.073871] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T18:21:48.254351] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-30T18:21:48.484369] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T18:21:48.488699] [INFO ] [REMOTE ] DPG: Full fetch complete (18967 records). [2025-09-30T18:21:48.488909] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-30T18:21:48.489904] [FATAL] [VALIDATOR ] DPG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:21:48.489996] [FATAL] [MAIN ] DPG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:21:48.490041] [WARN ] [MAIN ] DPG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:21:48.490091] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-30T18:21:48.490175] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-09-30T18:21:48.490236] [INFO ] [LOCAL ] DPG: Starting deletion of derivative data. [2025-09-30T18:21:48.490964] [DEBUG] [LOCAL ] DPG: Deleted derivative data file. [2025-09-30T18:21:48.491121] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DPG took 25.4s. Estimated remaining: 3h 38m 45s. Rate: 7.9 symbols/min [2025-09-30T18:21:48.686582] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:48.729542] [DEBUG] [LOCAL ] DRD: Loaded 36927 existing records from primary storage. [2025-09-30T18:21:48.729932] [INFO ] [MAIN ] DRD: Loaded 36927 existing records. [2025-09-30T18:21:48.931177] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:21:48.931415] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-30T18:21:48.931493] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-30T18:21:48.932858] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-30T18:21:48.932933] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-30T18:21:49.055322] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-30T18:21:49.337803] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:49.854328] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-30T18:21:50.214357] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T18:21:50.409341] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T18:21:50.422399] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-09-30T18:21:50.422593] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-30T18:21:50.664479] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-30T18:21:50.880567] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-30T18:21:50.880704] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-30T18:21:50.881923] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-30T18:21:50.882010] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-30T18:21:50.885748] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 53733 (keeping 200 days of data) [2025-09-30T18:21:51.147206] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T18:21:51.268339] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-09-30T18:21:51.268513] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-30T18:21:51.268677] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DOW took 34.3s. Estimated remaining: 3h 38m 25s. Rate: 7.9 symbols/min [2025-09-30T18:21:51.451360] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:51.454386] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-30T18:21:51.504713] [DEBUG] [LOCAL ] DRH: Loaded 50452 existing records from primary storage. [2025-09-30T18:21:51.505085] [INFO ] [MAIN ] DRH: Loaded 50452 existing records. [2025-09-30T18:21:51.718512] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:21:51.718839] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-30T18:21:51.718937] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-30T18:21:51.720363] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-30T18:21:51.720437] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-30T18:21:52.192062] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:52.254399] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-30T18:21:52.418302] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T18:21:52.429259] [INFO ] [REMOTE ] DOV: Full fetch complete (64861 records). [2025-09-30T18:21:52.429429] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-30T18:21:52.430226] [FATAL] [VALIDATOR ] DOV: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:21:52.430315] [FATAL] [MAIN ] DOV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:21:52.430359] [WARN ] [MAIN ] DOV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:21:52.430428] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-30T18:21:52.430507] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-09-30T18:21:52.430567] [INFO ] [LOCAL ] DOV: Starting deletion of derivative data. [2025-09-30T18:21:52.430901] [DEBUG] [LOCAL ] DOV: Deleted derivative data file. [2025-09-30T18:21:52.432482] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DOV took 37.7s. Estimated remaining: 3h 38m 0s. Rate: 7.9 symbols/min [2025-09-30T18:21:52.627013] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:21:52.627258] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-09-30T18:21:52.627302] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-09-30T18:21:52.627444] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-30T18:21:52.627521] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-30T18:21:52.627582] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-09-30T18:21:52.627617] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-30T18:21:53.055140] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-30T18:21:53.059384] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:21:53.275782] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T18:21:53.848741] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T18:21:53.861691] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-30T18:21:54.364300] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T18:21:54.654380] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-30T18:21:55.454333] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-30T18:21:55.532531] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:21:55.972152] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:21:56.254368] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-30T18:21:56.952068] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T18:21:57.054378] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-30T18:21:57.696329] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T18:21:57.854372] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-30T18:21:58.231247] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T18:21:58.654371] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-30T18:21:59.454389] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-30T18:21:59.666826] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:21:59.680231] [INFO ] [REMOTE ] DQ: Full fetch complete (62993 records). [2025-09-30T18:21:59.680400] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-30T18:22:00.127211] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-30T18:22:00.127326] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-30T18:22:00.128285] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-30T18:22:00.128383] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-30T18:22:00.153855] [DEBUG] [LOCAL ] DQ: Trimmed 62993 records to 43336 (keeping 200 days of data) [2025-09-30T18:22:00.154749] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:22:00.254607] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-30T18:22:00.430919] [DEBUG] [LOCAL ] DQ: Primary data saved (43336 records). [2025-09-30T18:22:00.431170] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-30T18:22:00.431336] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DQ took 30.9s. Estimated remaining: 3h 37m 54s. Rate: 7.9 symbols/min [2025-09-30T18:22:00.610223] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:22:00.610451] [DEBUG] [LOCAL ] DRLL: No existing data file found in primary storage. [2025-09-30T18:22:00.610510] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-09-30T18:22:00.610669] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-30T18:22:00.610731] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-30T18:22:00.610820] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-09-30T18:22:00.610866] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-30T18:22:01.019002] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:22:01.054413] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-30T18:22:01.168776] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T18:22:01.707384] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T18:22:01.742241] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T18:22:01.854359] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-30T18:22:02.654397] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-30T18:22:03.367208] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T18:22:03.461008] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-30T18:22:03.464721] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T18:22:04.254381] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-30T18:22:04.768555] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T18:22:05.005488] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T18:22:05.054329] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-30T18:22:05.854404] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-30T18:22:06.263831] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T18:22:06.654361] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-30T18:22:07.305038] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T18:22:07.454367] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-30T18:22:08.254336] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-30T18:22:08.442745] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T18:22:08.546244] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:22:09.054406] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-30T18:22:09.675609] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T18:22:09.854400] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-30T18:22:10.654373] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-30T18:22:10.779741] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T18:22:11.454401] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-30T18:22:11.667800] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:22:11.679622] [INFO ] [REMOTE ] DRD: Full fetch complete (49620 records). [2025-09-30T18:22:11.679852] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-30T18:22:12.235043] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T18:22:12.259348] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-30T18:22:12.300173] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-30T18:22:12.300311] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-30T18:22:12.301412] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-30T18:22:12.301833] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-30T18:22:12.303890] [DEBUG] [LOCAL ] DRD: Trimmed 49620 records to 36875 (keeping 200 days of data) [2025-09-30T18:22:12.447447] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:22:12.621902] [DEBUG] [LOCAL ] DRD: Primary data saved (36875 records). [2025-09-30T18:22:12.622117] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-30T18:22:12.622397] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRD took 24.1s. Estimated remaining: 3h 37m 58s. Rate: 7.9 symbols/min [2025-09-30T18:22:12.820217] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:22:12.859122] [DEBUG] [LOCAL ] DSL: Loaded 28288 existing records from primary storage. [2025-09-30T18:22:12.859425] [INFO ] [MAIN ] DSL: Loaded 28288 existing records. [2025-09-30T18:22:13.076684] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:22:13.073445] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-30T18:22:13.079404] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-30T18:22:13.080605] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-30T18:22:13.080757] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-30T18:22:13.084897] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-30T18:22:13.084963] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-30T18:22:13.482035] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:22:13.854374] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-30T18:22:14.654361] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-30T18:22:14.688955] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T18:22:14.821765] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T18:22:15.454393] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-30T18:22:16.254370] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-30T18:22:16.444936] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:22:16.876107] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T18:22:17.054371] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-30T18:22:17.544167] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T18:22:17.854391] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-30T18:22:17.913448] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T18:22:18.654368] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-30T18:22:19.432444] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T18:22:19.454305] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-30T18:22:19.576627] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-30T18:22:20.254379] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-30T18:22:20.691623] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T18:22:20.694264] [INFO ] [REMOTE ] DRLL: Full fetch complete (15582 records). [2025-09-30T18:22:20.694569] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-30T18:22:21.059468] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-30T18:22:21.107348] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-30T18:22:21.107433] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-30T18:22:21.107857] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-30T18:22:21.107948] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-30T18:22:21.108581] [DEBUG] [LOCAL ] DRLL: Trimmed 15582 records to 9497 (keeping 200 days of data) [2025-09-30T18:22:21.171878] [DEBUG] [LOCAL ] DRLL: Primary data saved (9497 records). [2025-09-30T18:22:21.172012] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-30T18:22:21.172088] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRLL took 20.7s. Estimated remaining: 3h 37m 53s. Rate: 7.9 symbols/min [2025-09-30T18:22:21.361969] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:22:21.362193] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-09-30T18:22:21.362239] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-09-30T18:22:21.362371] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-30T18:22:21.362413] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-30T18:22:21.362455] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-09-30T18:22:21.362488] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-30T18:22:21.763570] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:22:21.798971] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T18:22:21.854367] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-30T18:22:22.656955] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-30T18:22:22.663112] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T18:22:22.903661] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T18:22:23.454415] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-30T18:22:23.875431] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T18:22:24.182301] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T18:22:24.254414] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-30T18:22:25.054527] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-30T18:22:25.856911] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-30T18:22:25.862866] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T18:22:26.654405] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-30T18:22:26.741737] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T18:22:26.798301] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T18:22:27.454321] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-30T18:22:27.968114] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T18:22:28.254404] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-30T18:22:28.636620] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T18:22:29.054410] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-30T18:22:29.854390] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-30T18:22:30.239098] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:22:30.249942] [INFO ] [REMOTE ] DRI: Full fetch complete (69598 records). [2025-09-30T18:22:30.250117] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-30T18:22:30.678669] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-30T18:22:30.703027] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-30T18:22:30.704027] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-30T18:22:30.704882] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-30T18:22:30.705112] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-30T18:22:30.707011] [DEBUG] [LOCAL ] DRI: Trimmed 69598 records to 47780 (keeping 200 days of data) [2025-09-30T18:22:30.863667] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T18:22:31.086717] [DEBUG] [LOCAL ] DRI: Primary data saved (47780 records). [2025-09-30T18:22:31.086892] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-30T18:22:31.087078] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRI took 38.7s. Estimated remaining: 3h 37m 52s. Rate: 7.9 symbols/min [2025-09-30T18:22:31.163586] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T18:22:31.309409] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:22:31.314353] [DEBUG] [LOCAL ] DSMC: Loaded 1912 existing records from primary storage. [2025-09-30T18:22:31.314542] [INFO ] [MAIN ] DSMC: Loaded 1912 existing records. [2025-09-30T18:22:31.459563] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-30T18:22:31.542429] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:22:31.542725] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-30T18:22:31.542788] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-30T18:22:31.542982] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-30T18:22:31.543041] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-30T18:22:31.909560] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T18:22:31.979541] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:22:32.254371] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-30T18:22:32.883740] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T18:22:32.905411] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:22:33.054362] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-30T18:22:33.854368] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-30T18:22:34.121023] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T18:22:34.654408] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-30T18:22:35.454343] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-30T18:22:35.545687] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T18:22:35.557492] [INFO ] [REMOTE ] DRH: Full fetch complete (71856 records). [2025-09-30T18:22:35.557680] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-30T18:22:35.693568] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T18:22:35.995250] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T18:22:36.020857] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-30T18:22:36.020939] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-30T18:22:36.021995] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-30T18:22:36.022063] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-30T18:22:36.023560] [DEBUG] [LOCAL ] DRH: Trimmed 71856 records to 50465 (keeping 200 days of data) [2025-09-30T18:22:36.254438] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-30T18:22:36.339488] [DEBUG] [LOCAL ] DRH: Primary data saved (50465 records). [2025-09-30T18:22:36.339665] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-30T18:22:36.339789] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRH took 45.1s. Estimated remaining: 3h 37m 38s. Rate: 7.9 symbols/min [2025-09-30T18:22:36.542181] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:22:36.566344] [DEBUG] [LOCAL ] DSU: Loaded 22497 existing records from primary storage. [2025-09-30T18:22:36.566617] [INFO ] [MAIN ] DSU: Loaded 22497 existing records. [2025-09-30T18:22:36.767531] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:22:36.767801] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-30T18:22:36.767853] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-30T18:22:36.768671] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-30T18:22:36.768752] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-30T18:22:37.059505] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-30T18:22:37.161797] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:22:37.285232] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T18:22:37.369984] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-30T18:22:37.854382] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-30T18:22:38.338576] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-30T18:22:38.654384] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-30T18:22:39.030406] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-30T18:22:39.454410] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-30T18:22:40.254435] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-30T18:22:40.789885] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T18:22:41.054365] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-30T18:22:41.238332] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T18:22:41.860804] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-30T18:22:41.865028] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T18:22:42.300533] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-30T18:22:42.654365] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-30T18:22:43.113406] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-30T18:22:43.454375] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-30T18:22:43.742424] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-30T18:22:44.254405] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-30T18:22:45.054332] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-30T18:22:45.082310] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T18:22:45.854366] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-30T18:22:45.926695] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-30T18:22:46.654346] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-30T18:22:46.963529] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-30T18:22:47.225885] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T18:22:47.454368] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-30T18:22:48.254400] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-30T18:22:48.277975] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T18:22:48.841803] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T18:22:48.842896] [INFO ] [REMOTE ] DSMC: Full fetch complete (2881 records). [2025-09-30T18:22:48.842970] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-30T18:22:49.062540] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-30T18:22:49.254228] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-30T18:22:49.254348] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-30T18:22:49.254506] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-30T18:22:49.254554] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-30T18:22:49.255017] [DEBUG] [LOCAL ] DSMC: Trimmed 2881 records to 1896 (keeping 200 days of data) [2025-09-30T18:22:49.268260] [DEBUG] [LOCAL ] DSMC: Primary data saved (1896 records). [2025-09-30T18:22:49.268386] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-30T18:22:49.268491] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSMC took 18.2s. Estimated remaining: 3h 37m 44s. Rate: 7.9 symbols/min [2025-09-30T18:22:49.458947] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:22:49.459128] [DEBUG] [LOCAL ] DSX: No existing data file found in primary storage. [2025-09-30T18:22:49.459168] [WARN ] [MAIN ] DSX: No existing data found, performing full refresh instead. [2025-09-30T18:22:49.459315] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-30T18:22:49.459390] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-30T18:22:49.459453] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-09-30T18:22:49.459489] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-30T18:22:49.853858] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:22:49.854224] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-30T18:22:50.248933] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T18:22:50.654360] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-30T18:22:51.396790] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T18:22:51.454397] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-30T18:22:52.254385] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-30T18:22:53.054358] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-30T18:23:04.673322] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (13.22 seconds). [2025-09-30T18:23:04.678868] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-30T18:23:05.392312] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (14.74 seconds). [2025-09-30T18:23:05.395914] [INFO ] [REMOTE ] DSM: Full fetch complete (24581 records). [2025-09-30T18:23:05.396005] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-30T18:23:05.396531] [FATAL] [VALIDATOR ] DSM: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:23:05.396620] [FATAL] [MAIN ] DSM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:23:05.396705] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:23:05.396758] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-30T18:23:05.396841] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-09-30T18:23:05.396898] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-09-30T18:23:05.396944] [DEBUG] [LOCAL ] DSM: No derivative data file found to delete. [2025-09-30T18:23:05.397004] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSM took 44.2s. Estimated remaining: 3h 37m 59s. Rate: 7.9 symbols/min [2025-09-30T18:23:05.591155] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:05.651394] [DEBUG] [LOCAL ] DT: Loaded 52927 existing records from primary storage. [2025-09-30T18:23:05.651782] [INFO ] [MAIN ] DT: Loaded 52927 existing records. [2025-09-30T18:23:05.842179] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:05.842390] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-30T18:23:05.842439] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-30T18:23:05.843932] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-30T18:23:05.844013] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-30T18:23:06.243011] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:06.243341] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-30T18:23:06.512904] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T18:23:06.518963] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-30T18:23:07.840538] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T18:23:07.850174] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (14.80 seconds). [2025-09-30T18:23:07.862450] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-30T18:23:07.862780] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-30T18:23:08.561188] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (16.31 seconds). [2025-09-30T18:23:08.568109] [INFO ] [REMOTE ] DSL: Full fetch complete (41464 records). [2025-09-30T18:23:08.568264] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-30T18:23:09.031575] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-30T18:23:09.033439] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T18:23:09.040695] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-30T18:23:09.039837] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-30T18:23:09.042507] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-30T18:23:09.042765] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-30T18:23:09.062524] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T18:23:09.062724] [DEBUG] [LOCAL ] DSL: Trimmed 41464 records to 28412 (keeping 200 days of data) [2025-09-30T18:23:09.070271] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-30T18:23:09.257799] [DEBUG] [LOCAL ] DSL: Primary data saved (28412 records). [2025-09-30T18:23:09.257981] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-30T18:23:09.258086] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSL took 56.6s. Estimated remaining: 3h 37m 42s. Rate: 7.9 symbols/min [2025-09-30T18:23:09.453921] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:09.461346] [DEBUG] [LOCAL ] DTB: Loaded 4788 existing records from primary storage. [2025-09-30T18:23:09.461532] [INFO ] [MAIN ] DTB: Loaded 4788 existing records. [2025-09-30T18:23:09.679340] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:09.679622] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-30T18:23:09.679706] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-30T18:23:09.680086] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-30T18:23:09.680150] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-30T18:23:10.137979] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:10.139117] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-30T18:23:10.155717] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T18:23:10.161569] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-30T18:23:10.228768] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T18:23:10.233097] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-30T18:23:10.705535] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (4.46 seconds). [2025-09-30T18:23:10.717113] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-30T18:23:10.796448] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T18:23:10.799810] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-30T18:23:11.327226] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T18:23:11.334375] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-30T18:23:11.383295] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T18:23:11.385035] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-30T18:23:11.854030] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T18:23:11.855594] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-30T18:23:11.927590] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T18:23:11.933606] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-30T18:23:12.322822] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T18:23:12.334081] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-30T18:23:12.473617] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T18:23:12.475227] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-30T18:23:12.530904] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T18:23:12.537220] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-30T18:23:12.813101] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T18:23:12.819636] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-30T18:23:12.963539] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T18:23:12.966027] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-30T18:23:13.369486] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T18:23:13.370251] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T18:23:13.377454] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-30T18:23:13.378804] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-30T18:23:13.491542] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T18:23:13.497152] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-30T18:23:13.797237] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T18:23:13.799354] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-30T18:23:13.999958] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:23:14.011302] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-30T18:23:14.389133] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T18:23:14.606234] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T18:23:14.613168] [INFO ] [REMOTE ] DSU: Full fetch complete (32748 records). [2025-09-30T18:23:14.613289] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-30T18:23:14.662102] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-30T18:23:14.845189] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T18:23:14.941789] [INFO ] [REMOTE ] DSX: Full fetch complete (36733 records). [2025-09-30T18:23:14.961545] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-30T18:23:15.257132] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-30T18:23:15.274580] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-30T18:23:15.308064] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-30T18:23:15.343901] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-30T18:23:15.431895] [DEBUG] [LOCAL ] DSU: Trimmed 32748 records to 22526 (keeping 200 days of data) [2025-09-30T18:23:15.461090] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T18:23:15.551050] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-30T18:23:15.621581] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-30T18:23:15.621769] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-30T18:23:15.660150] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-30T18:23:15.661302] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-30T18:23:15.667213] [DEBUG] [LOCAL ] DSX: Trimmed 36733 records to 24002 (keeping 200 days of data) [2025-09-30T18:23:15.870075] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T18:23:15.896680] [DEBUG] [LOCAL ] DSX: Primary data saved (24002 records). [2025-09-30T18:23:15.898110] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-30T18:23:15.898889] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSX took 26.6s. Estimated remaining: 3h 37m 32s. Rate: 7.9 symbols/min [2025-09-30T18:23:16.117232] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:16.123116] [DEBUG] [LOCAL ] DSU: Primary data saved (22526 records). [2025-09-30T18:23:16.123336] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-30T18:23:16.123443] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSU took 39.8s. Estimated remaining: 3h 37m 5s. Rate: 7.9 symbols/min [2025-09-30T18:23:16.261785] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-30T18:23:16.341611] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T18:23:16.363881] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:16.366809] [INFO ] [REMOTE ] DTB: Full fetch complete (6767 records). [2025-09-30T18:23:16.366994] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-30T18:23:16.367243] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-30T18:23:16.367380] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-30T18:23:16.367565] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-30T18:23:16.368290] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:23:16.367839] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-30T18:23:16.369276] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-30T18:23:16.369105] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:23:16.369464] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-30T18:23:16.369768] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:23:16.375081] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-30T18:23:16.399179] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-09-30T18:23:16.451930] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-09-30T18:23:16.492912] [DEBUG] [LOCAL ] DTE: Loaded 47796 existing records from primary storage. [2025-09-30T18:23:16.504623] [INFO ] [MAIN ] DTE: Loaded 47796 existing records. [2025-09-30T18:23:16.510766] [DEBUG] [LOCAL ] DTB: Deleted derivative data file. [2025-09-30T18:23:16.517969] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTB took 7.3s. Estimated remaining: 3h 36m 38s. Rate: 7.9 symbols/min [2025-09-30T18:23:17.138636] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:17.131487] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:17.143638] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-30T18:23:17.144321] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-30T18:23:17.165736] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-30T18:23:17.165948] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-30T18:23:17.247558] [DEBUG] [LOCAL ] DTG: Loaded 5880 existing records from primary storage. [2025-09-30T18:23:17.265913] [INFO ] [MAIN ] DTG: Loaded 5880 existing records. [2025-09-30T18:23:17.357857] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:17.378669] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-30T18:23:17.797810] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:17.803943] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-30T18:23:17.819687] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-30T18:23:17.846845] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-30T18:23:17.888818] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:17.889104] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-30T18:23:17.890071] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-30T18:23:18.035278] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T18:23:18.350807] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:18.354333] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-30T18:23:18.654417] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-30T18:23:19.353384] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T18:23:19.454381] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-30T18:23:19.778850] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-30T18:23:20.254339] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-30T18:23:20.467175] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T18:23:21.054410] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-30T18:23:21.615620] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T18:23:21.854376] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-30T18:23:21.900674] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T18:23:22.212187] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-30T18:23:22.654415] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-30T18:23:23.454431] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-30T18:23:23.910471] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T18:23:24.254348] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-30T18:23:24.332882] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:23:25.054359] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-30T18:23:25.854443] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-30T18:23:25.958989] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:23:26.159298] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-30T18:23:26.339496] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T18:23:26.654402] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-30T18:23:27.255162] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T18:23:27.454373] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-30T18:23:28.028202] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T18:23:28.254407] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-30T18:23:29.054372] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-30T18:23:29.854450] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-30T18:23:30.093070] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T18:23:30.374928] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-30T18:23:30.654421] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-30T18:23:30.953578] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T18:23:31.454409] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-30T18:23:32.097966] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T18:23:32.254368] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-30T18:23:32.987669] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T18:23:33.054389] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-30T18:23:33.225618] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T18:23:33.418078] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-30T18:23:33.854420] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-30T18:23:34.135379] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-30T18:23:34.654395] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-30T18:23:35.454368] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-30T18:23:35.819847] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-30T18:23:36.253568] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T18:23:36.262678] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-30T18:23:37.054407] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-30T18:23:37.854374] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-30T18:23:38.280184] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T18:23:38.293379] [INFO ] [REMOTE ] DT: Full fetch complete (76663 records). [2025-09-30T18:23:38.293518] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-30T18:23:38.501355] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T18:23:38.658426] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-30T18:23:38.780449] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-30T18:23:38.780816] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-30T18:23:38.781858] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-30T18:23:38.782102] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-30T18:23:38.816119] [DEBUG] [LOCAL ] DT: Trimmed 76663 records to 52925 (keeping 200 days of data) [2025-09-30T18:23:38.818880] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T18:23:39.050332] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-30T18:23:39.172037] [DEBUG] [LOCAL ] DT: Primary data saved (52925 records). [2025-09-30T18:23:39.172229] [INFO ] [MAIN ] DT: Full history saved. [2025-09-30T18:23:39.172377] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DT took 33.8s. Estimated remaining: 3h 37m 10s. Rate: 7.9 symbols/min [2025-09-30T18:23:39.366006] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:39.366181] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-30T18:23:39.366221] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-30T18:23:39.366364] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-30T18:23:39.366445] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-30T18:23:39.366510] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-30T18:23:39.366547] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-30T18:23:39.459453] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-30T18:23:39.776721] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:40.015804] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-30T18:23:40.016886] [INFO ] [REMOTE ] DTF: Full fetch complete (2108 records). [2025-09-30T18:23:40.016979] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-30T18:23:40.228029] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-30T18:23:40.228258] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:23:40.228336] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:23:40.228414] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-30T18:23:40.228488] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-30T18:23:40.228537] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-30T18:23:40.228635] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-30T18:23:40.228761] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTF took 24.1s. Estimated remaining: 3h 36m 45s. Rate: 7.9 symbols/min [2025-09-30T18:23:40.262547] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-30T18:23:40.429757] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:40.482004] [DEBUG] [LOCAL ] DTM: Loaded 44232 existing records from primary storage. [2025-09-30T18:23:40.482434] [INFO ] [MAIN ] DTM: Loaded 44232 existing records. [2025-09-30T18:23:40.685139] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:40.685398] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-30T18:23:40.685453] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-30T18:23:40.686040] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-30T18:23:40.686099] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-30T18:23:41.060896] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-30T18:23:41.075889] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:41.298967] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:23:41.299327] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-30T18:23:41.299436] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:23:41.299525] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-09-30T18:23:41.299666] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:23:41.299762] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-30T18:23:41.299866] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-30T18:23:41.299925] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-30T18:23:41.299986] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-30T18:23:41.300056] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTK took 2.1s. Estimated remaining: 3h 36m 21s. Rate: 7.9 symbols/min [2025-09-30T18:23:41.481996] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:41.489999] [DEBUG] [LOCAL ] DTW: Loaded 4881 existing records from primary storage. [2025-09-30T18:23:41.490222] [INFO ] [MAIN ] DTW: Loaded 4881 existing records. [2025-09-30T18:23:41.691527] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:41.691815] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-30T18:23:41.691866] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-30T18:23:41.692091] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-30T18:23:41.692175] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-30T18:23:41.855337] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-30T18:23:42.097083] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:42.127835] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T18:23:42.654398] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-30T18:23:43.319547] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T18:23:43.454613] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-30T18:23:43.456718] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T18:23:44.254444] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-30T18:23:45.059542] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-30T18:23:45.074389] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T18:23:45.736366] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T18:23:45.854345] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-30T18:23:45.952366] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T18:23:45.962915] [INFO ] [REMOTE ] DTE: Full fetch complete (68750 records). [2025-09-30T18:23:45.963072] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-30T18:23:45.964072] [FATAL] [VALIDATOR ] DTE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:23:45.964191] [FATAL] [MAIN ] DTE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:23:45.964267] [WARN ] [MAIN ] DTE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:23:45.964343] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-30T18:23:45.964431] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-09-30T18:23:45.964498] [INFO ] [LOCAL ] DTE: Starting deletion of derivative data. [2025-09-30T18:23:45.964834] [DEBUG] [LOCAL ] DTE: Deleted derivative data file. [2025-09-30T18:23:45.967052] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTE took 30.1s. Estimated remaining: 3h 36m 6s. Rate: 7.9 symbols/min [2025-09-30T18:23:46.156815] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:46.223414] [DEBUG] [LOCAL ] DUK: Loaded 53458 existing records from primary storage. [2025-09-30T18:23:46.223768] [INFO ] [MAIN ] DUK: Loaded 53458 existing records. [2025-09-30T18:23:46.431071] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:46.431269] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-30T18:23:46.431325] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-30T18:23:46.433022] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-30T18:23:46.433083] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-30T18:23:46.565397] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T18:23:46.662079] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-30T18:23:46.896791] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:47.287704] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T18:23:47.454396] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-30T18:23:48.033284] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T18:23:48.254363] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-30T18:23:48.822270] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T18:23:49.054367] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-30T18:23:49.854372] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-30T18:23:50.454740] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T18:23:50.663103] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-30T18:23:50.682859] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:23:51.182873] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-30T18:23:51.454374] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-30T18:23:52.080911] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-30T18:23:52.254344] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-30T18:23:53.039976] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T18:23:53.041902] [INFO ] [REMOTE ] DTG: Full fetch complete (8879 records). [2025-09-30T18:23:53.042027] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-30T18:23:53.042875] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:23:53.042973] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:23:53.043027] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:23:53.043108] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-30T18:23:53.043203] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-09-30T18:23:53.043277] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-09-30T18:23:53.043595] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-09-30T18:23:53.043771] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTG took 36.5s. Estimated remaining: 3h 35m 57s. Rate: 7.9 symbols/min [2025-09-30T18:23:53.054336] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-30T18:23:53.243302] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:23:53.254770] [DEBUG] [LOCAL ] DUKB: Loaded 6344 existing records from primary storage. [2025-09-30T18:23:53.255056] [INFO ] [MAIN ] DUKB: Loaded 6344 existing records. [2025-09-30T18:23:53.444222] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:23:53.444464] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-30T18:23:53.444519] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-30T18:23:53.444786] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-30T18:23:53.444856] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-30T18:23:53.867502] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-30T18:23:53.873914] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:23:54.654373] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-30T18:23:54.787470] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T18:23:55.454356] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-30T18:23:55.517413] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T18:23:55.785079] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T18:23:56.254364] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-30T18:23:57.015069] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T18:23:57.054345] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-30T18:23:57.149884] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T18:23:57.854397] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-30T18:23:57.898370] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T18:23:58.654369] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-30T18:23:59.070069] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-30T18:23:59.326085] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T18:23:59.454372] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-30T18:24:00.164813] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T18:24:00.254376] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-30T18:24:01.054378] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-30T18:24:01.854338] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-30T18:24:02.122348] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T18:24:02.267772] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-30T18:24:02.269432] [INFO ] [REMOTE ] DTW: Full fetch complete (7599 records). [2025-09-30T18:24:02.269507] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-30T18:24:02.270440] [FATAL] [VALIDATOR ] DTW: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:24:02.270526] [FATAL] [MAIN ] DTW: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:24:02.270571] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:24:02.270611] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-30T18:24:02.270694] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-09-30T18:24:02.270784] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-09-30T18:24:02.270968] [DEBUG] [LOCAL ] DTW: Deleted derivative data file. [2025-09-30T18:24:02.271088] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTW took 21.0s. Estimated remaining: 3h 35m 53s. Rate: 7.9 symbols/min [2025-09-30T18:24:02.453960] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:02.529232] [DEBUG] [LOCAL ] DV: Loaded 51263 existing records from primary storage. [2025-09-30T18:24:02.529584] [INFO ] [MAIN ] DV: Loaded 51263 existing records. [2025-09-30T18:24:02.659522] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-30T18:24:02.726615] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:02.726875] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-30T18:24:02.727001] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-30T18:24:02.728338] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-30T18:24:02.728401] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-30T18:24:03.127606] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:03.307453] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T18:24:03.454387] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-30T18:24:04.254373] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-30T18:24:04.383389] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T18:24:04.698859] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T18:24:04.874109] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T18:24:05.054357] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-30T18:24:05.669018] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T18:24:05.854371] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-30T18:24:06.359150] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-30T18:24:06.654380] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-30T18:24:07.373786] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T18:24:07.454385] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-30T18:24:08.110100] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-30T18:24:08.254382] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-30T18:24:09.054421] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-30T18:24:09.854382] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-30T18:24:10.022797] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T18:24:10.402455] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T18:24:10.654352] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-30T18:24:10.733724] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T18:24:11.454364] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-30T18:24:12.237550] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T18:24:12.254344] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-30T18:24:13.054390] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-30T18:24:13.558968] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-30T18:24:13.672634] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-30T18:24:13.721529] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T18:24:13.731809] [INFO ] [REMOTE ] DTM: Full fetch complete (64831 records). [2025-09-30T18:24:13.732006] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-30T18:24:13.859628] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-30T18:24:14.167146] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-30T18:24:14.167295] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-30T18:24:14.168379] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-30T18:24:14.168457] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-30T18:24:14.170204] [DEBUG] [LOCAL ] DTM: Trimmed 64831 records to 44156 (keeping 200 days of data) [2025-09-30T18:24:14.471443] [DEBUG] [LOCAL ] DTM: Primary data saved (44156 records). [2025-09-30T18:24:14.471634] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-30T18:24:14.471819] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DTM took 34.2s. Estimated remaining: 3h 35m 58s. Rate: 7.9 symbols/min [2025-09-30T18:24:14.662675] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:14.659745] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-30T18:24:14.711145] [DEBUG] [LOCAL ] DVA: Loaded 41068 existing records from primary storage. [2025-09-30T18:24:14.711493] [INFO ] [MAIN ] DVA: Loaded 41068 existing records. [2025-09-30T18:24:14.906335] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:14.906599] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-30T18:24:14.906702] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-30T18:24:14.908148] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-30T18:24:14.908244] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-30T18:24:15.300907] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:15.454413] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-30T18:24:15.742947] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T18:24:15.985850] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-30T18:24:15.987767] [INFO ] [REMOTE ] DUKB: Full fetch complete (9549 records). [2025-09-30T18:24:15.987847] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-30T18:24:16.259449] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-30T18:24:16.415804] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-30T18:24:16.415975] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-30T18:24:16.416630] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-30T18:24:16.416760] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-30T18:24:16.449385] [DEBUG] [LOCAL ] DUKB: Trimmed 9549 records to 6380 (keeping 200 days of data) [2025-09-30T18:24:16.452493] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T18:24:16.508360] [DEBUG] [LOCAL ] DUKB: Primary data saved (6380 records). [2025-09-30T18:24:16.508820] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-30T18:24:16.508990] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUKB took 23.5s. Estimated remaining: 3h 35m 36s. Rate: 7.9 symbols/min [2025-09-30T18:24:16.723261] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:16.723579] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-09-30T18:24:16.723663] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-09-30T18:24:16.723803] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-30T18:24:16.723846] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-30T18:24:16.723914] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-09-30T18:24:16.723951] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-30T18:24:17.059786] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-30T18:24:17.165464] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:17.474965] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:24:17.854400] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-30T18:24:18.658788] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-30T18:24:18.664172] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:24:19.454361] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-30T18:24:20.157159] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-30T18:24:20.254395] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-30T18:24:20.550941] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-30T18:24:21.054393] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-30T18:24:21.111612] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T18:24:21.854419] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-30T18:24:22.296886] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-30T18:24:22.654386] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-30T18:24:22.881266] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T18:24:23.374706] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:24:23.454360] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-30T18:24:24.254363] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-30T18:24:24.575921] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T18:24:25.054376] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-30T18:24:25.116299] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T18:24:25.855091] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-30T18:24:26.044687] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T18:24:26.062042] [INFO ] [REMOTE ] DUK: Full fetch complete (77016 records). [2025-09-30T18:24:26.062292] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-30T18:24:26.069322] [FATAL] [VALIDATOR ] DUK: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:24:26.069588] [FATAL] [MAIN ] DUK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:24:26.069730] [WARN ] [MAIN ] DUK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:24:26.069867] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-30T18:24:26.069982] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-09-30T18:24:26.070072] [INFO ] [LOCAL ] DUK: Starting deletion of derivative data. [2025-09-30T18:24:26.070524] [DEBUG] [LOCAL ] DUK: Deleted derivative data file. [2025-09-30T18:24:26.071441] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DUK took 40.1s. Estimated remaining: 3h 35m 33s. Rate: 7.9 symbols/min [2025-09-30T18:24:26.332379] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:26.399732] [DEBUG] [LOCAL ] DX: Loaded 52453 existing records from primary storage. [2025-09-30T18:24:26.400118] [INFO ] [MAIN ] DX: Loaded 52453 existing records. [2025-09-30T18:24:26.622828] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:26.623197] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-30T18:24:26.623272] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-30T18:24:26.624929] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-30T18:24:26.624996] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-30T18:24:26.663280] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-30T18:24:27.050987] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:27.253929] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-30T18:24:27.301674] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T18:24:27.454389] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-30T18:24:28.231403] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T18:24:28.254310] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-30T18:24:29.054377] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-30T18:24:29.444155] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T18:24:29.854337] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-30T18:24:29.931172] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T18:24:30.654450] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-30T18:24:31.128015] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-30T18:24:31.454409] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-30T18:24:31.498761] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T18:24:31.980161] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T18:24:32.254387] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-30T18:24:33.054421] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-30T18:24:33.473311] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-30T18:24:33.854374] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-30T18:24:33.925624] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T18:24:34.654367] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-30T18:24:34.851504] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T18:24:35.141682] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T18:24:35.454366] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-30T18:24:36.254387] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-30T18:24:36.640163] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-30T18:24:36.753725] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T18:24:36.765684] [INFO ] [REMOTE ] DV: Full fetch complete (73025 records). [2025-09-30T18:24:36.765889] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-30T18:24:36.768276] [FATAL] [VALIDATOR ] DV: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:24:36.768377] [FATAL] [MAIN ] DV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:24:36.768422] [WARN ] [MAIN ] DV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:24:36.768463] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-30T18:24:36.768544] [DEBUG] [LOCAL ] DV: No primary data file found to delete. [2025-09-30T18:24:36.768704] [INFO ] [LOCAL ] DV: Starting deletion of derivative data. [2025-09-30T18:24:36.769229] [DEBUG] [LOCAL ] DV: Deleted derivative data file. [2025-09-30T18:24:36.769345] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DV took 34.5s. Estimated remaining: 3h 35m 34s. Rate: 7.9 symbols/min [2025-09-30T18:24:36.949252] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:37.002355] [DEBUG] [LOCAL ] DXC: Loaded 49756 existing records from primary storage. [2025-09-30T18:24:37.002696] [INFO ] [MAIN ] DXC: Loaded 49756 existing records. [2025-09-30T18:24:37.061062] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-30T18:24:37.197954] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:37.198210] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-30T18:24:37.198270] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-30T18:24:37.200317] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-30T18:24:37.200382] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-30T18:24:37.640034] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:37.801879] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T18:24:37.854348] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-30T18:24:38.654326] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-30T18:24:39.005940] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-30T18:24:39.285128] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T18:24:39.454412] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-30T18:24:40.073191] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T18:24:40.254370] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-30T18:24:41.054389] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-30T18:24:41.466661] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T18:24:41.505188] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:24:41.854366] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-30T18:24:42.654318] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-30T18:24:43.016422] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T18:24:43.060717] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T18:24:43.454371] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-30T18:24:44.254350] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-30T18:24:44.711007] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-30T18:24:45.054548] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-30T18:24:45.100608] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T18:24:45.854319] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-30T18:24:46.211290] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-30T18:24:46.654402] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-30T18:24:47.075017] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T18:24:47.087397] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-09-30T18:24:47.087567] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-30T18:24:47.460092] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-30T18:24:47.554964] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-30T18:24:47.555369] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-30T18:24:47.558674] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T18:24:47.556731] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-30T18:24:47.567172] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-30T18:24:47.569142] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 53699 (keeping 200 days of data) [2025-09-30T18:24:47.922552] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-09-30T18:24:47.922722] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-30T18:24:47.922811] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DVN took 31.4s. Estimated remaining: 3h 35m 35s. Rate: 7.9 symbols/min [2025-09-30T18:24:48.112787] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:48.152107] [DEBUG] [LOCAL ] DXYZ: Loaded 36627 existing records from primary storage. [2025-09-30T18:24:48.152418] [INFO ] [MAIN ] DXYZ: Loaded 36627 existing records. [2025-09-30T18:24:48.258996] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-30T18:24:48.351764] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:48.352314] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-30T18:24:48.352483] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-30T18:24:48.353853] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-30T18:24:48.353924] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-30T18:24:48.684991] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-30T18:24:48.822996] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:48.854168] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T18:24:49.054378] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-30T18:24:49.515574] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T18:24:49.854379] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-30T18:24:50.654377] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-30T18:24:50.892507] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T18:24:51.294505] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T18:24:51.454366] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-30T18:24:52.254370] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-30T18:24:52.685500] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T18:24:53.054360] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-30T18:24:53.334386] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-09-30T18:24:53.592864] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T18:24:53.854353] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-30T18:24:54.654386] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-30T18:24:54.780148] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T18:24:54.789203] [INFO ] [REMOTE ] DVA: Full fetch complete (59677 records). [2025-09-30T18:24:54.789334] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-30T18:24:55.219131] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-30T18:24:55.219217] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-30T18:24:55.220024] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-30T18:24:55.220091] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-30T18:24:55.221360] [DEBUG] [LOCAL ] DVA: Trimmed 59677 records to 41035 (keeping 200 days of data) [2025-09-30T18:24:55.456449] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-30T18:24:55.503571] [DEBUG] [LOCAL ] DVA: Primary data saved (41035 records). [2025-09-30T18:24:55.503846] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-30T18:24:55.504183] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DVA took 41.0s. Estimated remaining: 3h 35m 27s. Rate: 7.9 symbols/min [2025-09-30T18:24:55.743515] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:55.746779] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T18:24:55.787450] [DEBUG] [LOCAL ] DY: Loaded 29395 existing records from primary storage. [2025-09-30T18:24:55.787797] [INFO ] [MAIN ] DY: Loaded 29395 existing records. [2025-09-30T18:24:55.989840] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:55.990150] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-30T18:24:55.990231] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-30T18:24:55.991354] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-30T18:24:55.991427] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-30T18:24:56.261836] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-30T18:24:56.426851] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:24:56.430213] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T18:24:57.054356] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-30T18:24:57.637207] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-30T18:24:57.854356] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-30T18:24:58.467452] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-30T18:24:58.479088] [INFO ] [REMOTE ] DX: Full fetch complete (75417 records). [2025-09-30T18:24:58.479264] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-30T18:24:58.655589] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-30T18:24:58.958300] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-30T18:24:58.958433] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-30T18:24:58.958129] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T18:24:58.959591] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-30T18:24:58.959710] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-30T18:24:58.973058] [DEBUG] [LOCAL ] DX: Trimmed 75417 records to 52469 (keeping 200 days of data) [2025-09-30T18:24:59.303965] [DEBUG] [LOCAL ] DX: Primary data saved (52469 records). [2025-09-30T18:24:59.304107] [INFO ] [MAIN ] DX: Full history saved. [2025-09-30T18:24:59.304777] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DX took 33.2s. Estimated remaining: 3h 35m 10s. Rate: 7.9 symbols/min [2025-09-30T18:24:59.466451] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-30T18:24:59.501629] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:24:59.539596] [DEBUG] [LOCAL ] E: Loaded 33269 existing records from primary storage. [2025-09-30T18:24:59.539946] [INFO ] [MAIN ] E: Loaded 33269 existing records. [2025-09-30T18:24:59.781100] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:24:59.782373] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-30T18:24:59.791268] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-30T18:24:59.791406] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-30T18:24:59.792560] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-30T18:24:59.792625] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-30T18:25:00.187822] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:25:00.254365] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-30T18:25:00.290470] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T18:25:01.054369] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-30T18:25:01.301485] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T18:25:01.854370] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-30T18:25:02.077536] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T18:25:02.244526] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T18:25:02.654364] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-30T18:25:03.454344] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-30T18:25:03.641948] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T18:25:03.653433] [INFO ] [REMOTE ] DXC: Full fetch complete (69057 records). [2025-09-30T18:25:03.653576] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-30T18:25:04.092966] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-30T18:25:04.093125] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-30T18:25:04.094036] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-30T18:25:04.094121] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-30T18:25:04.095706] [DEBUG] [LOCAL ] DXC: Trimmed 69057 records to 49776 (keeping 200 days of data) [2025-09-30T18:25:04.234127] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:25:04.301747] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-30T18:25:04.470280] [DEBUG] [LOCAL ] DXC: Primary data saved (49776 records). [2025-09-30T18:25:04.470501] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-30T18:25:04.470598] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DXC took 27.7s. Estimated remaining: 3h 34m 56s. Rate: 7.9 symbols/min [2025-09-30T18:25:04.669352] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:25:04.669525] [DEBUG] [LOCAL ] EAF: No existing data file found in primary storage. [2025-09-30T18:25:04.669564] [WARN ] [MAIN ] EAF: No existing data found, performing full refresh instead. [2025-09-30T18:25:04.669710] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-30T18:25:04.669764] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-30T18:25:04.669807] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-09-30T18:25:04.669841] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-30T18:25:05.066588] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-30T18:25:05.072574] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:25:05.677384] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-30T18:25:05.854372] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-30T18:25:05.974807] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:25:06.264680] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T18:25:06.654371] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-30T18:25:07.454357] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-30T18:25:07.765437] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T18:25:08.117928] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T18:25:08.254363] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-30T18:25:08.532512] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T18:25:09.054368] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-30T18:25:09.854370] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-30T18:25:10.207689] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-30T18:25:10.641029] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T18:25:10.654315] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-30T18:25:11.150841] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-30T18:25:11.454377] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-30T18:25:12.235134] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:25:12.254309] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-30T18:25:12.775031] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T18:25:13.054397] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-30T18:25:13.522674] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T18:25:13.854360] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-30T18:25:14.654363] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-30T18:25:15.056364] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T18:25:15.134634] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-30T18:25:15.454373] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-30T18:25:16.097404] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T18:25:16.254353] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-30T18:25:16.960584] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T18:25:17.054413] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-30T18:25:17.425545] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T18:25:17.854348] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-30T18:25:18.293088] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T18:25:18.654688] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-30T18:25:19.454403] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-30T18:25:19.646221] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:25:19.699100] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T18:25:20.254406] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-30T18:25:20.757430] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T18:25:21.054400] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-30T18:25:21.854376] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-30T18:25:21.917546] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T18:25:22.506065] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T18:25:22.654410] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-30T18:25:23.454359] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-30T18:25:23.930397] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-30T18:25:24.167392] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T18:25:24.254410] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-30T18:25:24.845440] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-30T18:25:25.054405] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-30T18:25:25.854385] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-30T18:25:26.142236] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T18:25:26.150719] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57808 records). [2025-09-30T18:25:26.150855] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-30T18:25:26.569367] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-30T18:25:26.569526] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-30T18:25:26.570419] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-30T18:25:26.570597] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-30T18:25:26.572130] [DEBUG] [LOCAL ] DXYZ: Trimmed 57808 records to 36771 (keeping 200 days of data) [2025-09-30T18:25:26.661861] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-30T18:25:26.702738] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T18:25:26.712887] [INFO ] [REMOTE ] DY: Full fetch complete (44896 records). [2025-09-30T18:25:26.713881] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-30T18:25:27.221041] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T18:25:27.338154] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-30T18:25:27.338674] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-30T18:25:27.339330] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-30T18:25:27.339404] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-30T18:25:27.346110] [DEBUG] [LOCAL ] DY: Trimmed 44896 records to 29287 (keeping 200 days of data) [2025-09-30T18:25:27.412800] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36771 records). [2025-09-30T18:25:27.421584] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-30T18:25:27.422066] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DXYZ took 39.5s. Estimated remaining: 3h 35m 28s. Rate: 7.9 symbols/min [2025-09-30T18:25:27.461025] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-30T18:25:27.663387] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:25:27.673347] [DEBUG] [LOCAL ] EAI: Loaded 3960 existing records from primary storage. [2025-09-30T18:25:27.674436] [INFO ] [MAIN ] EAI: Loaded 3960 existing records. [2025-09-30T18:25:27.886477] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:25:27.887784] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-30T18:25:27.889465] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-30T18:25:27.890240] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-30T18:25:27.890871] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-30T18:25:28.387097] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:25:28.390343] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-30T18:25:28.396907] [DEBUG] [LOCAL ] DY: Primary data saved (29287 records). [2025-09-30T18:25:28.397178] [INFO ] [MAIN ] DY: Full history saved. [2025-09-30T18:25:28.397293] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. DY took 32.9s. Estimated remaining: 3h 35m 3s. Rate: 7.9 symbols/min [2025-09-30T18:25:28.499908] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T18:25:28.631810] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:25:28.632060] [DEBUG] [LOCAL ] EARN: No existing data file found in primary storage. [2025-09-30T18:25:28.632255] [WARN ] [MAIN ] EARN: No existing data found, performing full refresh instead. [2025-09-30T18:25:28.632483] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-30T18:25:28.632539] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-30T18:25:28.632717] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-09-30T18:25:28.632845] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-30T18:25:28.910575] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T18:25:28.966535] [INFO ] [REMOTE ] E: Full fetch complete (48304 records). [2025-09-30T18:25:28.969610] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-30T18:25:29.067332] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-30T18:25:29.182990] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:25:29.308093] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T18:25:29.523000] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-30T18:25:29.523093] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-30T18:25:29.523931] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-30T18:25:29.524009] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-30T18:25:29.525494] [DEBUG] [LOCAL ] E: Trimmed 48304 records to 33253 (keeping 200 days of data) [2025-09-30T18:25:29.748254] [DEBUG] [LOCAL ] E: Primary data saved (33253 records). [2025-09-30T18:25:29.748419] [INFO ] [MAIN ] E: Full history saved. [2025-09-30T18:25:29.749027] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. E took 30.4s. Estimated remaining: 3h 34m 40s. Rate: 7.9 symbols/min [2025-09-30T18:25:29.862022] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-30T18:25:29.949994] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:25:30.002506] [DEBUG] [LOCAL ] EAT: Loaded 49769 existing records from primary storage. [2025-09-30T18:25:30.002952] [INFO ] [MAIN ] EAT: Loaded 49769 existing records. [2025-09-30T18:25:30.213521] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:25:30.213773] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-30T18:25:30.213826] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-30T18:25:30.215128] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-30T18:25:30.215193] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-30T18:25:30.648101] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:25:30.654307] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-30T18:25:30.794002] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T18:25:31.174457] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-30T18:25:31.454384] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-30T18:25:32.086606] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T18:25:32.254401] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-30T18:25:32.901256] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T18:25:32.905924] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T18:25:33.054377] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-30T18:25:33.854416] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-30T18:25:34.414879] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-30T18:25:34.493115] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T18:25:34.654365] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-30T18:25:35.454401] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-30T18:25:36.034290] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T18:25:36.038133] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:25:36.254353] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-30T18:25:37.054373] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-30T18:25:37.649206] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T18:25:37.655983] [INFO ] [REMOTE ] EAF: Full fetch complete (64008 records). [2025-09-30T18:25:37.656129] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-30T18:25:37.779827] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-30T18:25:37.860590] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-30T18:25:38.106717] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-30T18:25:38.106851] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-30T18:25:38.107720] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-30T18:25:38.107790] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-30T18:25:38.109263] [DEBUG] [LOCAL ] EAF: Trimmed 64008 records to 43066 (keeping 200 days of data) [2025-09-30T18:25:38.376851] [DEBUG] [LOCAL ] EAF: Primary data saved (43066 records). [2025-09-30T18:25:38.377016] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-30T18:25:38.377170] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAF took 33.9s. Estimated remaining: 3h 34m 35s. Rate: 7.9 symbols/min [2025-09-30T18:25:38.515155] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T18:25:38.587761] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:25:38.633745] [DEBUG] [LOCAL ] EB: Loaded 37261 existing records from primary storage. [2025-09-30T18:25:38.634113] [INFO ] [MAIN ] EB: Loaded 37261 existing records. [2025-09-30T18:25:38.659599] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-30T18:25:38.864232] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:25:38.864437] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-30T18:25:38.864486] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-30T18:25:38.865356] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-30T18:25:38.865417] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-30T18:25:39.272464] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:25:39.454380] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-30T18:25:40.254365] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-30T18:25:40.311139] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T18:25:40.343085] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T18:25:41.054391] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-30T18:25:41.854393] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-30T18:25:42.094584] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T18:25:42.605603] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-30T18:25:42.637245] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T18:25:42.654368] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-30T18:25:43.454400] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-30T18:25:43.789687] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T18:25:44.254361] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-30T18:25:45.054370] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-30T18:25:45.382360] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T18:25:45.401518] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-30T18:25:45.854386] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-30T18:25:45.969702] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T18:25:46.654362] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-30T18:25:47.454359] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-30T18:25:47.720268] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T18:25:48.100138] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T18:25:48.254361] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-30T18:25:48.821712] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T18:25:49.054349] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-30T18:25:49.117219] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T18:25:49.854362] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-30T18:25:50.664230] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-30T18:25:50.670837] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T18:25:50.832857] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T18:25:51.454413] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-30T18:25:51.525761] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T18:25:51.527314] [INFO ] [REMOTE ] EAI: Full fetch complete (6149 records). [2025-09-30T18:25:51.527424] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-30T18:25:51.977937] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-30T18:25:51.978050] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-30T18:25:51.978273] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-30T18:25:51.978342] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-30T18:25:51.978807] [DEBUG] [LOCAL ] EAI: Trimmed 6149 records to 3945 (keeping 200 days of data) [2025-09-30T18:25:52.005470] [DEBUG] [LOCAL ] EAI: Primary data saved (3945 records). [2025-09-30T18:25:52.005620] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-30T18:25:52.005771] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EAI took 24.6s. Estimated remaining: 3h 34m 42s. Rate: 7.9 symbols/min [2025-09-30T18:25:52.254331] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-30T18:25:52.649114] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T18:25:53.054356] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-30T18:25:53.854408] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-30T18:25:54.002356] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T18:25:54.323089] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T18:25:54.654357] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-30T18:25:54.885769] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T18:25:54.891004] [INFO ] [REMOTE ] EARN: Full fetch complete (46042 records). [2025-09-30T18:25:54.891097] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-30T18:25:55.298262] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-30T18:25:55.298351] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-30T18:25:55.299071] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-30T18:25:55.299137] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-30T18:25:55.300166] [DEBUG] [LOCAL ] EARN: Trimmed 46042 records to 29751 (keeping 200 days of data) [2025-09-30T18:25:55.461312] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-30T18:25:55.479950] [DEBUG] [LOCAL ] EARN: Primary data saved (29751 records). [2025-09-30T18:25:55.480087] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-30T18:25:55.480162] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EARN took 27.1s. Estimated remaining: 3h 34m 25s. Rate: 7.9 symbols/min [2025-09-30T18:25:56.188016] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T18:25:56.254368] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-30T18:25:56.804535] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T18:25:57.054362] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-30T18:25:58.242329] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T18:25:58.253869] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-30T18:25:58.384485] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T18:25:58.654392] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-30T18:25:59.670309] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T18:25:59.690023] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-30T18:26:00.068768] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T18:26:00.254360] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-30T18:26:01.630829] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T18:26:01.641861] [INFO ] [REMOTE ] EAT: Full fetch complete (71517 records). [2025-09-30T18:26:01.642072] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-30T18:26:01.643152] [FATAL] [VALIDATOR ] EAT: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:26:01.643288] [FATAL] [MAIN ] EAT: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:26:01.643373] [WARN ] [MAIN ] EAT: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:26:01.643444] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-30T18:26:01.643606] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-09-30T18:26:01.643712] [INFO ] [LOCAL ] EAT: Starting deletion of derivative data. [2025-09-30T18:26:01.644140] [DEBUG] [LOCAL ] EAT: Deleted derivative data file. [2025-09-30T18:26:01.644999] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EAT took 31.9s. Estimated remaining: 3h 34m 13s. Rate: 7.9 symbols/min [2025-09-30T18:26:01.716869] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T18:26:01.727571] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-30T18:26:03.308478] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T18:26:03.316612] [INFO ] [REMOTE ] EB: Full fetch complete (56293 records). [2025-09-30T18:26:03.316837] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-30T18:26:03.772724] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-30T18:26:03.772827] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-30T18:26:03.773616] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-30T18:26:03.773705] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-30T18:26:03.776065] [DEBUG] [LOCAL ] EB: Trimmed 56293 records to 37197 (keeping 200 days of data) [2025-09-30T18:26:04.007800] [DEBUG] [LOCAL ] EB: Primary data saved (37197 records). [2025-09-30T18:26:04.007965] [INFO ] [MAIN ] EB: Full history saved. [2025-09-30T18:26:04.008141] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EB took 25.6s. Estimated remaining: 3h 33m 53s. Rate: 7.9 symbols/min [2025-09-30T18:26:04.692326] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:04.781754] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:04.796470] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:04.831366] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:04.859409] [DEBUG] [LOCAL ] EBF: Loaded 19222 existing records from primary storage. [2025-09-30T18:26:04.859903] [INFO ] [MAIN ] EBF: Loaded 19222 existing records. [2025-09-30T18:26:05.094071] [DEBUG] [LOCAL ] EC: Loaded 49282 existing records from primary storage. [2025-09-30T18:26:05.149944] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:26:05.146491] [DEBUG] [LOCAL ] EBS: Loaded 46678 existing records from primary storage. [2025-09-30T18:26:05.150892] [DEBUG] [LOCAL ] EBR: Loaded 43035 existing records from primary storage. [2025-09-30T18:26:05.134137] [INFO ] [MAIN ] EC: Loaded 49282 existing records. [2025-09-30T18:26:05.163485] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-30T18:26:05.151386] [INFO ] [MAIN ] EBS: Loaded 46678 existing records. [2025-09-30T18:26:05.179324] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-30T18:26:05.200809] [INFO ] [MAIN ] EBR: Loaded 43035 existing records. [2025-09-30T18:26:05.365001] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-30T18:26:05.384945] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-30T18:26:05.953200] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:26:05.850468] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:26:05.963969] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-30T18:26:06.000076] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-30T18:26:05.967381] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-30T18:26:06.003762] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-30T18:26:05.973318] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:26:06.012026] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-30T18:26:06.011982] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-30T18:26:06.011916] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-30T18:26:06.044867] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-30T18:26:06.027350] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-30T18:26:06.044750] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-30T18:26:06.121733] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-30T18:26:06.233337] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-30T18:26:06.776486] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:06.848118] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-30T18:26:07.326040] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:07.381506] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-30T18:26:07.441356] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:07.471915] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:07.467948] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-30T18:26:07.473156] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-30T18:26:07.821169] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T18:26:07.825076] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-30T18:26:08.527045] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T18:26:08.530937] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-30T18:26:08.870101] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T18:26:08.880767] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-30T18:26:09.015769] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T18:26:09.026854] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-30T18:26:09.101154] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T18:26:09.111461] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-30T18:26:09.624342] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:26:09.629012] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-30T18:26:10.500748] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T18:26:10.511019] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-30T18:26:10.705054] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T18:26:10.716232] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-30T18:26:10.783914] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T18:26:10.808787] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T18:26:11.454365] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-30T18:26:11.671714] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T18:26:12.254350] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-30T18:26:12.408187] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T18:26:12.597513] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T18:26:13.054419] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-30T18:26:13.748588] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T18:26:13.854381] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-30T18:26:14.565790] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T18:26:14.654398] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-30T18:26:15.454351] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-30T18:26:15.604403] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T18:26:16.207676] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T18:26:16.256068] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-30T18:26:16.261794] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T18:26:17.054435] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-30T18:26:17.854378] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-30T18:26:18.084034] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T18:26:18.124417] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T18:26:18.654402] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-30T18:26:19.454409] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-30T18:26:19.657376] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T18:26:20.254364] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-30T18:26:20.385806] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T18:26:20.929711] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T18:26:21.010149] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T18:26:21.054419] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-30T18:26:21.854377] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-30T18:26:22.598209] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T18:26:22.654375] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-30T18:26:22.826747] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T18:26:23.454373] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-30T18:26:24.264978] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-30T18:26:24.272110] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T18:26:25.036417] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:26:25.054331] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-30T18:26:25.091220] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T18:26:25.095086] [INFO ] [REMOTE ] EBF: Full fetch complete (27391 records). [2025-09-30T18:26:25.095207] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-30T18:26:25.484348] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-30T18:26:25.484431] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-30T18:26:25.485004] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-30T18:26:25.485068] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-30T18:26:25.485868] [DEBUG] [LOCAL ] EBF: Trimmed 27391 records to 19235 (keeping 200 days of data) [2025-09-30T18:26:25.614159] [DEBUG] [LOCAL ] EBF: Primary data saved (19235 records). [2025-09-30T18:26:25.614309] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-30T18:26:25.614397] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 21.6s. Estimated remaining: 3h 34m 20s. Rate: 7.9 symbols/min [2025-09-30T18:26:25.799592] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:25.799839] [DEBUG] [LOCAL ] ECAT: No existing data file found in primary storage. [2025-09-30T18:26:25.799897] [WARN ] [MAIN ] ECAT: No existing data found, performing full refresh instead. [2025-09-30T18:26:25.800028] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-30T18:26:25.800092] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-30T18:26:25.800167] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-09-30T18:26:25.800207] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-30T18:26:25.859581] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-30T18:26:26.188692] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:26.654386] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-30T18:26:26.738865] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T18:26:27.467799] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-30T18:26:27.496045] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T18:26:27.915903] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T18:26:28.254441] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-30T18:26:28.955801] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T18:26:28.967572] [INFO ] [REMOTE ] EBS: Full fetch complete (67318 records). [2025-09-30T18:26:28.967830] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-30T18:26:29.059576] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-30T18:26:29.445258] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-30T18:26:29.445462] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-30T18:26:29.446413] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-30T18:26:29.446557] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-30T18:26:29.448453] [DEBUG] [LOCAL ] EBS: Trimmed 67318 records to 46630 (keeping 200 days of data) [2025-09-30T18:26:29.531465] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T18:26:29.757096] [DEBUG] [LOCAL ] EBS: Primary data saved (46630 records). [2025-09-30T18:26:29.757229] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-30T18:26:29.757338] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EBS took 25.7s. Estimated remaining: 3h 34m 4s. Rate: 7.9 symbols/min [2025-09-30T18:26:29.859550] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-30T18:26:29.942296] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:29.942506] [DEBUG] [LOCAL ] ECC: No existing data file found in primary storage. [2025-09-30T18:26:29.942554] [WARN ] [MAIN ] ECC: No existing data found, performing full refresh instead. [2025-09-30T18:26:29.942712] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-30T18:26:29.942778] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-30T18:26:29.942821] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-09-30T18:26:29.942853] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-30T18:26:30.352947] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:30.371041] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T18:26:30.654407] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-30T18:26:31.454356] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-30T18:26:31.617329] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T18:26:31.991138] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T18:26:32.254378] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-30T18:26:33.054384] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-30T18:26:33.476285] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-30T18:26:33.833173] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T18:26:33.854361] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-30T18:26:34.387263] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T18:26:34.654363] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-30T18:26:35.454357] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-30T18:26:35.518966] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T18:26:35.528871] [INFO ] [REMOTE ] EBR: Full fetch complete (62714 records). [2025-09-30T18:26:35.529023] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-30T18:26:35.968801] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-30T18:26:35.968971] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-30T18:26:35.969884] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-30T18:26:35.969992] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-30T18:26:35.973689] [DEBUG] [LOCAL ] EBR: Trimmed 62714 records to 43075 (keeping 200 days of data) [2025-09-30T18:26:36.239530] [DEBUG] [LOCAL ] EBR: Primary data saved (43075 records). [2025-09-30T18:26:36.239668] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-30T18:26:36.239826] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EBR took 32.2s. Estimated remaining: 3h 33m 53s. Rate: 7.9 symbols/min [2025-09-30T18:26:36.262594] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-30T18:26:36.436750] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:36.437115] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-30T18:26:36.437441] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-30T18:26:36.437812] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-30T18:26:36.437939] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-30T18:26:36.438177] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-30T18:26:36.438294] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-30T18:26:36.596753] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:26:36.698780] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T18:26:36.931869] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:37.054379] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-30T18:26:37.511714] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-30T18:26:37.808628] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:26:37.854361] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-30T18:26:38.654394] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-30T18:26:38.924059] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-30T18:26:39.301718] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T18:26:39.454380] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-30T18:26:40.254394] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-30T18:26:40.911906] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T18:26:41.054373] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-30T18:26:41.854380] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-30T18:26:42.083564] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T18:26:42.094177] [INFO ] [REMOTE ] EC: Full fetch complete (71926 records). [2025-09-30T18:26:42.094362] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-30T18:26:42.554859] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:26:42.553904] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-30T18:26:42.555028] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-30T18:26:42.562941] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-30T18:26:42.563412] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-30T18:26:42.567389] [DEBUG] [LOCAL ] EC: Trimmed 71926 records to 49276 (keeping 200 days of data) [2025-09-30T18:26:42.660583] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-30T18:26:42.921211] [DEBUG] [LOCAL ] EC: Primary data saved (49276 records). [2025-09-30T18:26:42.921396] [INFO ] [MAIN ] EC: Full history saved. [2025-09-30T18:26:42.921510] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EC took 38.9s. Estimated remaining: 3h 33m 43s. Rate: 7.9 symbols/min [2025-09-30T18:26:43.111743] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:43.112048] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-30T18:26:43.112110] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-30T18:26:43.112252] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-30T18:26:43.112296] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-30T18:26:43.112340] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-30T18:26:43.112373] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-30T18:26:43.485305] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-30T18:26:43.533061] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T18:26:43.588068] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:43.607613] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T18:26:43.888189] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-30T18:26:44.254350] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-30T18:26:45.054327] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-30T18:26:45.387193] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-30T18:26:45.516413] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T18:26:45.854371] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-30T18:26:46.654385] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-30T18:26:47.192297] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-30T18:26:47.218890] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T18:26:47.454365] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-30T18:26:48.254354] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-30T18:26:48.833617] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T18:26:49.054331] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-30T18:26:49.350611] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T18:26:49.594413] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-30T18:26:49.854374] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-30T18:26:50.282590] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T18:26:50.654377] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-30T18:26:51.454370] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-30T18:26:51.806793] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T18:26:52.254351] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-30T18:26:52.715837] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:26:53.054358] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-30T18:26:53.854358] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-30T18:26:53.892395] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T18:26:53.899898] [INFO ] [REMOTE ] ECAT: Full fetch complete (42793 records). [2025-09-30T18:26:53.900084] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-30T18:26:54.347676] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-30T18:26:54.347772] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-30T18:26:54.348444] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-30T18:26:54.348508] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-30T18:26:54.349797] [DEBUG] [LOCAL ] ECAT: Trimmed 42793 records to 29602 (keeping 200 days of data) [2025-09-30T18:26:54.471993] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-30T18:26:54.567934] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T18:26:54.589192] [DEBUG] [LOCAL ] ECAT: Primary data saved (29602 records). [2025-09-30T18:26:54.589333] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-30T18:26:54.589410] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECAT took 29.0s. Estimated remaining: 3h 33m 46s. Rate: 7.9 symbols/min [2025-09-30T18:26:54.659537] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-30T18:26:54.770890] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:26:54.771064] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-30T18:26:54.771105] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-30T18:26:54.771217] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-30T18:26:54.771258] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-30T18:26:54.771299] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-30T18:26:54.771331] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-30T18:26:55.160004] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:26:55.339958] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T18:26:55.454365] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-30T18:26:55.999576] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T18:26:56.254363] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-30T18:26:56.599310] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-30T18:26:57.054401] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-30T18:26:57.466936] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-30T18:26:57.854367] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-30T18:26:58.197255] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-30T18:26:58.654381] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-30T18:26:58.981729] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T18:26:59.454361] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-30T18:26:59.804233] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-30T18:27:00.254359] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-30T18:27:00.732703] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-30T18:27:01.054355] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-30T18:27:01.510685] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-30T18:27:01.511472] [INFO ] [REMOTE ] ECCC: Full fetch complete (1284 records). [2025-09-30T18:27:01.511540] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-30T18:27:01.700593] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-30T18:27:01.700800] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:27:01.700853] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:27:01.700900] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-30T18:27:01.700961] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-30T18:27:01.701000] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-30T18:27:01.701062] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-30T18:27:01.701145] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECCC took 25.5s. Estimated remaining: 3h 33m 37s. Rate: 7.9 symbols/min [2025-09-30T18:27:01.859491] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-30T18:27:01.893320] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:01.893515] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-30T18:27:01.893554] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-30T18:27:01.893708] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-30T18:27:01.893764] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-30T18:27:01.893808] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-30T18:27:01.893895] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-30T18:27:02.313711] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:02.654349] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-30T18:27:03.231843] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T18:27:03.454344] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-30T18:27:03.546453] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T18:27:03.796827] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T18:27:04.254367] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-30T18:27:04.606751] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-30T18:27:05.054350] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-30T18:27:05.854368] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-30T18:27:06.205164] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-30T18:27:06.548271] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T18:27:06.654383] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-30T18:27:06.950984] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-30T18:27:07.454404] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-30T18:27:08.254384] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-30T18:27:08.639532] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-30T18:27:08.889715] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T18:27:08.899481] [INFO ] [REMOTE ] ECC: Full fetch complete (61024 records). [2025-09-30T18:27:08.899689] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-30T18:27:09.062218] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-30T18:27:09.346581] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-30T18:27:09.346688] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-30T18:27:09.347507] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-30T18:27:09.347571] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-30T18:27:09.348993] [DEBUG] [LOCAL ] ECC: Trimmed 61024 records to 43260 (keeping 200 days of data) [2025-09-30T18:27:09.444714] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-30T18:27:09.616861] [DEBUG] [LOCAL ] ECC: Primary data saved (43260 records). [2025-09-30T18:27:09.616993] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-30T18:27:09.617067] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECC took 39.9s. Estimated remaining: 3h 33m 30s. Rate: 7.9 symbols/min [2025-09-30T18:27:09.803453] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:09.845263] [DEBUG] [LOCAL ] ECG: Loaded 33936 existing records from primary storage. [2025-09-30T18:27:09.845582] [INFO ] [MAIN ] ECG: Loaded 33936 existing records. [2025-09-30T18:27:09.859610] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-30T18:27:10.043933] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:10.044159] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-30T18:27:10.044234] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-30T18:27:10.044845] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-30T18:27:10.044908] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-30T18:27:10.385246] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-30T18:27:10.441112] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:10.654378] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-30T18:27:11.454426] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-30T18:27:11.869394] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-30T18:27:12.137195] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T18:27:12.254369] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-30T18:27:12.592767] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T18:27:13.054389] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-30T18:27:13.854367] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-30T18:27:14.130785] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T18:27:14.317992] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T18:27:14.654367] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-30T18:27:15.022361] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-30T18:27:15.454390] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-30T18:27:16.254345] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-30T18:27:16.526749] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-30T18:27:16.976086] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T18:27:17.054409] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-30T18:27:17.854413] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-30T18:27:18.208926] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-30T18:27:18.512811] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T18:27:18.654380] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-30T18:27:19.165116] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-30T18:27:19.166065] [INFO ] [REMOTE ] ECCW: Full fetch complete (1418 records). [2025-09-30T18:27:19.166136] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-30T18:27:19.375909] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-30T18:27:19.376100] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:27:19.376150] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:27:19.376217] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-30T18:27:19.376287] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-30T18:27:19.376324] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-30T18:27:19.376365] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-30T18:27:19.376424] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECCW took 24.8s. Estimated remaining: 3h 33m 28s. Rate: 7.9 symbols/min [2025-09-30T18:27:19.459612] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-30T18:27:19.571246] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:19.626324] [DEBUG] [LOCAL ] ECL: Loaded 46782 existing records from primary storage. [2025-09-30T18:27:19.626688] [INFO ] [MAIN ] ECL: Loaded 46782 existing records. [2025-09-30T18:27:19.833820] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:19.834059] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-30T18:27:19.834131] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-30T18:27:19.834846] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-30T18:27:19.834935] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-30T18:27:20.254343] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:20.254437] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-30T18:27:20.390533] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T18:27:20.587922] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-30T18:27:21.054427] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-30T18:27:21.458394] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T18:27:21.854404] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-30T18:27:22.374088] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T18:27:22.375192] [INFO ] [REMOTE ] ECCU: Full fetch complete (4474 records). [2025-09-30T18:27:22.375288] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-30T18:27:22.587068] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-30T18:27:22.587264] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:27:22.587309] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:27:22.587373] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-30T18:27:22.587436] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-30T18:27:22.587471] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-30T18:27:22.587509] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-30T18:27:22.587564] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCU took 39.7s. Estimated remaining: 3h 33m 10s. Rate: 7.9 symbols/min [2025-09-30T18:27:22.659456] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-30T18:27:22.778511] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:22.801542] [DEBUG] [LOCAL ] ECO: Loaded 18367 existing records from primary storage. [2025-09-30T18:27:22.801847] [INFO ] [MAIN ] ECO: Loaded 18367 existing records. [2025-09-30T18:27:22.989893] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:22.990102] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-30T18:27:22.990151] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-30T18:27:22.990487] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-30T18:27:22.990547] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-30T18:27:23.387022] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:23.454355] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-30T18:27:24.254411] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-30T18:27:24.388984] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T18:27:24.650142] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-30T18:27:25.054343] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-30T18:27:25.097735] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:27:25.854372] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-30T18:27:26.212391] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-30T18:27:26.654335] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-30T18:27:26.769003] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T18:27:27.454365] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-30T18:27:28.057487] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-30T18:27:28.058443] [INFO ] [REMOTE ] ECCX: Full fetch complete (1514 records). [2025-09-30T18:27:28.058514] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-30T18:27:28.251595] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-30T18:27:28.251951] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:27:28.252131] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:27:28.260492] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-30T18:27:28.260408] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-30T18:27:28.273116] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-30T18:27:28.276868] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-30T18:27:28.277048] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-30T18:27:28.277196] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECCX took 26.6s. Estimated remaining: 3h 32m 57s. Rate: 7.9 symbols/min [2025-09-30T18:27:28.301452] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T18:27:28.480381] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:28.534781] [DEBUG] [LOCAL ] ECVT: Loaded 42947 existing records from primary storage. [2025-09-30T18:27:28.535266] [INFO ] [MAIN ] ECVT: Loaded 42947 existing records. [2025-09-30T18:27:28.745953] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:28.746162] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-30T18:27:28.746208] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-30T18:27:28.746639] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-30T18:27:28.746733] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-30T18:27:29.059440] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-30T18:27:29.123244] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:29.335575] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T18:27:29.854360] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-30T18:27:30.654327] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-30T18:27:30.695490] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T18:27:30.967610] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T18:27:31.454401] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-30T18:27:32.211721] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T18:27:32.254325] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-30T18:27:33.054327] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-30T18:27:33.138440] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T18:27:33.461386] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T18:27:33.780762] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T18:27:33.854365] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-30T18:27:34.654380] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-30T18:27:35.073835] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T18:27:35.454412] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-30T18:27:36.254406] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-30T18:27:36.441343] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T18:27:36.672086] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T18:27:37.054379] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-30T18:27:37.333071] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:27:37.854370] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-30T18:27:38.654382] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-30T18:27:38.787182] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T18:27:39.455051] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-30T18:27:39.454957] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T18:27:39.812944] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T18:27:40.254372] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-30T18:27:41.054340] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-30T18:27:41.143557] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T18:27:41.506391] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:27:41.854371] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-30T18:27:42.262634] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T18:27:42.654392] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-30T18:27:43.459488] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-30T18:27:43.475284] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T18:27:43.715052] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T18:27:44.254363] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-30T18:27:44.551015] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:27:45.054392] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-30T18:27:45.453912] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T18:27:45.460440] [INFO ] [REMOTE ] ECG: Full fetch complete (51389 records). [2025-09-30T18:27:45.460558] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-30T18:27:45.860165] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-30T18:27:45.861373] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-30T18:27:45.862310] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-30T18:27:45.863058] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-30T18:27:45.863235] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-30T18:27:45.864404] [DEBUG] [LOCAL ] ECG: Trimmed 51389 records to 33853 (keeping 200 days of data) [2025-09-30T18:27:46.084348] [DEBUG] [LOCAL ] ECG: Primary data saved (33853 records). [2025-09-30T18:27:46.084534] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-30T18:27:46.085511] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECG took 36.5s. Estimated remaining: 3h 33m 14s. Rate: 7.9 symbols/min [2025-09-30T18:27:46.259148] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T18:27:46.300978] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:46.369571] [DEBUG] [LOCAL ] ED: Loaded 52759 existing records from primary storage. [2025-09-30T18:27:46.370019] [INFO ] [MAIN ] ED: Loaded 52759 existing records. [2025-09-30T18:27:46.574558] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:46.574828] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-30T18:27:46.574880] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-30T18:27:46.575507] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-30T18:27:46.575567] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-30T18:27:46.659500] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-30T18:27:46.959490] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:47.454355] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-30T18:27:47.830436] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T18:27:48.065074] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T18:27:48.254372] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-30T18:27:48.315184] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T18:27:48.319726] [INFO ] [REMOTE ] ECO: Full fetch complete (29215 records). [2025-09-30T18:27:48.319872] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-30T18:27:48.718076] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-30T18:27:48.718203] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-30T18:27:48.718819] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-30T18:27:48.718883] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-30T18:27:48.719900] [DEBUG] [LOCAL ] ECO: Trimmed 29215 records to 18384 (keeping 200 days of data) [2025-09-30T18:27:48.852896] [DEBUG] [LOCAL ] ECO: Primary data saved (18384 records). [2025-09-30T18:27:48.853158] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-30T18:27:48.853287] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECO took 26.3s. Estimated remaining: 3h 32m 55s. Rate: 7.9 symbols/min [2025-09-30T18:27:49.045012] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:49.054393] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-30T18:27:49.078247] [DEBUG] [LOCAL ] EDD: Loaded 27095 existing records from primary storage. [2025-09-30T18:27:49.078678] [INFO ] [MAIN ] EDD: Loaded 27095 existing records. [2025-09-30T18:27:49.255737] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:49.256069] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-30T18:27:49.256123] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-30T18:27:49.256541] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-30T18:27:49.256603] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-30T18:27:49.668360] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:49.854352] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-30T18:27:50.149870] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T18:27:50.160863] [INFO ] [REMOTE ] ECL: Full fetch complete (67918 records). [2025-09-30T18:27:50.161009] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-30T18:27:50.574222] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-30T18:27:50.574312] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-30T18:27:50.575221] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-30T18:27:50.575293] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-30T18:27:50.576762] [DEBUG] [LOCAL ] ECL: Trimmed 67918 records to 46764 (keeping 200 days of data) [2025-09-30T18:27:50.674153] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-30T18:27:50.911262] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T18:27:50.949716] [DEBUG] [LOCAL ] ECL: Primary data saved (46764 records). [2025-09-30T18:27:50.949856] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-30T18:27:50.949942] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECL took 31.6s. Estimated remaining: 3h 32m 34s. Rate: 7.9 symbols/min [2025-09-30T18:27:51.199972] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:27:51.219549] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T18:27:51.237503] [DEBUG] [LOCAL ] EDF: Loaded 13397 existing records from primary storage. [2025-09-30T18:27:51.237787] [INFO ] [MAIN ] EDF: Loaded 13397 existing records. [2025-09-30T18:27:51.449061] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:27:51.449321] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-30T18:27:51.449382] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-30T18:27:51.449639] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-30T18:27:51.449729] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-30T18:27:51.461687] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-30T18:27:51.877899] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:27:52.254352] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-30T18:27:52.395862] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T18:27:52.447610] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-30T18:27:53.054381] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-30T18:27:53.854333] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-30T18:27:53.932810] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T18:27:53.969852] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T18:27:54.654367] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-30T18:27:55.020756] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:27:55.454396] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-30T18:27:55.624307] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T18:27:56.254359] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-30T18:27:57.054337] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-30T18:27:57.122973] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:27:57.150222] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T18:27:57.854327] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-30T18:27:58.019431] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T18:27:58.654364] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-30T18:27:58.978206] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T18:27:59.201340] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T18:27:59.454377] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-30T18:28:00.254363] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-30T18:28:00.426073] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T18:28:01.054358] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-30T18:28:01.853825] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T18:28:01.857677] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-30T18:28:02.605299] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T18:28:02.654373] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-30T18:28:03.204472] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-30T18:28:03.454407] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-30T18:28:04.233242] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T18:28:04.254324] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-30T18:28:04.269004] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T18:28:05.054380] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-30T18:28:05.854803] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-30T18:28:05.854728] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T18:28:06.547442] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T18:28:06.654328] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-30T18:28:06.780452] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T18:28:07.454375] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-30T18:28:08.210928] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T18:28:08.230323] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T18:28:08.254310] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-30T18:28:09.054364] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-30T18:28:09.199450] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T18:28:09.202705] [INFO ] [REMOTE ] EDF: Full fetch complete (20970 records). [2025-09-30T18:28:09.202791] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-30T18:28:09.605206] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-30T18:28:09.605300] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-30T18:28:09.605783] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-30T18:28:09.605883] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-30T18:28:09.606572] [DEBUG] [LOCAL ] EDF: Trimmed 20970 records to 13382 (keeping 200 days of data) [2025-09-30T18:28:09.687894] [DEBUG] [LOCAL ] EDF: Primary data saved (13382 records). [2025-09-30T18:28:09.688034] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-30T18:28:09.688132] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. EDF took 18.7s. Estimated remaining: 3h 32m 53s. Rate: 7.9 symbols/min [2025-09-30T18:28:09.875596] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-30T18:28:09.880727] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:09.904068] [DEBUG] [LOCAL ] EDN: Loaded 18073 existing records from primary storage. [2025-09-30T18:28:09.904333] [INFO ] [MAIN ] EDN: Loaded 18073 existing records. [2025-09-30T18:28:10.109422] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:28:10.109756] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-30T18:28:10.110071] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-30T18:28:10.110721] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-30T18:28:10.110794] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-30T18:28:10.258684] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T18:28:10.515698] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:10.654384] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-30T18:28:11.454359] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-30T18:28:11.499458] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T18:28:11.509789] [INFO ] [REMOTE ] ECVT: Full fetch complete (60025 records). [2025-09-30T18:28:11.509941] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-30T18:28:11.701703] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T18:28:11.975604] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-30T18:28:11.975731] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-30T18:28:11.976526] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-30T18:28:11.976594] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-30T18:28:11.978117] [DEBUG] [LOCAL ] ECVT: Trimmed 60025 records to 43021 (keeping 200 days of data) [2025-09-30T18:28:12.246198] [DEBUG] [LOCAL ] ECVT: Primary data saved (43021 records). [2025-09-30T18:28:12.246528] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-30T18:28:12.246895] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. ECVT took 44.0s. Estimated remaining: 3h 32m 34s. Rate: 7.9 symbols/min [2025-09-30T18:28:12.260631] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-30T18:28:12.441164] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:12.487744] [DEBUG] [LOCAL ] EDU: Loaded 44931 existing records from primary storage. [2025-09-30T18:28:12.488071] [INFO ] [MAIN ] EDU: Loaded 44931 existing records. [2025-09-30T18:28:12.680316] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:28:12.680544] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-30T18:28:12.680592] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-30T18:28:12.682043] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-30T18:28:12.682108] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-30T18:28:13.057983] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-30T18:28:13.156180] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:13.558026] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-30T18:28:13.771588] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T18:28:13.858732] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-30T18:28:13.862281] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T18:28:14.654408] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-30T18:28:15.255424] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T18:28:15.454390] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-30T18:28:16.021203] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T18:28:16.254329] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-30T18:28:16.625540] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:28:17.054404] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-30T18:28:17.854362] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-30T18:28:18.108190] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T18:28:18.165957] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-30T18:28:18.654367] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-30T18:28:19.454390] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-30T18:28:19.921706] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-30T18:28:20.254323] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-30T18:28:20.453015] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T18:28:20.974927] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T18:28:20.981615] [INFO ] [REMOTE ] EDD: Full fetch complete (38930 records). [2025-09-30T18:28:20.981846] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-30T18:28:21.062761] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-30T18:28:21.406579] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-30T18:28:21.406712] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-30T18:28:21.407549] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-30T18:28:21.407630] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-30T18:28:21.408936] [DEBUG] [LOCAL ] EDD: Trimmed 38930 records to 27088 (keeping 200 days of data) [2025-09-30T18:28:21.587878] [DEBUG] [LOCAL ] EDD: Primary data saved (27088 records). [2025-09-30T18:28:21.588097] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-30T18:28:21.588736] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. EDD took 32.7s. Estimated remaining: 3h 32m 30s. Rate: 7.9 symbols/min [2025-09-30T18:28:21.783702] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:21.828870] [DEBUG] [LOCAL ] EE: Loaded 32516 existing records from primary storage. [2025-09-30T18:28:21.829413] [INFO ] [MAIN ] EE: Loaded 32516 existing records. [2025-09-30T18:28:21.862849] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-30T18:28:22.037392] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:28:22.038094] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-30T18:28:22.082054] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-30T18:28:22.083916] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T18:28:22.087664] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-30T18:28:22.087943] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-30T18:28:22.122047] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T18:28:22.510992] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:22.654399] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-30T18:28:23.454407] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-30T18:28:23.598053] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T18:28:23.657223] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T18:28:24.254399] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-30T18:28:25.054357] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-30T18:28:25.109069] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T18:28:25.394780] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T18:28:25.854406] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-30T18:28:26.576127] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-30T18:28:26.654380] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-30T18:28:26.855715] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T18:28:27.454363] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-30T18:28:28.254416] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-30T18:28:28.555585] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-30T18:28:28.586801] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T18:28:29.054373] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-30T18:28:29.599279] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T18:28:29.854385] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-30T18:28:30.654338] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-30T18:28:30.801482] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T18:28:30.812962] [INFO ] [REMOTE ] ED: Full fetch complete (76349 records). [2025-09-30T18:28:30.813123] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-30T18:28:31.265905] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-30T18:28:31.266076] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-30T18:28:31.267611] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-30T18:28:31.268765] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-30T18:28:31.268638] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T18:28:31.278709] [DEBUG] [LOCAL ] ED: Trimmed 76349 records to 52759 (keeping 200 days of data) [2025-09-30T18:28:31.474030] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-30T18:28:31.637637] [DEBUG] [LOCAL ] ED: Primary data saved (52759 records). [2025-09-30T18:28:31.637877] [INFO ] [MAIN ] ED: Full history saved. [2025-09-30T18:28:31.639784] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. ED took 45.6s. Estimated remaining: 3h 32m 28s. Rate: 7.9 symbols/min [2025-09-30T18:28:31.827581] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:31.827803] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-09-30T18:28:31.827863] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-09-30T18:28:31.827986] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-30T18:28:31.828040] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-30T18:28:31.828111] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-30T18:28:31.828148] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-30T18:28:32.205878] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:32.248412] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T18:28:32.256883] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-30T18:28:32.956841] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T18:28:32.976356] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T18:28:33.054363] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-30T18:28:33.527434] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-30T18:28:33.854367] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-30T18:28:34.654391] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-30T18:28:35.113117] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-30T18:28:35.207479] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T18:28:35.454361] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-30T18:28:36.254356] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-30T18:28:36.922179] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T18:28:37.054381] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-30T18:28:37.459159] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-30T18:28:37.861964] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-30T18:28:37.867554] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T18:28:38.654385] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-30T18:28:39.068799] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T18:28:39.454380] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-30T18:28:40.254412] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-30T18:28:40.496891] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T18:28:40.560808] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T18:28:41.054325] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-30T18:28:41.079483] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T18:28:41.854376] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-30T18:28:42.247917] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-30T18:28:42.277678] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T18:28:42.284126] [INFO ] [REMOTE ] EE: Full fetch complete (43414 records). [2025-09-30T18:28:42.284255] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-30T18:28:42.285039] [FATAL] [VALIDATOR ] EE: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:28:42.285175] [FATAL] [MAIN ] EE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:28:42.285241] [WARN ] [MAIN ] EE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:28:42.285314] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-30T18:28:42.285381] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-09-30T18:28:42.285431] [INFO ] [LOCAL ] EE: Starting deletion of derivative data. [2025-09-30T18:28:42.285839] [DEBUG] [LOCAL ] EE: Deleted derivative data file. [2025-09-30T18:28:42.285937] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EE took 20.7s. Estimated remaining: 3h 32m 28s. Rate: 7.9 symbols/min [2025-09-30T18:28:42.485270] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:42.498897] [DEBUG] [LOCAL ] EEX: Loaded 11665 existing records from primary storage. [2025-09-30T18:28:42.499155] [INFO ] [MAIN ] EEX: Loaded 11665 existing records. [2025-09-30T18:28:42.659500] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-30T18:28:42.704298] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:28:42.704777] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-30T18:28:42.704874] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-30T18:28:42.705471] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-30T18:28:42.705577] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-30T18:28:43.129171] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:43.440904] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T18:28:43.454318] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-30T18:28:44.254366] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-30T18:28:44.895428] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T18:28:44.901255] [INFO ] [REMOTE ] EDN: Full fetch complete (30300 records). [2025-09-30T18:28:44.901370] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-30T18:28:45.059448] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-30T18:28:45.309198] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-30T18:28:45.309304] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-30T18:28:45.309880] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-30T18:28:45.309964] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-30T18:28:45.310823] [DEBUG] [LOCAL ] EDN: Trimmed 30300 records to 18137 (keeping 200 days of data) [2025-09-30T18:28:45.410245] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T18:28:45.447827] [DEBUG] [LOCAL ] EDN: Primary data saved (18137 records). [2025-09-30T18:28:45.447986] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-30T18:28:45.448074] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EDN took 35.8s. Estimated remaining: 3h 32m 10s. Rate: 7.9 symbols/min [2025-09-30T18:28:45.683231] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:45.734317] [DEBUG] [LOCAL ] EFC: Loaded 46199 existing records from primary storage. [2025-09-30T18:28:45.734669] [INFO ] [MAIN ] EFC: Loaded 46199 existing records. [2025-09-30T18:28:45.854921] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T18:28:45.855193] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-30T18:28:45.935209] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:28:45.935523] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-30T18:28:45.935589] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-30T18:28:45.937376] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-30T18:28:45.937438] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-30T18:28:46.309067] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:46.654362] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-30T18:28:47.199883] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-30T18:28:47.233256] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T18:28:47.454377] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-30T18:28:48.254347] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-30T18:28:48.438368] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T18:28:48.814705] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-30T18:28:49.054361] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-30T18:28:49.538079] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-30T18:28:49.854361] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-30T18:28:50.654379] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-30T18:28:51.454377] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-30T18:28:51.579282] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T18:28:51.588992] [INFO ] [REMOTE ] EDU: Full fetch complete (66479 records). [2025-09-30T18:28:51.589156] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-30T18:28:52.049388] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-30T18:28:52.049609] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-30T18:28:52.050474] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-30T18:28:52.050557] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-30T18:28:52.052369] [DEBUG] [LOCAL ] EDU: Trimmed 66479 records to 44992 (keeping 200 days of data) [2025-09-30T18:28:52.170094] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T18:28:52.262102] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-30T18:28:52.364412] [DEBUG] [LOCAL ] EDU: Primary data saved (44992 records). [2025-09-30T18:28:52.364602] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-30T18:28:52.364727] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EDU took 40.1s. Estimated remaining: 3h 32m 1s. Rate: 7.9 symbols/min [2025-09-30T18:28:52.450803] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T18:28:52.565931] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:52.566114] [DEBUG] [LOCAL ] EFR: No existing data file found in primary storage. [2025-09-30T18:28:52.566153] [WARN ] [MAIN ] EFR: No existing data found, performing full refresh instead. [2025-09-30T18:28:52.566265] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-30T18:28:52.566306] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-30T18:28:52.566345] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-30T18:28:52.566377] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-30T18:28:52.855520] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T18:28:52.883169] [INFO ] [REMOTE ] EEA: Full fetch complete (3915 records). [2025-09-30T18:28:52.886692] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-30T18:28:53.060546] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-30T18:28:53.088427] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:53.175551] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T18:28:53.175813] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:28:53.175886] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:28:53.175956] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-30T18:28:53.176019] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-30T18:28:53.176055] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-09-30T18:28:53.176095] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-09-30T18:28:53.176151] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EEA took 21.5s. Estimated remaining: 3h 31m 37s. Rate: 7.9 symbols/min [2025-09-30T18:28:53.354002] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:28:53.370421] [DEBUG] [LOCAL ] EFT: Loaded 12787 existing records from primary storage. [2025-09-30T18:28:53.370680] [INFO ] [MAIN ] EFT: Loaded 12787 existing records. [2025-09-30T18:28:53.580074] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:28:53.580337] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-30T18:28:53.580409] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-30T18:28:53.581422] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-30T18:28:53.581501] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-30T18:28:53.860015] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-30T18:28:53.996704] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:28:54.006442] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T18:28:54.654371] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-30T18:28:55.454335] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-30T18:28:55.794038] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-30T18:28:55.879758] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T18:28:56.254337] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-30T18:28:56.467193] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T18:28:57.054367] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-30T18:28:57.834141] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:28:57.854322] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-30T18:28:57.960026] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T18:28:58.636389] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T18:28:58.654305] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-30T18:28:59.392841] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T18:28:59.454325] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-30T18:29:00.150913] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-30T18:29:00.254369] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-30T18:29:00.916396] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T18:29:01.054391] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-30T18:29:01.854412] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-30T18:29:01.970849] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T18:29:02.465615] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-30T18:29:02.654373] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-30T18:29:03.454368] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-30T18:29:04.256845] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-30T18:29:04.279554] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T18:29:04.281305] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T18:29:05.054353] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-30T18:29:05.137783] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T18:29:05.854415] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-30T18:29:05.992579] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-30T18:29:06.654338] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-30T18:29:06.824620] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T18:29:07.454394] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-30T18:29:08.254369] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-30T18:29:08.378516] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T18:29:08.647781] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T18:29:08.972797] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-30T18:29:09.054402] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-30T18:29:09.854354] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-30T18:29:09.889126] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T18:29:10.654354] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-30T18:29:10.762027] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T18:29:11.454406] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-30T18:29:11.570639] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T18:29:12.163681] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T18:29:12.254338] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-30T18:29:13.054334] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-30T18:29:13.113080] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T18:29:13.115256] [INFO ] [REMOTE ] EEX: Full fetch complete (19511 records). [2025-09-30T18:29:13.115328] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-30T18:29:13.505874] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-30T18:29:13.505951] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-30T18:29:13.506356] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-30T18:29:13.506395] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-30T18:29:13.506970] [DEBUG] [LOCAL ] EEX: Trimmed 19511 records to 11608 (keeping 200 days of data) [2025-09-30T18:29:13.578142] [DEBUG] [LOCAL ] EEX: Primary data saved (11608 records). [2025-09-30T18:29:13.578331] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-30T18:29:13.578421] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EEX took 31.3s. Estimated remaining: 3h 31m 60s. Rate: 7.9 symbols/min [2025-09-30T18:29:13.761442] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:13.811285] [DEBUG] [LOCAL ] EFX: Loaded 44588 existing records from primary storage. [2025-09-30T18:29:13.811584] [INFO ] [MAIN ] EFX: Loaded 44588 existing records. [2025-09-30T18:29:13.859463] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-30T18:29:14.007877] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:29:14.008135] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-30T18:29:14.008215] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-30T18:29:14.008757] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-30T18:29:14.008816] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-30T18:29:14.178269] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T18:29:14.402956] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:14.654383] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-30T18:29:15.454331] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-30T18:29:15.645506] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:29:15.666317] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T18:29:16.254356] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-30T18:29:16.516980] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T18:29:16.522891] [INFO ] [REMOTE ] EFR: Full fetch complete (18640 records). [2025-09-30T18:29:16.523043] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-30T18:29:16.523720] [FATAL] [VALIDATOR ] EFR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:29:16.523829] [FATAL] [MAIN ] EFR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:29:16.523887] [WARN ] [MAIN ] EFR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:29:16.523948] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-30T18:29:16.524028] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-30T18:29:16.524104] [INFO ] [LOCAL ] EFR: Starting deletion of derivative data. [2025-09-30T18:29:16.524174] [DEBUG] [LOCAL ] EFR: No derivative data file found to delete. [2025-09-30T18:29:16.524279] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EFR took 24.2s. Estimated remaining: 3h 31m 41s. Rate: 7.9 symbols/min [2025-09-30T18:29:16.720399] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:16.750164] [DEBUG] [LOCAL ] EFXT: Loaded 29190 existing records from primary storage. [2025-09-30T18:29:16.750457] [INFO ] [MAIN ] EFXT: Loaded 29190 existing records. [2025-09-30T18:29:16.941500] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:29:16.941775] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-30T18:29:16.941829] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-30T18:29:16.942194] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-30T18:29:16.942255] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-30T18:29:17.059508] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-30T18:29:17.352855] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:17.854371] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-30T18:29:17.874694] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T18:29:17.903841] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T18:29:18.654420] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-30T18:29:19.390395] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T18:29:19.454389] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-30T18:29:20.088972] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T18:29:20.254408] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-30T18:29:21.054405] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-30T18:29:21.132162] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T18:29:21.688889] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T18:29:21.854371] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-30T18:29:22.270163] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T18:29:22.654367] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-30T18:29:23.454337] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-30T18:29:23.616378] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T18:29:23.784044] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T18:29:23.787755] [INFO ] [REMOTE ] EFT: Full fetch complete (17653 records). [2025-09-30T18:29:23.787898] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-30T18:29:24.174162] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-30T18:29:24.174241] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-30T18:29:24.174609] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-30T18:29:24.174671] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-30T18:29:24.175236] [DEBUG] [LOCAL ] EFT: Trimmed 17653 records to 12856 (keeping 200 days of data) [2025-09-30T18:29:24.256170] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-30T18:29:24.258884] [DEBUG] [LOCAL ] EFT: Primary data saved (12856 records). [2025-09-30T18:29:24.260213] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-30T18:29:24.260339] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFT took 31.1s. Estimated remaining: 3h 31m 34s. Rate: 7.9 symbols/min [2025-09-30T18:29:24.452348] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:24.476484] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T18:29:24.511257] [DEBUG] [LOCAL ] EG: Loaded 28398 existing records from primary storage. [2025-09-30T18:29:24.511571] [INFO ] [MAIN ] EG: Loaded 28398 existing records. [2025-09-30T18:29:24.710754] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:29:24.710992] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-30T18:29:24.711040] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-30T18:29:24.711876] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-30T18:29:24.711939] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-30T18:29:25.062500] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-30T18:29:25.109451] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:25.854338] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-30T18:29:25.997892] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T18:29:26.009017] [INFO ] [REMOTE ] EFC: Full fetch complete (66402 records). [2025-09-30T18:29:26.009196] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-30T18:29:26.451781] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T18:29:26.451999] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-30T18:29:26.457967] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-30T18:29:26.459309] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-30T18:29:26.459850] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-30T18:29:26.461082] [DEBUG] [LOCAL ] EFC: Trimmed 66402 records to 46224 (keeping 200 days of data) [2025-09-30T18:29:26.679785] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-30T18:29:26.757076] [DEBUG] [LOCAL ] EFC: Primary data saved (46224 records). [2025-09-30T18:29:26.757216] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-30T18:29:26.757305] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFC took 41.3s. Estimated remaining: 3h 31m 14s. Rate: 7.9 symbols/min [2025-09-30T18:29:26.945899] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:26.999280] [DEBUG] [LOCAL ] EGO: Loaded 51568 existing records from primary storage. [2025-09-30T18:29:26.999624] [INFO ] [MAIN ] EGO: Loaded 51568 existing records. [2025-09-30T18:29:27.193122] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:29:27.193350] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-30T18:29:27.193396] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-30T18:29:27.193938] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-30T18:29:27.193997] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-30T18:29:27.458764] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-30T18:29:27.604780] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:27.630321] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T18:29:27.940885] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T18:29:28.254364] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-30T18:29:28.486176] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T18:29:29.054416] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-30T18:29:29.854343] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-30T18:29:29.956330] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T18:29:30.160552] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T18:29:30.654368] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-30T18:29:31.157189] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T18:29:31.454367] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-30T18:29:31.962244] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T18:29:32.254315] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-30T18:29:32.335246] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T18:29:33.054361] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-30T18:29:33.554682] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T18:29:33.854358] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-30T18:29:34.104523] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T18:29:34.654404] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-30T18:29:35.463286] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-30T18:29:35.485453] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:29:36.263803] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-30T18:29:36.269936] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T18:29:36.852719] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:29:36.993085] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T18:29:37.054343] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-30T18:29:37.854386] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-30T18:29:38.654340] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-30T18:29:38.746416] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T18:29:39.060444] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T18:29:39.454360] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-30T18:29:40.254330] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-30T18:29:40.419624] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:29:40.986549] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:29:41.054356] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-30T18:29:41.854363] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-30T18:29:41.923816] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T18:29:42.490898] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T18:29:42.498129] [INFO ] [REMOTE ] EFXT: Full fetch complete (44125 records). [2025-09-30T18:29:42.498284] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-30T18:29:42.667890] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-30T18:29:42.945188] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-30T18:29:42.945289] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-30T18:29:42.946191] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-30T18:29:42.946276] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-30T18:29:42.947581] [DEBUG] [LOCAL ] EFXT: Trimmed 44125 records to 29194 (keeping 200 days of data) [2025-09-30T18:29:43.053688] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T18:29:43.149685] [DEBUG] [LOCAL ] EFXT: Primary data saved (29194 records). [2025-09-30T18:29:43.149826] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-30T18:29:43.149909] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFXT took 26.6s. Estimated remaining: 3h 31m 27s. Rate: 7.9 symbols/min [2025-09-30T18:29:43.335536] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:43.373279] [DEBUG] [LOCAL ] EGP: Loaded 30961 existing records from primary storage. [2025-09-30T18:29:43.373588] [INFO ] [MAIN ] EGP: Loaded 30961 existing records. [2025-09-30T18:29:43.461680] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-30T18:29:43.590212] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:29:43.590435] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-30T18:29:43.590486] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-30T18:29:43.591034] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-30T18:29:43.591129] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-30T18:29:43.989854] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:44.254338] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-30T18:29:44.619541] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T18:29:45.054364] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-30T18:29:45.264142] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T18:29:45.347874] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T18:29:45.854372] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-30T18:29:46.444198] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T18:29:46.654364] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-30T18:29:47.454365] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-30T18:29:47.503380] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T18:29:47.565486] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T18:29:48.254363] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-30T18:29:49.054338] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-30T18:29:49.255881] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T18:29:49.854340] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-30T18:29:49.911272] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T18:29:49.922805] [INFO ] [REMOTE ] EFX: Full fetch complete (64400 records). [2025-09-30T18:29:49.922978] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-30T18:29:50.353136] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-30T18:29:50.353321] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-30T18:29:50.354228] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-30T18:29:50.354313] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-30T18:29:50.375137] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:29:50.381899] [DEBUG] [LOCAL ] EFX: Trimmed 64400 records to 44541 (keeping 200 days of data) [2025-09-30T18:29:50.659097] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-30T18:29:50.675854] [DEBUG] [LOCAL ] EFX: Primary data saved (44541 records). [2025-09-30T18:29:50.676008] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-30T18:29:50.676106] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EFX took 37.1s. Estimated remaining: 3h 31m 19s. Rate: 7.9 symbols/min [2025-09-30T18:29:50.869497] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:50.917160] [DEBUG] [LOCAL ] EGY: Loaded 42167 existing records from primary storage. [2025-09-30T18:29:50.917530] [INFO ] [MAIN ] EGY: Loaded 42167 existing records. [2025-09-30T18:29:51.135063] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:29:51.135416] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-30T18:29:51.135530] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-30T18:29:51.142228] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-30T18:29:51.152896] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-30T18:29:51.159401] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T18:29:51.459670] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-30T18:29:51.553039] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:51.786676] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T18:29:52.254321] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-30T18:29:52.641474] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-30T18:29:53.054354] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-30T18:29:53.744629] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T18:29:53.854366] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-30T18:29:54.654349] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-30T18:29:54.829685] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T18:29:55.454359] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-30T18:29:55.653288] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T18:29:56.143513] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T18:29:56.149778] [INFO ] [REMOTE ] EG: Full fetch complete (43587 records). [2025-09-30T18:29:56.149932] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-30T18:29:56.150735] [FATAL] [VALIDATOR ] EG: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:29:56.150837] [FATAL] [MAIN ] EG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:29:56.150880] [WARN ] [MAIN ] EG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:29:56.150955] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-30T18:29:56.151027] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-09-30T18:29:56.151063] [INFO ] [LOCAL ] EG: Starting deletion of derivative data. [2025-09-30T18:29:56.151467] [DEBUG] [LOCAL ] EG: Deleted derivative data file. [2025-09-30T18:29:56.151590] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EG took 31.9s. Estimated remaining: 3h 31m 6s. Rate: 7.9 symbols/min [2025-09-30T18:29:56.259488] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-30T18:29:56.347613] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:29:56.347892] [DEBUG] [LOCAL ] EHAB: No existing data file found in primary storage. [2025-09-30T18:29:56.347951] [WARN ] [MAIN ] EHAB: No existing data found, performing full refresh instead. [2025-09-30T18:29:56.348065] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-30T18:29:56.348209] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-30T18:29:56.348266] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-09-30T18:29:56.348303] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-30T18:29:56.728726] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:29:56.975160] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T18:29:57.054366] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-30T18:29:57.614952] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T18:29:57.854410] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-30T18:29:58.637789] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:29:58.654362] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-30T18:29:58.969774] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T18:29:59.454388] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-30T18:29:59.702121] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T18:30:00.254352] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-30T18:30:00.832361] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T18:30:01.054364] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-30T18:30:01.854392] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-30T18:30:02.059784] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T18:30:02.293094] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T18:30:02.654370] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-30T18:30:03.052263] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T18:30:03.454412] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-30T18:30:03.841913] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T18:30:04.254374] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-30T18:30:05.056304] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-30T18:30:05.059537] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T18:30:05.441460] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T18:30:05.854402] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-30T18:30:06.654400] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-30T18:30:07.209552] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T18:30:07.221307] [INFO ] [REMOTE ] EGO: Full fetch complete (73274 records). [2025-09-30T18:30:07.221457] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-30T18:30:07.222531] [FATAL] [VALIDATOR ] EGO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:30:07.222721] [FATAL] [MAIN ] EGO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:30:07.222888] [WARN ] [MAIN ] EGO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:30:07.223095] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-30T18:30:07.223212] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-09-30T18:30:07.223439] [INFO ] [LOCAL ] EGO: Starting deletion of derivative data. [2025-09-30T18:30:07.223780] [DEBUG] [LOCAL ] EGO: Deleted derivative data file. [2025-09-30T18:30:07.223882] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EGO took 40.5s. Estimated remaining: 3h 31m 7s. Rate: 7.9 symbols/min [2025-09-30T18:30:07.407876] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:07.430628] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T18:30:07.438289] [INFO ] [REMOTE ] EGP: Full fetch complete (45425 records). [2025-09-30T18:30:07.438478] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-30T18:30:07.461157] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-30T18:30:07.794409] [DEBUG] [LOCAL ] EHC: Loaded 41153 existing records from primary storage. [2025-09-30T18:30:07.806492] [INFO ] [MAIN ] EHC: Loaded 41153 existing records. [2025-09-30T18:30:08.030273] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-30T18:30:08.035540] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-30T18:30:08.041598] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-30T18:30:08.052212] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-30T18:30:08.111626] [DEBUG] [LOCAL ] EGP: Trimmed 45425 records to 30925 (keeping 200 days of data) [2025-09-30T18:30:08.114507] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:30:08.115044] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-30T18:30:08.115351] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-30T18:30:08.116111] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-30T18:30:08.116177] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-30T18:30:08.681866] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:08.690119] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-30T18:30:08.690628] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-30T18:30:08.777810] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:30:08.803597] [DEBUG] [LOCAL ] EGP: Primary data saved (30925 records). [2025-09-30T18:30:08.803769] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-30T18:30:08.803864] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGP took 25.7s. Estimated remaining: 3h 30m 45s. Rate: 7.9 symbols/min [2025-09-30T18:30:08.987366] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:08.999905] [DEBUG] [LOCAL ] EHI: Loaded 10420 existing records from primary storage. [2025-09-30T18:30:09.000151] [INFO ] [MAIN ] EHI: Loaded 10420 existing records. [2025-09-30T18:30:09.059497] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-30T18:30:09.196930] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:30:09.197145] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-30T18:30:09.197192] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-30T18:30:09.197510] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-30T18:30:09.197572] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-30T18:30:09.591681] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:09.854367] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-30T18:30:10.545532] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T18:30:10.654338] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-30T18:30:10.899038] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T18:30:10.977848] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T18:30:11.454373] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-30T18:30:11.684096] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T18:30:12.254342] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-30T18:30:13.019372] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T18:30:13.054337] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-30T18:30:13.748533] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T18:30:13.854532] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-30T18:30:14.582276] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T18:30:14.654387] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-30T18:30:15.310278] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T18:30:15.454364] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-30T18:30:16.170840] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T18:30:16.254402] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-30T18:30:17.054461] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-30T18:30:17.199067] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T18:30:17.682122] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T18:30:17.854410] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-30T18:30:18.654348] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-30T18:30:18.905188] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T18:30:18.914633] [INFO ] [REMOTE ] EGY: Full fetch complete (61506 records). [2025-09-30T18:30:18.914841] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-30T18:30:19.230144] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T18:30:19.394484] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-30T18:30:19.394571] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-30T18:30:19.395396] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-30T18:30:19.395550] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-30T18:30:19.396983] [DEBUG] [LOCAL ] EGY: Trimmed 61506 records to 42167 (keeping 200 days of data) [2025-09-30T18:30:19.455962] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-30T18:30:19.647182] [DEBUG] [LOCAL ] EGY: Primary data saved (42167 records). [2025-09-30T18:30:19.647320] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-30T18:30:19.647428] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EGY took 29.0s. Estimated remaining: 3h 30m 45s. Rate: 7.9 symbols/min [2025-09-30T18:30:19.837165] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:19.865314] [DEBUG] [LOCAL ] EIC: Loaded 23686 existing records from primary storage. [2025-09-30T18:30:19.865597] [INFO ] [MAIN ] EIC: Loaded 23686 existing records. [2025-09-30T18:30:20.071411] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:30:20.071759] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-30T18:30:20.071912] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-30T18:30:20.072324] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-30T18:30:20.072459] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-30T18:30:20.252325] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T18:30:20.257613] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-30T18:30:20.355581] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T18:30:20.532895] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:21.054416] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-30T18:30:21.668020] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T18:30:21.854436] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-30T18:30:22.381453] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T18:30:22.654361] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-30T18:30:23.351009] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T18:30:23.454378] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-30T18:30:23.575935] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-30T18:30:24.254363] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-30T18:30:24.716617] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-30T18:30:25.054371] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-30T18:30:25.394510] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T18:30:25.854417] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-30T18:30:25.880067] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T18:30:26.654367] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-30T18:30:26.951420] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T18:30:27.454391] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-30T18:30:28.254344] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-30T18:30:28.290152] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:30:28.751987] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T18:30:28.764941] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T18:30:29.054369] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-30T18:30:29.854381] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-30T18:30:30.430969] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T18:30:30.654407] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-30T18:30:31.454363] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-30T18:30:31.490786] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:30:31.543915] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T18:30:31.549715] [INFO ] [REMOTE ] EHAB: Full fetch complete (41002 records). [2025-09-30T18:30:31.549899] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-30T18:30:31.550685] [FATAL] [VALIDATOR ] EHAB: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:30:31.550780] [FATAL] [MAIN ] EHAB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:30:31.550825] [WARN ] [MAIN ] EHAB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:30:31.550914] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-30T18:30:31.551032] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-09-30T18:30:31.551139] [INFO ] [LOCAL ] EHAB: Starting deletion of derivative data. [2025-09-30T18:30:31.551243] [DEBUG] [LOCAL ] EHAB: No derivative data file found to delete. [2025-09-30T18:30:31.551348] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHAB took 35.4s. Estimated remaining: 3h 30m 47s. Rate: 7.9 symbols/min [2025-09-30T18:30:31.742145] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:31.742384] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-30T18:30:31.742442] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-30T18:30:31.742601] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-30T18:30:31.742680] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-30T18:30:31.742744] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-30T18:30:31.742789] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-30T18:30:32.135913] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:32.254358] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-30T18:30:32.412162] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T18:30:32.874980] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-30T18:30:33.054372] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-30T18:30:33.560898] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-30T18:30:33.854355] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-30T18:30:34.654336] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-30T18:30:35.043489] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T18:30:35.454322] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-30T18:30:35.711238] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T18:30:36.254354] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-30T18:30:36.595013] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T18:30:36.756549] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T18:30:37.054371] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-30T18:30:37.745208] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-30T18:30:37.854357] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-30T18:30:38.654350] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-30T18:30:38.766204] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T18:30:38.990439] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T18:30:39.454387] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-30T18:30:40.254349] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-30T18:30:40.269912] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T18:30:40.585222] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-30T18:30:41.054329] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-30T18:30:41.854358] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-30T18:30:41.900230] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T18:30:42.197227] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-30T18:30:42.654366] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-30T18:30:43.454393] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-30T18:30:43.559883] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T18:30:43.562771] [INFO ] [REMOTE ] EHI: Full fetch complete (16156 records). [2025-09-30T18:30:43.562852] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-30T18:30:43.563306] [FATAL] [VALIDATOR ] EHI: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:30:43.563395] [FATAL] [MAIN ] EHI: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:30:43.563438] [WARN ] [MAIN ] EHI: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:30:43.563477] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-30T18:30:43.563541] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-09-30T18:30:43.563579] [INFO ] [LOCAL ] EHI: Starting deletion of derivative data. [2025-09-30T18:30:43.563864] [DEBUG] [LOCAL ] EHI: Deleted derivative data file. [2025-09-30T18:30:43.563988] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EHI took 34.8s. Estimated remaining: 3h 30m 50s. Rate: 7.9 symbols/min [2025-09-30T18:30:43.781827] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:43.782074] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-30T18:30:43.782129] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-30T18:30:43.782259] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-30T18:30:43.782325] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-30T18:30:43.782397] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-30T18:30:43.782435] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-30T18:30:43.862056] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T18:30:44.186676] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:44.254370] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-30T18:30:44.599525] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-30T18:30:45.054389] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-30T18:30:45.554787] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-30T18:30:45.854368] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-30T18:30:46.654345] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-30T18:30:47.166182] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T18:30:47.184964] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-30T18:30:47.454365] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-30T18:30:48.254355] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-30T18:30:48.512146] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-30T18:30:48.597454] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T18:30:49.054362] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-30T18:30:49.854362] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-30T18:30:50.307826] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-30T18:30:50.598296] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T18:30:50.606205] [INFO ] [REMOTE ] EHC: Full fetch complete (58526 records). [2025-09-30T18:30:50.606371] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-30T18:30:50.607140] [FATAL] [VALIDATOR ] EHC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:30:50.607231] [FATAL] [MAIN ] EHC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:30:50.607276] [WARN ] [MAIN ] EHC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:30:50.607316] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-30T18:30:50.607375] [DEBUG] [LOCAL ] EHC: No primary data file found to delete. [2025-09-30T18:30:50.607411] [INFO ] [LOCAL ] EHC: Starting deletion of derivative data. [2025-09-30T18:30:50.607590] [DEBUG] [LOCAL ] EHC: Deleted derivative data file. [2025-09-30T18:30:50.607743] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EHC took 43.4s. Estimated remaining: 3h 30m 41s. Rate: 7.9 symbols/min [2025-09-30T18:30:50.659525] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-30T18:30:50.805447] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:50.805681] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-30T18:30:50.805756] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-30T18:30:50.805881] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-30T18:30:50.805923] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-30T18:30:50.805964] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-30T18:30:50.805996] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-30T18:30:51.197509] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:51.454366] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-30T18:30:51.790990] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T18:30:51.795667] [INFO ] [REMOTE ] EIC: Full fetch complete (34915 records). [2025-09-30T18:30:51.795858] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-30T18:30:52.085705] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-30T18:30:52.229318] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-30T18:30:52.229413] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-30T18:30:52.230070] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-30T18:30:52.230139] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-30T18:30:52.231028] [DEBUG] [LOCAL ] EIC: Trimmed 34915 records to 23631 (keeping 200 days of data) [2025-09-30T18:30:52.292289] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-30T18:30:52.392123] [DEBUG] [LOCAL ] EIC: Primary data saved (23631 records). [2025-09-30T18:30:52.392262] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-30T18:30:52.392349] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EIC took 32.7s. Estimated remaining: 3h 30m 20s. Rate: 7.9 symbols/min [2025-09-30T18:30:52.584391] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:52.611713] [DEBUG] [LOCAL ] EIG: Loaded 20285 existing records from primary storage. [2025-09-30T18:30:52.611988] [INFO ] [MAIN ] EIG: Loaded 20285 existing records. [2025-09-30T18:30:52.717354] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T18:30:52.816745] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:30:52.817027] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-30T18:30:52.817083] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-30T18:30:52.817354] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-30T18:30:52.817414] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-30T18:30:53.059580] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-30T18:30:53.233814] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:53.724499] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T18:30:53.854380] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-30T18:30:54.306278] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T18:30:54.654365] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-30T18:30:55.029633] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-30T18:30:55.454427] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-30T18:30:55.913136] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-30T18:30:56.254342] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-30T18:30:56.606256] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-30T18:30:57.054364] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-30T18:30:57.517865] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-30T18:30:57.518833] [INFO ] [REMOTE ] EICA: Full fetch complete (1279 records). [2025-09-30T18:30:57.518909] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-30T18:30:57.713964] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-30T18:30:57.714180] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:30:57.714249] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:30:57.714318] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-30T18:30:57.714383] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-30T18:30:57.714419] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-30T18:30:57.714458] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-30T18:30:57.714535] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EICA took 26.2s. Estimated remaining: 3h 30m 7s. Rate: 7.9 symbols/min [2025-09-30T18:30:57.859595] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-30T18:30:57.909399] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:30:57.909622] [DEBUG] [LOCAL ] EIX: No existing data file found in primary storage. [2025-09-30T18:30:57.909710] [WARN ] [MAIN ] EIX: No existing data found, performing full refresh instead. [2025-09-30T18:30:57.909860] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-30T18:30:57.909915] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-30T18:30:57.909960] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-30T18:30:57.909992] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-30T18:30:58.297505] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:30:58.654341] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-30T18:30:58.731711] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T18:30:59.316134] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-30T18:30:59.454381] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-30T18:31:00.176397] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T18:31:00.254346] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-30T18:31:00.879399] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T18:31:01.054400] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-30T18:31:01.854356] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-30T18:31:02.019529] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T18:31:02.297090] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-30T18:31:02.654364] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-30T18:31:03.454403] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-30T18:31:03.862178] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-30T18:31:04.254347] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-30T18:31:04.476278] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T18:31:04.824883] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T18:31:05.054382] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-30T18:31:05.854365] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-30T18:31:06.087273] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T18:31:06.338939] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-30T18:31:06.654394] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-30T18:31:07.426545] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T18:31:07.454406] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-30T18:31:08.231688] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-30T18:31:08.233982] [INFO ] [REMOTE ] EICC: Full fetch complete (8129 records). [2025-09-30T18:31:08.234069] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-30T18:31:08.234524] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:31:08.234620] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:31:08.234702] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:31:08.234802] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-30T18:31:08.234886] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-30T18:31:08.234936] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-30T18:31:08.235020] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-30T18:31:08.235099] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EICC took 17.6s. Estimated remaining: 3h 30m 6s. Rate: 7.9 symbols/min [2025-09-30T18:31:08.254353] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-30T18:31:09.054417] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-30T18:31:09.854417] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-30T18:31:10.171321] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-30T18:31:10.319191] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T18:31:10.374057] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T18:31:10.654408] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-30T18:31:11.454469] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-30T18:31:11.733445] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:31:12.254369] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-30T18:31:13.010253] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-30T18:31:13.012058] [INFO ] [REMOTE ] EICB: Full fetch complete (2700 records). [2025-09-30T18:31:13.012215] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-30T18:31:13.057158] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-30T18:31:13.180816] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T18:31:13.268998] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T18:31:13.269197] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:31:13.269271] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:31:13.269351] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-30T18:31:13.269420] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-30T18:31:13.269459] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-30T18:31:13.269503] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-30T18:31:13.269569] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EICB took 29.7s. Estimated remaining: 3h 29m 52s. Rate: 7.9 symbols/min [2025-09-30T18:31:13.854352] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-30T18:31:14.077119] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T18:31:14.654374] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-30T18:31:15.809470] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T18:31:15.815122] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-30T18:31:15.867069] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-30T18:31:16.254383] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-30T18:31:16.943083] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T18:31:17.054404] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-30T18:31:17.851606] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T18:31:17.863335] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-30T18:31:18.138017] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T18:31:18.143158] [INFO ] [REMOTE ] EIG: Full fetch complete (27040 records). [2025-09-30T18:31:18.143284] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-30T18:31:18.551736] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-30T18:31:18.551853] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-30T18:31:18.552351] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-30T18:31:18.552404] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-30T18:31:18.553201] [DEBUG] [LOCAL ] EIG: Trimmed 27040 records to 20286 (keeping 200 days of data) [2025-09-30T18:31:18.684236] [DEBUG] [LOCAL ] EIG: Primary data saved (20286 records). [2025-09-30T18:31:18.684370] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-30T18:31:18.684453] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EIG took 26.3s. Estimated remaining: 3h 29m 40s. Rate: 7.9 symbols/min [2025-09-30T18:31:19.732234] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T18:31:19.744191] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-30T18:31:21.551469] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T18:31:21.562636] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-30T18:31:23.232828] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T18:31:23.244982] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-30T18:31:25.153227] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T18:31:25.165091] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-30T18:31:27.355474] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-30T18:31:27.367369] [INFO ] [REMOTE ] EIX: Full fetch complete (76596 records). [2025-09-30T18:31:27.367539] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-30T18:31:27.370758] [FATAL] [VALIDATOR ] EIX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:31:27.370886] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:31:27.370932] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:31:27.370976] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-30T18:31:27.371043] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-30T18:31:27.371086] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-09-30T18:31:27.371128] [DEBUG] [LOCAL ] EIX: No derivative data file found to delete. [2025-09-30T18:31:27.371191] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIX took 29.7s. Estimated remaining: 3h 29m 35s. Rate: 7.9 symbols/min [2025-09-30T18:31:28.158326] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:31:28.156360] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:31:28.157324] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:31:28.227387] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:31:28.231467] [DEBUG] [LOCAL ] ELC: Loaded 3481 existing records from primary storage. [2025-09-30T18:31:28.232575] [INFO ] [MAIN ] ELC: Loaded 3481 existing records. [2025-09-30T18:31:28.501986] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:31:28.522342] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-30T18:31:28.522617] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-30T18:31:28.537342] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-30T18:31:28.539978] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-30T18:31:28.554883] [DEBUG] [LOCAL ] ELF: Loaded 52235 existing records from primary storage. [2025-09-30T18:31:28.592872] [DEBUG] [LOCAL ] ELAN: Loaded 53226 existing records from primary storage. [2025-09-30T18:31:28.591898] [INFO ] [MAIN ] ELF: Loaded 52235 existing records. [2025-09-30T18:31:28.593342] [INFO ] [MAIN ] ELAN: Loaded 53226 existing records. [2025-09-30T18:31:28.708485] [DEBUG] [LOCAL ] EL: Loaded 53397 existing records from primary storage. [2025-09-30T18:31:28.777986] [INFO ] [MAIN ] EL: Loaded 53397 existing records. [2025-09-30T18:31:29.339920] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:31:29.326837] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:31:29.361903] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-30T18:31:29.362032] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-30T18:31:29.374034] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-30T18:31:29.396374] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-30T18:31:29.401717] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-30T18:31:29.407684] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-30T18:31:29.407588] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-30T18:31:29.494804] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-30T18:31:29.644153] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:31:29.742331] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-30T18:31:29.839734] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:31:29.845044] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-30T18:31:29.905904] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-30T18:31:30.029059] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-30T18:31:30.075100] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-30T18:31:30.445620] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:31:30.492980] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-30T18:31:30.569178] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:31:30.585048] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-30T18:31:30.831066] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:31:30.831521] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-30T18:31:30.837621] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T18:31:30.839605] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-30T18:31:31.479999] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T18:31:31.481553] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-30T18:31:31.825831] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T18:31:31.827147] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-30T18:31:32.366764] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T18:31:32.378561] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-30T18:31:32.385050] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T18:31:32.387972] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-30T18:31:32.559989] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-30T18:31:32.571583] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-30T18:31:32.886101] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-30T18:31:32.887714] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-30T18:31:32.933183] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-30T18:31:32.944632] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-30T18:31:33.441802] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-30T18:31:33.443402] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-30T18:31:33.689997] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-30T18:31:33.707385] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-30T18:31:33.925062] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T18:31:33.926749] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-30T18:31:34.162669] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T18:31:34.173948] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-30T18:31:34.497513] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T18:31:34.654334] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-30T18:31:34.787847] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T18:31:35.069462] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-30T18:31:35.284613] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:31:35.454405] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-30T18:31:36.111912] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-30T18:31:36.254377] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-30T18:31:37.054379] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-30T18:31:37.188909] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T18:31:37.854424] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-30T18:31:37.893611] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T18:31:37.895083] [INFO ] [REMOTE ] ELC: Full fetch complete (5094 records). [2025-09-30T18:31:37.895161] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-30T18:31:38.130854] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T18:31:38.342246] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-30T18:31:38.342351] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-30T18:31:38.342536] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-30T18:31:38.342579] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-30T18:31:38.343043] [DEBUG] [LOCAL ] ELC: Trimmed 5094 records to 3479 (keeping 200 days of data) [2025-09-30T18:31:38.364667] [DEBUG] [LOCAL ] ELC: Primary data saved (3479 records). [2025-09-30T18:31:38.364799] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-30T18:31:38.364912] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 11.0s. Estimated remaining: 3h 29m 35s. Rate: 7.9 symbols/min [2025-09-30T18:31:38.551533] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:31:38.614624] [DEBUG] [LOCAL ] ELME: Loaded 39202 existing records from primary storage. [2025-09-30T18:31:38.615102] [INFO ] [MAIN ] ELME: Loaded 39202 existing records. [2025-09-30T18:31:38.666813] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-30T18:31:38.854985] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:31:38.855237] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-30T18:31:38.855287] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-30T18:31:38.856092] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-30T18:31:38.856153] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-30T18:31:39.259007] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:31:39.454360] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-30T18:31:40.073685] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-30T18:31:40.254398] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-30T18:31:40.498619] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T18:31:41.054332] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-30T18:31:41.343803] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T18:31:41.854370] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-30T18:31:42.064127] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T18:31:42.634139] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T18:31:42.654328] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-30T18:31:43.454365] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-30T18:31:44.142603] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T18:31:44.254369] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-30T18:31:44.354909] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:31:44.407879] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T18:31:45.054357] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-30T18:31:45.854351] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-30T18:31:46.348382] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-30T18:31:46.654360] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-30T18:31:46.991828] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:31:47.318335] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T18:31:47.454361] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-30T18:31:48.254359] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-30T18:31:48.920210] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-30T18:31:49.043157] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:31:49.054348] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-30T18:31:49.678702] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T18:31:49.854374] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-30T18:31:50.654344] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-30T18:31:50.765853] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T18:31:51.454331] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-30T18:31:51.960261] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-30T18:31:52.221516] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T18:31:52.233871] [INFO ] [REMOTE ] ELAN: Full fetch complete (76864 records). [2025-09-30T18:31:52.234046] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-30T18:31:52.259544] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-30T18:31:52.718241] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-30T18:31:52.718365] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-30T18:31:52.719304] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-30T18:31:52.719371] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-30T18:31:52.722355] [DEBUG] [LOCAL ] ELAN: Trimmed 76864 records to 53230 (keeping 200 days of data) [2025-09-30T18:31:53.056461] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-30T18:31:53.080363] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T18:31:53.097551] [DEBUG] [LOCAL ] ELAN: Primary data saved (53230 records). [2025-09-30T18:31:53.098131] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-30T18:31:53.098270] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. ELAN took 25.7s. Estimated remaining: 3h 29m 43s. Rate: 7.9 symbols/min [2025-09-30T18:31:53.282808] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:31:53.313179] [DEBUG] [LOCAL ] ELP: Loaded 25746 existing records from primary storage. [2025-09-30T18:31:53.313494] [INFO ] [MAIN ] ELP: Loaded 25746 existing records. [2025-09-30T18:31:53.509320] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:31:53.509567] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-30T18:31:53.509616] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-30T18:31:53.509949] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-30T18:31:53.510015] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-30T18:31:53.862284] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-30T18:31:53.911196] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:31:54.190575] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-30T18:31:54.654316] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-30T18:31:55.148801] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-30T18:31:55.270303] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T18:31:55.454398] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-30T18:31:56.254403] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-30T18:31:56.663949] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T18:31:56.987373] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T18:31:57.054575] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-30T18:31:57.133376] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T18:31:57.854427] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-30T18:31:58.276679] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T18:31:58.654376] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-30T18:31:59.454420] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-30T18:31:59.738444] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T18:31:59.856339] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T18:32:00.254411] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-30T18:32:01.054395] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-30T18:32:01.424561] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T18:32:01.854398] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-30T18:32:01.894127] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T18:32:02.160926] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:32:02.170787] [INFO ] [REMOTE ] ELME: Full fetch complete (55945 records). [2025-09-30T18:32:02.170998] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-30T18:32:02.637785] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-30T18:32:02.637871] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-30T18:32:02.638696] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-30T18:32:02.638843] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-30T18:32:02.640118] [DEBUG] [LOCAL ] ELME: Trimmed 55945 records to 39204 (keeping 200 days of data) [2025-09-30T18:32:02.695461] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-30T18:32:02.916271] [DEBUG] [LOCAL ] ELME: Primary data saved (39204 records). [2025-09-30T18:32:02.916442] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-30T18:32:02.916541] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELME took 24.6s. Estimated remaining: 3h 29m 41s. Rate: 7.9 symbols/min [2025-09-30T18:32:03.100690] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:03.100896] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-30T18:32:03.100943] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-30T18:32:03.101057] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-30T18:32:03.101100] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-30T18:32:03.101144] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-30T18:32:03.101176] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-30T18:32:03.463072] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-30T18:32:03.499939] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:03.662978] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:32:03.674274] [INFO ] [REMOTE ] EL: Full fetch complete (76937 records). [2025-09-30T18:32:03.674433] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-30T18:32:03.675387] [FATAL] [VALIDATOR ] EL: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:32:03.675481] [FATAL] [MAIN ] EL: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:32:03.675530] [WARN ] [MAIN ] EL: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:32:03.675600] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-30T18:32:03.675700] [DEBUG] [LOCAL ] EL: No primary data file found to delete. [2025-09-30T18:32:03.675756] [INFO ] [LOCAL ] EL: Starting deletion of derivative data. [2025-09-30T18:32:03.676034] [DEBUG] [LOCAL ] EL: Deleted derivative data file. [2025-09-30T18:32:03.676136] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. EL took 36.3s. Estimated remaining: 3h 29m 17s. Rate: 7.9 symbols/min [2025-09-30T18:32:03.870303] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:03.931452] [DEBUG] [LOCAL ] ELS: Loaded 49379 existing records from primary storage. [2025-09-30T18:32:03.931862] [INFO ] [MAIN ] ELS: Loaded 49379 existing records. [2025-09-30T18:32:04.118776] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:32:04.119033] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-30T18:32:04.119093] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-30T18:32:04.119779] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-30T18:32:04.119840] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-30T18:32:04.266521] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-30T18:32:04.512129] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:04.688083] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T18:32:04.720482] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-30T18:32:04.799040] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-30T18:32:05.054612] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-30T18:32:05.854370] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-30T18:32:06.654363] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-30T18:32:06.736832] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T18:32:07.454409] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-30T18:32:07.776916] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-30T18:32:07.882715] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T18:32:07.893904] [INFO ] [REMOTE ] ELF: Full fetch complete (75342 records). [2025-09-30T18:32:07.894057] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-30T18:32:08.205848] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T18:32:08.260243] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-30T18:32:08.387198] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-30T18:32:08.387302] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-30T18:32:08.388305] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-30T18:32:08.388374] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-30T18:32:08.389998] [DEBUG] [LOCAL ] ELF: Trimmed 75342 records to 52207 (keeping 200 days of data) [2025-09-30T18:32:08.727686] [DEBUG] [LOCAL ] ELF: Primary data saved (52207 records). [2025-09-30T18:32:08.727842] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-30T18:32:08.728855] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELF took 41.4s. Estimated remaining: 3h 29m 4s. Rate: 7.9 symbols/min [2025-09-30T18:32:08.917440] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:08.917623] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-09-30T18:32:08.917708] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-09-30T18:32:08.917838] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-30T18:32:08.917897] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-30T18:32:08.917983] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-30T18:32:08.918038] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-30T18:32:09.059547] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-30T18:32:09.312440] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:09.854352] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-30T18:32:10.169023] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T18:32:10.207193] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T18:32:10.654361] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-30T18:32:11.454414] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-30T18:32:11.783834] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T18:32:12.009602] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T18:32:12.254388] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-30T18:32:12.346705] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T18:32:13.054402] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-30T18:32:13.849968] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:32:13.860453] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-30T18:32:14.214673] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-30T18:32:14.654326] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-30T18:32:14.776945] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T18:32:15.454399] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-30T18:32:16.003329] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:32:16.254387] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-30T18:32:17.054433] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-30T18:32:17.268952] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T18:32:17.318719] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T18:32:17.396274] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T18:32:17.854364] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-30T18:32:18.654346] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-30T18:32:19.241272] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T18:32:19.246733] [INFO ] [REMOTE ] ELP: Full fetch complete (37343 records). [2025-09-30T18:32:19.246855] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-30T18:32:19.459685] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-30T18:32:19.671487] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-30T18:32:19.671634] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-30T18:32:19.672283] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-30T18:32:19.672329] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-30T18:32:19.673445] [DEBUG] [LOCAL ] ELP: Trimmed 37343 records to 25714 (keeping 200 days of data) [2025-09-30T18:32:19.831424] [DEBUG] [LOCAL ] ELP: Primary data saved (25714 records). [2025-09-30T18:32:19.832216] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-30T18:32:19.832314] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELP took 26.7s. Estimated remaining: 3h 29m 4s. Rate: 7.9 symbols/min [2025-09-30T18:32:20.022807] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T18:32:20.027106] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:20.029047] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-30T18:32:20.029093] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-30T18:32:20.029206] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-30T18:32:20.029247] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-30T18:32:20.029288] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-30T18:32:20.029320] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-30T18:32:20.256742] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-30T18:32:20.423676] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:20.456577] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T18:32:21.054424] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-30T18:32:21.256168] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:32:21.256510] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-30T18:32:21.256622] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:32:21.256718] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-09-30T18:32:21.256784] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:32:21.256858] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-30T18:32:21.256955] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-30T18:32:21.257010] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-30T18:32:21.257074] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-30T18:32:21.257150] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. EMA took 1.4s. Estimated remaining: 3h 28m 43s. Rate: 7.9 symbols/min [2025-09-30T18:32:21.453142] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:21.476951] [DEBUG] [LOCAL ] EMD: Loaded 21085 existing records from primary storage. [2025-09-30T18:32:21.477239] [INFO ] [MAIN ] EMD: Loaded 21085 existing records. [2025-09-30T18:32:21.668133] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:32:21.668536] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-30T18:32:21.668600] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-30T18:32:21.668963] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-30T18:32:21.669023] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-30T18:32:21.860613] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-30T18:32:22.075135] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:22.105722] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T18:32:22.245776] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-30T18:32:22.654362] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-30T18:32:23.454371] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-30T18:32:24.254416] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-30T18:32:24.556099] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T18:32:24.603503] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-30T18:32:25.054355] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-30T18:32:25.244440] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:32:25.854389] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-30T18:32:26.654389] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-30T18:32:26.944546] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T18:32:27.454366] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-30T18:32:27.711848] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-30T18:32:28.070156] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T18:32:28.092588] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-30T18:32:28.254380] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-30T18:32:28.614406] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-30T18:32:29.054370] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-30T18:32:29.854376] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-30T18:32:30.143710] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T18:32:30.654382] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-30T18:32:31.418335] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T18:32:31.454310] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-30T18:32:31.779932] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T18:32:32.254403] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-30T18:32:32.780465] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-30T18:32:32.781410] [INFO ] [REMOTE ] ELPC: Full fetch complete (1456 records). [2025-09-30T18:32:32.781486] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-30T18:32:32.781924] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:32:32.782028] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:32:32.782103] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:32:32.782198] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-30T18:32:32.782296] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-30T18:32:32.782344] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-30T18:32:32.782422] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-30T18:32:32.782498] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. ELPC took 29.9s. Estimated remaining: 3h 28m 44s. Rate: 7.9 symbols/min [2025-09-30T18:32:33.036289] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T18:32:33.056751] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-30T18:32:33.059621] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:33.061376] [DEBUG] [LOCAL ] EME: No existing data file found in primary storage. [2025-09-30T18:32:33.061467] [WARN ] [MAIN ] EME: No existing data found, performing full refresh instead. [2025-09-30T18:32:33.061699] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-30T18:32:33.061858] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-30T18:32:33.061929] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-09-30T18:32:33.061966] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-30T18:32:33.545154] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:33.854394] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-30T18:32:34.654350] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-30T18:32:34.852784] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T18:32:35.005071] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T18:32:35.454386] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-30T18:32:35.832227] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T18:32:36.254365] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-30T18:32:37.054417] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-30T18:32:37.592432] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T18:32:37.827322] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-30T18:32:37.854343] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-30T18:32:38.654357] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-30T18:32:38.968120] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:32:38.979145] [INFO ] [REMOTE ] ELS: Full fetch complete (70340 records). [2025-09-30T18:32:38.979360] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-30T18:32:38.980310] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:32:38.980418] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:32:38.980479] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:32:38.980555] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-30T18:32:38.980637] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-09-30T18:32:38.980721] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-09-30T18:32:38.981006] [DEBUG] [LOCAL ] ELS: Deleted derivative data file. [2025-09-30T18:32:38.981116] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. ELS took 35.3s. Estimated remaining: 3h 28m 33s. Rate: 7.9 symbols/min [2025-09-30T18:32:39.173193] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:39.180690] [DEBUG] [LOCAL ] EMF: Loaded 3445 existing records from primary storage. [2025-09-30T18:32:39.180919] [INFO ] [MAIN ] EMF: Loaded 3445 existing records. [2025-09-30T18:32:39.409448] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:32:39.409884] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-30T18:32:39.409956] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-30T18:32:39.410393] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-30T18:32:39.410466] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-30T18:32:39.462531] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-30T18:32:39.807757] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:39.855527] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T18:32:39.856798] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T18:32:40.254361] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-30T18:32:41.054366] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-30T18:32:41.592436] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-30T18:32:41.854365] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-30T18:32:42.083891] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T18:32:42.481568] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-30T18:32:42.492416] [INFO ] [REMOTE ] ELV: Full fetch complete (72803 records). [2025-09-30T18:32:42.492575] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-30T18:32:42.493429] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:32:42.493520] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:32:42.493564] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:32:42.493603] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-30T18:32:42.493688] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-30T18:32:42.493743] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-09-30T18:32:42.493786] [DEBUG] [LOCAL ] ELV: No derivative data file found to delete. [2025-09-30T18:32:42.493844] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. ELV took 33.8s. Estimated remaining: 3h 28m 16s. Rate: 7.9 symbols/min [2025-09-30T18:32:42.660376] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-30T18:32:42.691366] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:42.753185] [DEBUG] [LOCAL ] EMN: Loaded 50422 existing records from primary storage. [2025-09-30T18:32:42.753529] [INFO ] [MAIN ] EMN: Loaded 50422 existing records. [2025-09-30T18:32:42.948636] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:32:42.948917] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-30T18:32:42.948965] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-30T18:32:42.949704] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-30T18:32:42.949766] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-30T18:32:43.344599] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:43.454385] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-30T18:32:43.664590] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T18:32:44.254362] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-30T18:32:45.054323] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-30T18:32:45.223885] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-30T18:32:45.854356] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-30T18:32:45.885974] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T18:32:45.966041] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T18:32:46.639466] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-30T18:32:46.654376] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-30T18:32:47.067936] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T18:32:47.454395] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-30T18:32:48.254339] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-30T18:32:48.414093] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:32:48.761600] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-30T18:32:49.054390] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-30T18:32:49.295554] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-30T18:32:49.854367] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-30T18:32:50.258402] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T18:32:50.263109] [INFO ] [REMOTE ] EMD: Full fetch complete (32097 records). [2025-09-30T18:32:50.263222] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-30T18:32:50.263817] [FATAL] [VALIDATOR ] EMD: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:32:50.263910] [FATAL] [MAIN ] EMD: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:32:50.263990] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:32:50.264072] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-30T18:32:50.264163] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-09-30T18:32:50.264233] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-09-30T18:32:50.264505] [DEBUG] [LOCAL ] EMD: Deleted derivative data file. [2025-09-30T18:32:50.264701] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EMD took 29.0s. Estimated remaining: 3h 28m 9s. Rate: 7.9 symbols/min [2025-09-30T18:32:50.449436] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:32:50.449757] [DEBUG] [LOCAL ] EMO: No existing data file found in primary storage. [2025-09-30T18:32:50.449877] [WARN ] [MAIN ] EMO: No existing data found, performing full refresh instead. [2025-09-30T18:32:50.450039] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-30T18:32:50.450136] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-30T18:32:50.450368] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-09-30T18:32:50.455429] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-30T18:32:50.455630] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T18:32:50.658018] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-30T18:32:50.857858] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:32:51.454404] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-30T18:32:52.254332] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-30T18:32:52.365884] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T18:32:52.489755] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T18:32:53.054403] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-30T18:32:53.166243] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T18:32:53.854436] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-30T18:32:54.419726] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T18:32:54.654393] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-30T18:32:54.680219] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T18:32:55.454379] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-30T18:32:56.045555] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:32:56.254372] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-30T18:32:56.837070] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T18:32:57.031075] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T18:32:57.054341] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-30T18:32:57.854373] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-30T18:32:57.936220] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T18:32:58.419170] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T18:32:58.654380] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-30T18:32:59.454379] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-30T18:33:00.254350] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-30T18:33:00.436278] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T18:33:00.894508] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T18:33:01.054351] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-30T18:33:01.226329] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:33:01.235251] [INFO ] [REMOTE ] EME: Full fetch complete (46667 records). [2025-09-30T18:33:01.235445] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-30T18:33:01.239256] [FATAL] [VALIDATOR ] EME: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:33:01.239374] [FATAL] [MAIN ] EME: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:33:01.239420] [WARN ] [MAIN ] EME: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:33:01.239493] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-30T18:33:01.239605] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-09-30T18:33:01.239686] [INFO ] [LOCAL ] EME: Starting deletion of derivative data. [2025-09-30T18:33:01.239764] [DEBUG] [LOCAL ] EME: No derivative data file found to delete. [2025-09-30T18:33:01.239849] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EME took 28.5s. Estimated remaining: 3h 28m 9s. Rate: 7.9 symbols/min [2025-09-30T18:33:01.422770] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:01.422963] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-09-30T18:33:01.423035] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-09-30T18:33:01.423154] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-30T18:33:01.423247] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-30T18:33:01.423308] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-09-30T18:33:01.423346] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-30T18:33:01.742327] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-30T18:33:01.859434] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:01.859526] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-30T18:33:02.607142] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T18:33:02.654386] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-30T18:33:03.454393] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-30T18:33:03.481471] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T18:33:04.104753] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T18:33:04.254368] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-30T18:33:05.054400] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-30T18:33:05.721898] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-30T18:33:05.854334] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-30T18:33:06.027164] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T18:33:06.492427] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T18:33:06.654363] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-30T18:33:07.241219] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T18:33:07.454406] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-30T18:33:08.157192] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T18:33:08.158518] [INFO ] [REMOTE ] EMF: Full fetch complete (7161 records). [2025-09-30T18:33:08.158626] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-30T18:33:08.261994] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-30T18:33:08.550494] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-30T18:33:08.550603] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-30T18:33:08.550852] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-30T18:33:08.550927] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-30T18:33:08.551529] [DEBUG] [LOCAL ] EMF: Trimmed 7161 records to 3427 (keeping 200 days of data) [2025-09-30T18:33:08.573511] [DEBUG] [LOCAL ] EMF: Primary data saved (3427 records). [2025-09-30T18:33:08.573592] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-30T18:33:08.573730] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EMF took 29.6s. Estimated remaining: 3h 28m 0s. Rate: 7.9 symbols/min [2025-09-30T18:33:08.770454] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:08.815957] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T18:33:08.841371] [DEBUG] [LOCAL ] EMR: Loaded 53249 existing records from primary storage. [2025-09-30T18:33:08.841790] [INFO ] [MAIN ] EMR: Loaded 53249 existing records. [2025-09-30T18:33:09.034184] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:33:09.034417] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-30T18:33:09.034464] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-30T18:33:09.036396] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-30T18:33:09.036482] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-30T18:33:09.059521] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-30T18:33:09.411741] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:09.854379] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-30T18:33:10.382480] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-30T18:33:10.654403] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-30T18:33:11.375160] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-30T18:33:11.454379] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-30T18:33:12.047952] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T18:33:12.254351] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-30T18:33:12.610899] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T18:33:13.054325] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-30T18:33:13.223198] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T18:33:13.715437] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T18:33:13.854367] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-30T18:33:14.654374] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-30T18:33:15.217865] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-30T18:33:15.454409] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-30T18:33:15.696678] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T18:33:16.254341] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-30T18:33:16.392892] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T18:33:17.054369] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-30T18:33:17.216214] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T18:33:17.854359] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-30T18:33:17.885585] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T18:33:18.654425] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-30T18:33:19.454405] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-30T18:33:19.684602] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T18:33:20.025365] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T18:33:20.254366] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-30T18:33:20.474985] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T18:33:21.054346] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-30T18:33:21.148775] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T18:33:21.854357] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-30T18:33:22.654349] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-30T18:33:23.156756] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-30T18:33:23.454336] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-30T18:33:23.614401] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-30T18:33:23.618616] [INFO ] [REMOTE ] EMO: Full fetch complete (17024 records). [2025-09-30T18:33:23.618762] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-30T18:33:23.619380] [FATAL] [VALIDATOR ] EMO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:33:23.619467] [FATAL] [MAIN ] EMO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:33:23.619512] [WARN ] [MAIN ] EMO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:33:23.619584] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-30T18:33:23.619722] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-09-30T18:33:23.619784] [INFO ] [LOCAL ] EMO: Starting deletion of derivative data. [2025-09-30T18:33:23.619894] [DEBUG] [LOCAL ] EMO: No derivative data file found to delete. [2025-09-30T18:33:23.619977] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMO took 33.4s. Estimated remaining: 3h 28m 9s. Rate: 7.9 symbols/min [2025-09-30T18:33:23.890514] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:23.930425] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-30T18:33:23.944219] [INFO ] [REMOTE ] EMN: Full fetch complete (72018 records). [2025-09-30T18:33:23.944396] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-30T18:33:24.255862] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-30T18:33:24.372917] [DEBUG] [LOCAL ] ENB: Loaded 53513 existing records from primary storage. [2025-09-30T18:33:24.383314] [INFO ] [MAIN ] ENB: Loaded 53513 existing records. [2025-09-30T18:33:24.524282] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-30T18:33:24.536363] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-30T18:33:24.548188] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-30T18:33:24.558690] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-30T18:33:24.636613] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:33:24.636834] [DEBUG] [LOCAL ] EMN: Trimmed 72018 records to 50415 (keeping 200 days of data) [2025-09-30T18:33:24.637132] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-30T18:33:24.637226] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-30T18:33:24.638857] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-30T18:33:24.639072] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-30T18:33:24.825304] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-30T18:33:25.054948] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-30T18:33:25.175341] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:25.228201] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:33:25.445028] [DEBUG] [LOCAL ] EMN: Primary data saved (50415 records). [2025-09-30T18:33:25.445193] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-30T18:33:25.446050] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMN took 43.0s. Estimated remaining: 3h 27m 49s. Rate: 7.9 symbols/min [2025-09-30T18:33:25.628427] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:25.636639] [DEBUG] [LOCAL ] ENFY: Loaded 3090 existing records from primary storage. [2025-09-30T18:33:25.636902] [INFO ] [MAIN ] ENFY: Loaded 3090 existing records. [2025-09-30T18:33:25.837668] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:33:25.838004] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-30T18:33:25.838064] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-30T18:33:25.838268] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-30T18:33:25.838327] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-30T18:33:25.860018] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-30T18:33:25.967083] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T18:33:25.997750] [INFO ] [REMOTE ] EMP: Full fetch complete (4242 records). [2025-09-30T18:33:26.005863] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-30T18:33:26.021508] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:33:26.067319] [FATAL] [MAIN ] EMP: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:33:26.112000] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:33:26.136619] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-30T18:33:26.139585] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-09-30T18:33:26.139977] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-09-30T18:33:26.140055] [DEBUG] [LOCAL ] EMP: No derivative data file found to delete. [2025-09-30T18:33:26.140165] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMP took 24.9s. Estimated remaining: 3h 27m 26s. Rate: 7.9 symbols/min [2025-09-30T18:33:26.334862] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:26.410594] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:26.460261] [DEBUG] [LOCAL ] ENIC: Loaded 36314 existing records from primary storage. [2025-09-30T18:33:26.460558] [INFO ] [MAIN ] ENIC: Loaded 36314 existing records. [2025-09-30T18:33:26.651793] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:33:26.651996] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-30T18:33:26.652046] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-30T18:33:26.652809] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-30T18:33:26.652869] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-30T18:33:26.664237] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-30T18:33:27.031320] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:27.454383] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-30T18:33:27.843340] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T18:33:28.055873] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-30T18:33:28.254323] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-30T18:33:28.638029] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-30T18:33:29.054362] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-30T18:33:29.780406] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T18:33:29.854359] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-30T18:33:30.081679] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T18:33:30.654361] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-30T18:33:31.327278] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T18:33:31.454359] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-30T18:33:32.254350] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-30T18:33:32.340215] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T18:33:33.054342] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-30T18:33:33.538444] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-30T18:33:33.574376] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:33:33.854363] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-30T18:33:34.644853] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:33:34.655765] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-30T18:33:35.090431] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T18:33:35.454359] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-30T18:33:36.254327] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-30T18:33:36.301779] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T18:33:36.532842] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T18:33:36.947819] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T18:33:37.054389] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-30T18:33:37.516121] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T18:33:37.854357] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-30T18:33:38.654368] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-30T18:33:39.443906] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T18:33:39.455036] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-30T18:33:40.191502] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T18:33:40.254335] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-30T18:33:40.613337] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-30T18:33:41.054366] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-30T18:33:41.487283] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-30T18:33:41.854373] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-30T18:33:42.654366] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-30T18:33:42.966940] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T18:33:43.458396] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-30T18:33:43.464219] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T18:33:44.254335] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-30T18:33:44.616580] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T18:33:44.772284] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-30T18:33:45.054393] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-30T18:33:45.631582] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-30T18:33:45.647394] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T18:33:45.854378] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-30T18:33:46.397193] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-30T18:33:46.654364] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-30T18:33:47.250554] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-30T18:33:47.454422] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-30T18:33:48.042436] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-30T18:33:48.043851] [INFO ] [REMOTE ] ENFY: Full fetch complete (5610 records). [2025-09-30T18:33:48.043943] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-30T18:33:48.263199] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-30T18:33:48.454129] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-30T18:33:48.454208] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-30T18:33:48.454408] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-30T18:33:48.454475] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-30T18:33:48.455003] [DEBUG] [LOCAL ] ENFY: Trimmed 5610 records to 3099 (keeping 200 days of data) [2025-09-30T18:33:48.473612] [DEBUG] [LOCAL ] ENFY: Primary data saved (3099 records). [2025-09-30T18:33:48.473738] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-30T18:33:48.473846] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. ENFY took 23.0s. Estimated remaining: 3h 27m 51s. Rate: 7.9 symbols/min [2025-09-30T18:33:48.656611] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:48.661414] [DEBUG] [LOCAL ] ENO: Loaded 1914 existing records from primary storage. [2025-09-30T18:33:48.661627] [INFO ] [MAIN ] ENO: Loaded 1914 existing records. [2025-09-30T18:33:48.861935] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:33:48.862240] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-30T18:33:48.862302] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-30T18:33:48.862512] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-30T18:33:48.862581] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-30T18:33:49.068692] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-30T18:33:49.279237] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:49.854373] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-30T18:33:50.485696] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T18:33:50.501013] [INFO ] [REMOTE ] EMR: Full fetch complete (76721 records). [2025-09-30T18:33:50.501176] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-30T18:33:50.502073] [FATAL] [VALIDATOR ] EMR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:33:50.502202] [FATAL] [MAIN ] EMR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:33:50.502261] [WARN ] [MAIN ] EMR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:33:50.502333] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-30T18:33:50.502400] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-09-30T18:33:50.502435] [INFO ] [LOCAL ] EMR: Starting deletion of derivative data. [2025-09-30T18:33:50.502795] [DEBUG] [LOCAL ] EMR: Deleted derivative data file. [2025-09-30T18:33:50.502907] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. EMR took 41.9s. Estimated remaining: 3h 27m 31s. Rate: 7.9 symbols/min [2025-09-30T18:33:50.658078] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-30T18:33:50.694232] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:50.752167] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T18:33:50.755874] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T18:33:50.782295] [DEBUG] [LOCAL ] ENOV: Loaded 45017 existing records from primary storage. [2025-09-30T18:33:50.782625] [INFO ] [MAIN ] ENOV: Loaded 45017 existing records. [2025-09-30T18:33:50.990081] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:33:50.990320] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-30T18:33:50.990374] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-30T18:33:50.990891] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-30T18:33:50.990954] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-30T18:33:51.403568] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:51.454335] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-30T18:33:52.103061] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T18:33:52.254351] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-30T18:33:52.330911] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T18:33:53.054358] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-30T18:33:53.663320] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T18:33:53.854371] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-30T18:33:54.654397] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-30T18:33:54.855635] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T18:33:54.991399] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T18:33:55.239915] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T18:33:55.454397] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-30T18:33:56.254369] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-30T18:33:56.723320] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-30T18:33:57.054319] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-30T18:33:57.483788] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T18:33:57.495759] [INFO ] [REMOTE ] ENB: Full fetch complete (77490 records). [2025-09-30T18:33:57.495906] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-30T18:33:57.619343] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T18:33:57.859535] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-30T18:33:57.943269] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-30T18:33:57.943369] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-30T18:33:57.944378] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-30T18:33:57.944448] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-30T18:33:57.946154] [DEBUG] [LOCAL ] ENB: Trimmed 77490 records to 53511 (keeping 200 days of data) [2025-09-30T18:33:58.290206] [DEBUG] [LOCAL ] ENB: Primary data saved (53511 records). [2025-09-30T18:33:58.290340] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-30T18:33:58.290424] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENB took 34.7s. Estimated remaining: 3h 27m 24s. Rate: 7.9 symbols/min [2025-09-30T18:33:58.476697] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:33:58.476945] [DEBUG] [LOCAL ] ENR: No existing data file found in primary storage. [2025-09-30T18:33:58.476992] [WARN ] [MAIN ] ENR: No existing data found, performing full refresh instead. [2025-09-30T18:33:58.477104] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-30T18:33:58.477147] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-30T18:33:58.477191] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-30T18:33:58.477227] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-30T18:33:58.648526] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T18:33:58.660093] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-30T18:33:58.885399] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:33:59.454375] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-30T18:34:00.254316] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-30T18:34:00.718815] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-30T18:34:00.726763] [INFO ] [REMOTE ] ENIC: Full fetch complete (51082 records). [2025-09-30T18:34:00.726958] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-30T18:34:00.727859] [FATAL] [VALIDATOR ] ENIC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:34:00.727965] [FATAL] [MAIN ] ENIC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:34:00.728011] [WARN ] [MAIN ] ENIC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:34:00.728065] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-30T18:34:00.728406] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-09-30T18:34:00.728493] [INFO ] [LOCAL ] ENIC: Starting deletion of derivative data. [2025-09-30T18:34:00.728854] [DEBUG] [LOCAL ] ENIC: Deleted derivative data file. [2025-09-30T18:34:00.728959] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENIC took 34.6s. Estimated remaining: 3h 27m 5s. Rate: 7.9 symbols/min [2025-09-30T18:34:00.927157] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:00.927337] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-09-30T18:34:00.927376] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-09-30T18:34:00.927502] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-30T18:34:00.927546] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-30T18:34:00.927588] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-09-30T18:34:00.927621] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-30T18:34:01.059463] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-30T18:34:01.139714] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T18:34:01.325937] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:34:01.416919] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T18:34:01.854371] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-30T18:34:02.343483] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T18:34:02.654372] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-30T18:34:03.206014] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-30T18:34:03.454464] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-30T18:34:04.254431] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-30T18:34:04.289770] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:34:04.624015] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T18:34:05.054382] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-30T18:34:05.714083] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T18:34:05.854357] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-30T18:34:06.468321] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T18:34:06.654364] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-30T18:34:07.420065] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T18:34:07.454321] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-30T18:34:07.813882] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:34:08.254373] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-30T18:34:08.696741] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T18:34:09.025778] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T18:34:09.054316] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-30T18:34:09.854403] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-30T18:34:10.432484] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T18:34:10.433517] [INFO ] [REMOTE ] ENO: Full fetch complete (3102 records). [2025-09-30T18:34:10.433591] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-30T18:34:10.434004] [FATAL] [VALIDATOR ] ENO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:34:10.434084] [FATAL] [MAIN ] ENO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:34:10.434154] [WARN ] [MAIN ] ENO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:34:10.434228] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-30T18:34:10.434294] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-09-30T18:34:10.434331] [INFO ] [LOCAL ] ENO: Starting deletion of derivative data. [2025-09-30T18:34:10.434514] [DEBUG] [LOCAL ] ENO: Deleted derivative data file. [2025-09-30T18:34:10.434607] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENO took 22.0s. Estimated remaining: 3h 27m 2s. Rate: 7.9 symbols/min [2025-09-30T18:34:10.647060] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:10.647436] [DEBUG] [LOCAL ] ENVA: No existing data file found in primary storage. [2025-09-30T18:34:10.647503] [WARN ] [MAIN ] ENVA: No existing data found, performing full refresh instead. [2025-09-30T18:34:10.647813] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-30T18:34:10.647962] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-30T18:34:10.648029] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-09-30T18:34:10.648065] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-30T18:34:10.659763] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-30T18:34:11.066097] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T18:34:11.087486] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:34:11.454398] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-30T18:34:12.182134] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:34:12.254388] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-30T18:34:12.879871] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T18:34:13.054424] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-30T18:34:13.582235] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T18:34:13.854411] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-30T18:34:14.551439] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:34:14.654393] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-30T18:34:15.454362] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-30T18:34:15.590296] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T18:34:16.090262] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T18:34:16.254404] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-30T18:34:17.013863] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T18:34:17.054364] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-30T18:34:17.456157] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T18:34:17.854417] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-30T18:34:18.337048] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T18:34:18.654449] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-30T18:34:19.454363] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-30T18:34:19.523473] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T18:34:19.617565] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T18:34:20.254398] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-30T18:34:20.700247] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T18:34:21.054415] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-30T18:34:21.556039] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T18:34:21.854423] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-30T18:34:22.505041] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T18:34:22.654420] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-30T18:34:23.329942] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T18:34:23.454386] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-30T18:34:24.058372] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T18:34:24.254400] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-30T18:34:24.476870] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T18:34:25.054399] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-30T18:34:25.854458] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-30T18:34:26.265845] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T18:34:26.451952] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T18:34:26.654385] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-30T18:34:26.826520] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T18:34:27.454395] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-30T18:34:28.254439] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-30T18:34:28.396528] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T18:34:28.450502] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T18:34:29.054399] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-30T18:34:29.718572] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T18:34:29.727631] [INFO ] [REMOTE ] ENR: Full fetch complete (58208 records). [2025-09-30T18:34:29.727838] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-30T18:34:29.728776] [FATAL] [VALIDATOR ] ENR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:34:29.728876] [FATAL] [MAIN ] ENR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:34:29.728922] [WARN ] [MAIN ] ENR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:34:29.728965] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-30T18:34:29.729026] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-30T18:34:29.729063] [INFO ] [LOCAL ] ENR: Starting deletion of derivative data. [2025-09-30T18:34:29.729123] [DEBUG] [LOCAL ] ENR: No derivative data file found to delete. [2025-09-30T18:34:29.729207] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENR took 31.4s. Estimated remaining: 3h 27m 20s. Rate: 7.9 symbols/min [2025-09-30T18:34:29.859487] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-30T18:34:29.910513] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:29.927588] [DEBUG] [LOCAL ] EOD: Loaded 14134 existing records from primary storage. [2025-09-30T18:34:29.927932] [INFO ] [MAIN ] EOD: Loaded 14134 existing records. [2025-09-30T18:34:30.117436] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:34:30.117706] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-30T18:34:30.117765] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-30T18:34:30.118110] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-30T18:34:30.118188] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-30T18:34:30.504560] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:34:30.519214] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T18:34:30.654423] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-30T18:34:31.454450] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-30T18:34:31.796016] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T18:34:31.802962] [INFO ] [REMOTE ] ENS: Full fetch complete (42065 records). [2025-09-30T18:34:31.803101] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-30T18:34:32.237354] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-30T18:34:32.237514] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-30T18:34:32.238365] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-30T18:34:32.239086] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-30T18:34:32.240400] [DEBUG] [LOCAL ] ENS: Trimmed 42065 records to 29303 (keeping 200 days of data) [2025-09-30T18:34:32.304117] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-30T18:34:32.376714] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T18:34:32.487616] [DEBUG] [LOCAL ] ENS: Primary data saved (29303 records). [2025-09-30T18:34:32.487828] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-30T18:34:32.487920] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENS took 31.8s. Estimated remaining: 3h 27m 1s. Rate: 7.9 symbols/min [2025-09-30T18:34:32.684442] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:32.709874] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T18:34:32.778297] [DEBUG] [LOCAL ] EOG: Loaded 53342 existing records from primary storage. [2025-09-30T18:34:32.778737] [INFO ] [MAIN ] EOG: Loaded 53342 existing records. [2025-09-30T18:34:32.971912] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:34:32.972183] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-30T18:34:32.972239] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-30T18:34:32.972936] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-30T18:34:32.972999] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-30T18:34:33.059571] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-30T18:34:33.287610] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-30T18:34:33.370431] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:34:33.854424] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-30T18:34:34.348975] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T18:34:34.654369] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-30T18:34:35.427200] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T18:34:35.454326] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-30T18:34:35.695411] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-30T18:34:36.254355] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-30T18:34:36.788373] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T18:34:36.803788] [INFO ] [REMOTE ] ENOV: Full fetch complete (63141 records). [2025-09-30T18:34:36.803987] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-30T18:34:37.059586] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-30T18:34:37.248311] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-30T18:34:37.248444] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-30T18:34:37.249605] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-30T18:34:37.249725] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-30T18:34:37.251600] [DEBUG] [LOCAL ] ENOV: Trimmed 63141 records to 44995 (keeping 200 days of data) [2025-09-30T18:34:37.553166] [DEBUG] [LOCAL ] ENOV: Primary data saved (44995 records). [2025-09-30T18:34:37.553405] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-30T18:34:37.553539] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENOV took 47.1s. Estimated remaining: 3h 26m 48s. Rate: 7.9 symbols/min [2025-09-30T18:34:37.736836] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:37.757184] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T18:34:37.766770] [INFO ] [REMOTE ] ENVA: Full fetch complete (36746 records). [2025-09-30T18:34:37.766954] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-30T18:34:37.854468] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-30T18:34:37.885269] [DEBUG] [LOCAL ] EOI: Loaded 10661 existing records from primary storage. [2025-09-30T18:34:37.885870] [INFO ] [MAIN ] EOI: Loaded 10661 existing records. [2025-09-30T18:34:38.322734] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:34:38.333315] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-30T18:34:38.338549] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-30T18:34:38.364092] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-30T18:34:38.381821] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-30T18:34:38.437743] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-30T18:34:38.462216] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-30T18:34:38.478372] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-30T18:34:38.513628] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-30T18:34:38.565316] [DEBUG] [LOCAL ] ENVA: Trimmed 36746 records to 25406 (keeping 200 days of data) [2025-09-30T18:34:38.789992] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T18:34:38.820824] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-30T18:34:39.031886] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:34:39.130155] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-30T18:34:39.128078] [DEBUG] [LOCAL ] ENVA: Primary data saved (25406 records). [2025-09-30T18:34:39.144088] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-30T18:34:39.144441] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENVA took 28.7s. Estimated remaining: 3h 26m 27s. Rate: 7.9 symbols/min [2025-09-30T18:34:39.330627] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:39.347617] [DEBUG] [LOCAL ] EOS: Loaded 15244 existing records from primary storage. [2025-09-30T18:34:39.347971] [INFO ] [MAIN ] EOS: Loaded 15244 existing records. [2025-09-30T18:34:39.460261] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-30T18:34:39.545585] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:34:39.545814] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-30T18:34:39.545863] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-30T18:34:39.546456] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-30T18:34:39.546521] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-30T18:34:39.911153] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T18:34:39.947768] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:34:40.254371] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-30T18:34:40.431727] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T18:34:41.054382] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-30T18:34:41.674045] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T18:34:41.854368] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-30T18:34:42.654350] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-30T18:34:42.678715] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T18:34:42.837030] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-30T18:34:43.454425] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-30T18:34:43.638984] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T18:34:44.254428] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-30T18:34:45.054389] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-30T18:34:45.226700] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T18:34:45.858528] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-30T18:34:45.881280] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-30T18:34:45.932543] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-30T18:34:46.654422] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-30T18:34:47.029519] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T18:34:47.454383] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-30T18:34:48.254362] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-30T18:34:48.378924] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T18:34:48.531720] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T18:34:48.932085] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T18:34:49.054404] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-30T18:34:49.854420] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-30T18:34:50.654422] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-30T18:34:50.756833] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T18:34:50.918209] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T18:34:51.454342] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-30T18:34:51.526085] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T18:34:52.254378] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-30T18:34:53.029813] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T18:34:53.054326] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-30T18:34:53.361097] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T18:34:53.854425] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-30T18:34:54.654423] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-30T18:34:54.782621] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T18:34:54.997342] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:34:55.454385] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-30T18:34:55.551951] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T18:34:56.254382] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-30T18:34:56.347622] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T18:34:57.054378] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-30T18:34:57.854359] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-30T18:34:58.046778] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T18:34:58.144316] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T18:34:58.654370] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-30T18:34:58.834516] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T18:34:58.838402] [INFO ] [REMOTE ] EOD: Full fetch complete (20182 records). [2025-09-30T18:34:58.838516] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-30T18:34:59.243605] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-30T18:34:59.243717] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-30T18:34:59.244201] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-30T18:34:59.244245] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-30T18:34:59.245696] [DEBUG] [LOCAL ] EOD: Trimmed 20182 records to 14203 (keeping 200 days of data) [2025-09-30T18:34:59.332844] [DEBUG] [LOCAL ] EOD: Primary data saved (14203 records). [2025-09-30T18:34:59.332992] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-30T18:34:59.333082] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. EOD took 29.6s. Estimated remaining: 3h 26m 47s. Rate: 7.9 symbols/min [2025-09-30T18:34:59.459457] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-30T18:34:59.529554] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:34:59.538775] [DEBUG] [LOCAL ] EOT: Loaded 6885 existing records from primary storage. [2025-09-30T18:34:59.538967] [INFO ] [MAIN ] EOT: Loaded 6885 existing records. [2025-09-30T18:34:59.735283] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:34:59.735529] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-30T18:34:59.735588] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-30T18:34:59.735866] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-30T18:34:59.735928] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-30T18:35:00.111984] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:00.254332] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-30T18:35:00.324859] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T18:35:00.423178] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:35:00.434981] [INFO ] [REMOTE ] EOG: Full fetch complete (77274 records). [2025-09-30T18:35:00.435158] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-30T18:35:00.884750] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-30T18:35:00.884900] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-30T18:35:00.886342] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-30T18:35:00.886432] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-30T18:35:00.888948] [DEBUG] [LOCAL ] EOG: Trimmed 77274 records to 53343 (keeping 200 days of data) [2025-09-30T18:35:01.088028] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-30T18:35:01.142886] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T18:35:01.275060] [DEBUG] [LOCAL ] EOG: Primary data saved (53343 records). [2025-09-30T18:35:01.275226] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-30T18:35:01.275350] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOG took 28.8s. Estimated remaining: 3h 26m 27s. Rate: 7.9 symbols/min [2025-09-30T18:35:01.476038] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:01.476271] [DEBUG] [LOCAL ] EPAC: No existing data file found in primary storage. [2025-09-30T18:35:01.476312] [WARN ] [MAIN ] EPAC: No existing data found, performing full refresh instead. [2025-09-30T18:35:01.476431] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-30T18:35:01.476473] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-30T18:35:01.476515] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-09-30T18:35:01.476549] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-30T18:35:01.859536] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-30T18:35:01.933550] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:02.060597] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T18:35:02.654405] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-30T18:35:02.921363] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T18:35:03.454347] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-30T18:35:03.506928] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T18:35:03.510572] [INFO ] [REMOTE ] EOS: Full fetch complete (23215 records). [2025-09-30T18:35:03.510677] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-30T18:35:03.917441] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-30T18:35:03.917659] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-30T18:35:03.918235] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-30T18:35:03.918297] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-30T18:35:03.919007] [DEBUG] [LOCAL ] EOS: Trimmed 23215 records to 15187 (keeping 200 days of data) [2025-09-30T18:35:04.024262] [DEBUG] [LOCAL ] EOS: Primary data saved (15187 records). [2025-09-30T18:35:04.024380] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-30T18:35:04.024500] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOS took 24.9s. Estimated remaining: 3h 26m 9s. Rate: 7.9 symbols/min [2025-09-30T18:35:04.204606] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:04.252338] [DEBUG] [LOCAL ] EPAM: Loaded 39831 existing records from primary storage. [2025-09-30T18:35:04.252678] [INFO ] [MAIN ] EPAM: Loaded 39831 existing records. [2025-09-30T18:35:04.264682] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-30T18:35:04.447155] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:35:04.447409] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-30T18:35:04.447459] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-30T18:35:04.448272] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-30T18:35:04.448334] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-30T18:35:04.846183] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:05.043379] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T18:35:05.054297] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-30T18:35:05.112298] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T18:35:05.854307] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-30T18:35:06.106863] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-30T18:35:06.654406] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-30T18:35:07.132322] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T18:35:07.454408] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-30T18:35:08.193504] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-30T18:35:08.254379] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-30T18:35:08.359457] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T18:35:09.054403] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-30T18:35:09.497338] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T18:35:09.854379] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-30T18:35:09.962795] [DEBUG] [REMOTE ] EOT: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-30T18:35:09.963205] [WARN ] [REMOTE ] EOT: No data returned for month 2025-01 [2025-09-30T18:35:09.963334] [FATAL] [REMOTE ] EOT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:35:09.963567] [FATAL] [MAIN ] EOT: Failed to fetch primary data. [2025-09-30T18:35:09.963695] [WARN ] [MAIN ] EOT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:35:09.963774] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-30T18:35:09.963864] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-09-30T18:35:09.963952] [INFO ] [LOCAL ] EOT: Starting deletion of derivative data. [2025-09-30T18:35:09.964277] [DEBUG] [LOCAL ] EOT: Deleted derivative data file. [2025-09-30T18:35:09.964524] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOT took 10.6s. Estimated remaining: 3h 25m 57s. Rate: 7.9 symbols/min [2025-09-30T18:35:10.172502] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:10.225403] [DEBUG] [LOCAL ] EPC: Loaded 39719 existing records from primary storage. [2025-09-30T18:35:10.225785] [INFO ] [MAIN ] EPC: Loaded 39719 existing records. [2025-09-30T18:35:10.376399] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T18:35:10.450998] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:35:10.451256] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-30T18:35:10.451306] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-30T18:35:10.451762] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-30T18:35:10.451824] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-30T18:35:10.659546] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-30T18:35:10.835934] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:11.454322] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-30T18:35:11.919366] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-30T18:35:12.254411] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-30T18:35:13.015221] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T18:35:13.054344] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-30T18:35:13.319191] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T18:35:13.667542] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T18:35:13.854399] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-30T18:35:14.654358] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-30T18:35:14.673111] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T18:35:15.454408] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-30T18:35:16.097304] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T18:35:16.254373] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-30T18:35:16.474757] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T18:35:16.477798] [INFO ] [REMOTE ] EOI: Full fetch complete (16167 records). [2025-09-30T18:35:16.477958] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-30T18:35:16.905835] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-30T18:35:16.905929] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-30T18:35:16.906344] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-30T18:35:16.906411] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-30T18:35:16.907185] [DEBUG] [LOCAL ] EOI: Trimmed 16167 records to 10647 (keeping 200 days of data) [2025-09-30T18:35:16.976149] [DEBUG] [LOCAL ] EOI: Primary data saved (10647 records). [2025-09-30T18:35:16.976296] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-30T18:35:16.976463] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOI took 39.4s. Estimated remaining: 3h 25m 49s. Rate: 7.9 symbols/min [2025-09-30T18:35:17.059473] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-30T18:35:17.173547] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:17.235234] [DEBUG] [LOCAL ] EPD: Loaded 53610 existing records from primary storage. [2025-09-30T18:35:17.235573] [INFO ] [MAIN ] EPD: Loaded 53610 existing records. [2025-09-30T18:35:17.439005] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:35:17.439230] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-30T18:35:17.439280] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-30T18:35:17.439838] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-30T18:35:17.439979] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-30T18:35:17.603988] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T18:35:17.862459] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-30T18:35:17.912478] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:18.548974] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T18:35:18.654386] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-30T18:35:19.454365] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-30T18:35:19.664434] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T18:35:19.740698] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:35:20.254394] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-30T18:35:20.888944] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T18:35:21.054382] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-30T18:35:21.566942] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T18:35:21.854378] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-30T18:35:22.654363] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-30T18:35:22.717306] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T18:35:23.320234] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T18:35:23.454384] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-30T18:35:23.951041] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T18:35:24.254439] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-30T18:35:24.800431] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-30T18:35:25.054379] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-30T18:35:25.648822] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T18:35:25.854371] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-30T18:35:26.456618] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-30T18:35:26.463381] [INFO ] [REMOTE ] EPAC: Full fetch complete (39074 records). [2025-09-30T18:35:26.463502] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-30T18:35:26.664853] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-30T18:35:26.892558] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-30T18:35:26.892697] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-30T18:35:26.893419] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-30T18:35:26.893491] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-30T18:35:26.894519] [DEBUG] [LOCAL ] EPAC: Trimmed 39074 records to 26979 (keeping 200 days of data) [2025-09-30T18:35:27.071301] [DEBUG] [LOCAL ] EPAC: Primary data saved (26979 records). [2025-09-30T18:35:27.071446] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-30T18:35:27.071551] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPAC took 25.8s. Estimated remaining: 3h 25m 46s. Rate: 7.9 symbols/min [2025-09-30T18:35:27.261796] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:27.308526] [DEBUG] [LOCAL ] EPR: Loaded 43933 existing records from primary storage. [2025-09-30T18:35:27.308892] [INFO ] [MAIN ] EPR: Loaded 43933 existing records. [2025-09-30T18:35:27.458187] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-30T18:35:27.534929] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T18:35:27.545383] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:35:27.558343] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-30T18:35:27.558445] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-30T18:35:27.558946] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-30T18:35:27.559013] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-30T18:35:27.971401] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:28.254348] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-30T18:35:28.625970] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T18:35:28.680184] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T18:35:29.054357] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-30T18:35:29.861299] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-30T18:35:29.875747] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T18:35:30.654388] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-30T18:35:30.879463] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T18:35:31.358175] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T18:35:31.454355] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-30T18:35:32.254370] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-30T18:35:32.396473] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T18:35:33.056272] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-30T18:35:33.060136] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T18:35:33.800360] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:35:33.854377] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-30T18:35:34.564628] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T18:35:34.654354] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-30T18:35:35.454341] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-30T18:35:35.522765] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:35:36.204870] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T18:35:36.254350] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-30T18:35:37.054366] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-30T18:35:37.295524] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T18:35:37.304062] [INFO ] [REMOTE ] EPC: Full fetch complete (56512 records). [2025-09-30T18:35:37.304232] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-30T18:35:37.305321] [FATAL] [VALIDATOR ] EPC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:35:37.305462] [FATAL] [MAIN ] EPC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:35:37.305517] [WARN ] [MAIN ] EPC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:35:37.305596] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-30T18:35:37.305714] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-09-30T18:35:37.305782] [INFO ] [LOCAL ] EPC: Starting deletion of derivative data. [2025-09-30T18:35:37.306144] [DEBUG] [LOCAL ] EPC: Deleted derivative data file. [2025-09-30T18:35:37.306279] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPC took 27.3s. Estimated remaining: 3h 25m 44s. Rate: 7.9 symbols/min [2025-09-30T18:35:37.505439] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:37.553604] [DEBUG] [LOCAL ] EPRT: Loaded 48483 existing records from primary storage. [2025-09-30T18:35:37.553972] [INFO ] [MAIN ] EPRT: Loaded 48483 existing records. [2025-09-30T18:35:37.763556] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:35:37.764121] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-30T18:35:37.764277] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-30T18:35:37.764610] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-30T18:35:37.764758] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-30T18:35:37.866862] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-30T18:35:38.086163] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T18:35:38.140442] [INFO ] [REMOTE ] EPAM: Full fetch complete (56138 records). [2025-09-30T18:35:38.146263] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-30T18:35:38.267146] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:38.659566] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-30T18:35:38.713721] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-30T18:35:38.713854] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-30T18:35:38.714850] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-30T18:35:38.714967] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-30T18:35:38.716884] [DEBUG] [LOCAL ] EPAM: Trimmed 56138 records to 39781 (keeping 200 days of data) [2025-09-30T18:35:38.865840] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T18:35:39.044536] [DEBUG] [LOCAL ] EPAM: Primary data saved (39781 records). [2025-09-30T18:35:39.044759] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-30T18:35:39.045812] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPAM took 35.0s. Estimated remaining: 3h 25m 24s. Rate: 7.9 symbols/min [2025-09-30T18:35:39.246772] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:39.276304] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T18:35:39.295990] [DEBUG] [LOCAL ] EQBK: Loaded 10915 existing records from primary storage. [2025-09-30T18:35:39.296249] [INFO ] [MAIN ] EQBK: Loaded 10915 existing records. [2025-09-30T18:35:39.463287] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-30T18:35:39.487804] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:35:39.489068] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-30T18:35:39.489123] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-30T18:35:39.489393] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-30T18:35:39.489470] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-30T18:35:39.952707] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:40.254317] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-30T18:35:40.362992] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T18:35:41.054400] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-30T18:35:41.084990] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T18:35:41.659289] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-30T18:35:41.854382] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-30T18:35:42.503929] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T18:35:42.654360] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-30T18:35:42.800188] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T18:35:43.411429] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T18:35:43.454340] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-30T18:35:44.254396] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-30T18:35:45.036466] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T18:35:45.054335] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-30T18:35:45.087944] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T18:35:45.854373] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-30T18:35:46.602070] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T18:35:46.654368] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-30T18:35:46.988464] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T18:35:47.454360] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-30T18:35:47.943223] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T18:35:48.254404] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-30T18:35:49.054477] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-30T18:35:49.478596] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-30T18:35:49.805164] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T18:35:49.854419] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-30T18:35:50.654353] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-30T18:35:50.707197] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T18:35:51.394955] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T18:35:51.454323] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-30T18:35:51.896007] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-30T18:35:52.254415] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-30T18:35:53.015153] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T18:35:53.017158] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T18:35:53.054331] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-30T18:35:53.851677] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-30T18:35:53.855056] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-30T18:35:54.654455] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-30T18:35:55.454378] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-30T18:35:55.503213] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T18:35:55.600085] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T18:35:56.254370] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-30T18:35:57.054412] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-30T18:35:57.357946] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T18:35:57.370762] [INFO ] [REMOTE ] EPD: Full fetch complete (77640 records). [2025-09-30T18:35:57.370933] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-30T18:35:57.811944] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-30T18:35:57.812292] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-30T18:35:57.813355] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-30T18:35:57.813480] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-30T18:35:57.815209] [DEBUG] [LOCAL ] EPD: Trimmed 77640 records to 53610 (keeping 200 days of data) [2025-09-30T18:35:57.874114] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-30T18:35:57.931254] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T18:35:58.093180] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T18:35:58.105503] [INFO ] [REMOTE ] EPR: Full fetch complete (62919 records). [2025-09-30T18:35:58.106765] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-30T18:35:58.649560] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-30T18:35:58.649698] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-30T18:35:58.650671] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-30T18:35:58.650765] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-30T18:35:58.686135] [DEBUG] [LOCAL ] EPR: Trimmed 62919 records to 43924 (keeping 200 days of data) [2025-09-30T18:35:58.686264] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-30T18:35:58.835931] [DEBUG] [LOCAL ] EPD: Primary data saved (53610 records). [2025-09-30T18:35:58.837679] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-30T18:35:58.838086] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 41.9s. Estimated remaining: 3h 25m 42s. Rate: 7.9 symbols/min [2025-09-30T18:35:59.036981] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:35:59.038476] [DEBUG] [LOCAL ] EQH: No existing data file found in primary storage. [2025-09-30T18:35:59.039136] [WARN ] [MAIN ] EQH: No existing data found, performing full refresh instead. [2025-09-30T18:35:59.039866] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-30T18:35:59.040168] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-30T18:35:59.041093] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-09-30T18:35:59.041938] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-30T18:35:59.459930] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:35:59.460401] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-30T18:35:59.588379] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T18:35:59.660918] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T18:35:59.665683] [INFO ] [REMOTE ] EQBK: Full fetch complete (15417 records). [2025-09-30T18:35:59.666044] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-30T18:35:59.785789] [DEBUG] [LOCAL ] EPR: Primary data saved (43924 records). [2025-09-30T18:35:59.791766] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-30T18:35:59.791924] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPR took 32.7s. Estimated remaining: 3h 25m 21s. Rate: 7.9 symbols/min [2025-09-30T18:36:00.218312] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:00.259471] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-30T18:36:00.302802] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-30T18:36:00.302894] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-30T18:36:00.303323] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-30T18:36:00.303389] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-30T18:36:00.304740] [DEBUG] [LOCAL ] EQBK: Trimmed 15417 records to 10919 (keeping 200 days of data) [2025-09-30T18:36:00.407289] [DEBUG] [LOCAL ] EQNR: Loaded 53027 existing records from primary storage. [2025-09-30T18:36:00.408484] [INFO ] [MAIN ] EQNR: Loaded 53027 existing records. [2025-09-30T18:36:00.530112] [DEBUG] [LOCAL ] EQBK: Primary data saved (10919 records). [2025-09-30T18:36:00.534216] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-30T18:36:00.534757] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EQBK took 21.5s. Estimated remaining: 3h 24m 58s. Rate: 7.9 symbols/min [2025-09-30T18:36:00.747201] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:00.757809] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-30T18:36:00.768224] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-30T18:36:00.773810] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-30T18:36:00.773884] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-30T18:36:00.864235] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:01.202075] [DEBUG] [LOCAL ] EQR: Loaded 51469 existing records from primary storage. [2025-09-30T18:36:01.218082] [INFO ] [MAIN ] EQR: Loaded 51469 existing records. [2025-09-30T18:36:01.330517] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:01.346526] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-30T18:36:01.534761] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:01.537626] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-30T18:36:01.535684] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-30T18:36:01.549221] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-30T18:36:01.549577] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-30T18:36:01.549638] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-30T18:36:01.859459] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-30T18:36:01.939223] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:02.280150] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T18:36:02.654411] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-30T18:36:03.326624] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T18:36:03.392070] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T18:36:03.454345] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-30T18:36:04.254389] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-30T18:36:04.372312] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T18:36:05.054351] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-30T18:36:05.171715] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T18:36:05.761132] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T18:36:05.854373] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-30T18:36:06.594884] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:36:06.654387] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-30T18:36:07.454351] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-30T18:36:07.576804] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T18:36:08.224738] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T18:36:08.254362] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-30T18:36:09.054403] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-30T18:36:09.123441] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:36:09.854375] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-30T18:36:09.941147] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T18:36:10.529410] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T18:36:10.654414] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-30T18:36:11.175113] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:36:11.454380] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-30T18:36:12.203517] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T18:36:12.254329] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-30T18:36:13.054366] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-30T18:36:13.151886] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T18:36:13.854383] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-30T18:36:14.252304] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-30T18:36:14.263230] [INFO ] [REMOTE ] EPRT: Full fetch complete (68708 records). [2025-09-30T18:36:14.263425] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-30T18:36:14.656591] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-30T18:36:14.721244] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-30T18:36:14.721500] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-30T18:36:14.722618] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-30T18:36:14.723056] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-30T18:36:14.725405] [DEBUG] [LOCAL ] EPRT: Trimmed 68708 records to 48479 (keeping 200 days of data) [2025-09-30T18:36:14.903633] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-30T18:36:15.133629] [DEBUG] [LOCAL ] EPRT: Primary data saved (48479 records). [2025-09-30T18:36:15.133822] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-30T18:36:15.133932] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EPRT took 37.8s. Estimated remaining: 3h 25m 5s. Rate: 7.9 symbols/min [2025-09-30T18:36:15.454411] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-30T18:36:15.667890] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T18:36:16.254415] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-30T18:36:16.510567] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T18:36:17.054345] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-30T18:36:17.111785] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T18:36:17.854417] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-30T18:36:18.051680] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T18:36:18.440325] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T18:36:18.654378] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-30T18:36:19.316602] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T18:36:19.454395] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-30T18:36:20.254464] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-30T18:36:20.447847] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:36:21.054380] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-30T18:36:21.220178] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T18:36:21.854369] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-30T18:36:22.029009] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T18:36:22.492587] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T18:36:22.654388] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-30T18:36:23.239894] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T18:36:23.454408] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-30T18:36:24.254382] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-30T18:36:24.336116] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T18:36:25.054339] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-30T18:36:25.541284] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-30T18:36:25.854346] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-30T18:36:26.086053] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T18:36:26.099110] [INFO ] [REMOTE ] EQH: Full fetch complete (76360 records). [2025-09-30T18:36:26.099306] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-30T18:36:26.514685] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-30T18:36:26.514784] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-30T18:36:26.515840] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-30T18:36:26.515911] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-30T18:36:26.518514] [DEBUG] [LOCAL ] EQH: Trimmed 76360 records to 52651 (keeping 200 days of data) [2025-09-30T18:36:26.874328] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T18:36:26.888974] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-30T18:36:26.900262] [DEBUG] [LOCAL ] EQH: Primary data saved (52651 records). [2025-09-30T18:36:26.900411] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-30T18:36:26.900492] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 28.1s. Estimated remaining: 3h 25m 7s. Rate: 7.9 symbols/min [2025-09-30T18:36:27.319251] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T18:36:27.454376] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-30T18:36:28.711115] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T18:36:28.723592] [INFO ] [REMOTE ] EQR: Full fetch complete (73944 records). [2025-09-30T18:36:28.723885] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-30T18:36:29.160149] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-30T18:36:29.160365] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-30T18:36:29.161554] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-30T18:36:29.161640] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-30T18:36:29.163437] [DEBUG] [LOCAL ] EQR: Trimmed 73944 records to 51489 (keeping 200 days of data) [2025-09-30T18:36:29.437341] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:36:29.451796] [INFO ] [REMOTE ] EQNR: Full fetch complete (76797 records). [2025-09-30T18:36:29.454142] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-30T18:36:29.927008] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-30T18:36:29.927626] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-30T18:36:29.928771] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-30T18:36:29.929254] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-30T18:36:29.977947] [DEBUG] [LOCAL ] EQNR: Trimmed 76797 records to 53023 (keeping 200 days of data) [2025-09-30T18:36:30.129273] [DEBUG] [LOCAL ] EQR: Primary data saved (51489 records). [2025-09-30T18:36:30.130216] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-30T18:36:30.130600] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQR took 29.6s. Estimated remaining: 3h 24m 50s. Rate: 7.9 symbols/min [2025-09-30T18:36:30.377708] [DEBUG] [LOCAL ] EQNR: Primary data saved (53023 records). [2025-09-30T18:36:30.377867] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-30T18:36:30.377974] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQNR took 30.6s. Estimated remaining: 3h 24m 26s. Rate: 7.9 symbols/min [2025-09-30T18:36:31.057198] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:31.164402] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:31.180331] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:31.199338] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-30T18:36:31.199493] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-30T18:36:31.200792] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-30T18:36:31.201143] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-30T18:36:31.200698] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:31.201316] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-30T18:36:31.201627] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-30T18:36:31.293208] [DEBUG] [LOCAL ] EQV: Loaded 2742 existing records from primary storage. [2025-09-30T18:36:31.325752] [INFO ] [MAIN ] EQV: Loaded 2742 existing records. [2025-09-30T18:36:31.692074] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-30T18:36:31.750608] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-09-30T18:36:31.877268] [DEBUG] [LOCAL ] ERJ: Loaded 50678 existing records from primary storage. [2025-09-30T18:36:31.947742] [INFO ] [MAIN ] ERJ: Loaded 50678 existing records. [2025-09-30T18:36:31.990849] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:31.996421] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-30T18:36:31.987624] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:32.040200] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-30T18:36:32.059459] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-30T18:36:32.133037] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-30T18:36:32.192253] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-30T18:36:32.241021] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:32.294808] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-30T18:36:32.339218] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-30T18:36:32.398753] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:32.426064] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-30T18:36:32.433846] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-30T18:36:32.437721] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-30T18:36:32.437933] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-30T18:36:32.507874] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-30T18:36:32.637704] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-30T18:36:32.814833] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T18:36:32.942010] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-30T18:36:33.108388] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:33.149115] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-30T18:36:33.501025] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:33.529969] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-30T18:36:33.529714] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T18:36:33.622059] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-30T18:36:33.620944] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:33.623246] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-30T18:36:33.955820] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T18:36:33.956968] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-30T18:36:34.162874] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T18:36:34.164923] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-30T18:36:34.296095] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T18:36:34.654343] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-30T18:36:34.941057] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T18:36:34.981186] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-30T18:36:35.151915] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T18:36:35.454375] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-30T18:36:35.686536] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-30T18:36:36.254353] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-30T18:36:36.772464] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:36:37.054401] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-30T18:36:37.474253] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T18:36:37.854335] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-30T18:36:38.008488] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T18:36:38.390478] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-30T18:36:38.654390] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-30T18:36:39.454398] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-30T18:36:39.921754] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-30T18:36:40.100354] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T18:36:40.254408] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-30T18:36:40.602977] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-30T18:36:41.054404] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-30T18:36:41.542973] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T18:36:41.854485] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-30T18:36:42.217345] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-30T18:36:42.654388] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-30T18:36:43.454407] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-30T18:36:44.254314] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-30T18:36:44.594597] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-30T18:36:44.925878] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T18:36:45.054332] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-30T18:36:45.255865] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T18:36:45.854384] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-30T18:36:46.332983] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-30T18:36:46.654358] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-30T18:36:47.020055] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T18:36:47.205167] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-30T18:36:47.454369] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-30T18:36:48.254379] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-30T18:36:48.821355] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-30T18:36:48.822604] [INFO ] [REMOTE ] EQV: Full fetch complete (5775 records). [2025-09-30T18:36:48.822711] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-30T18:36:49.061145] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-30T18:36:49.242752] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-30T18:36:49.243059] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-30T18:36:49.243363] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-30T18:36:49.243467] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-30T18:36:49.244830] [DEBUG] [LOCAL ] EQV: Trimmed 5775 records to 2737 (keeping 200 days of data) [2025-09-30T18:36:49.288125] [DEBUG] [LOCAL ] EQV: Primary data saved (2737 records). [2025-09-30T18:36:49.304379] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-30T18:36:49.304588] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQV took 18.9s. Estimated remaining: 3h 24m 43s. Rate: 7.9 symbols/min [2025-09-30T18:36:49.343444] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-30T18:36:49.523313] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:49.565505] [DEBUG] [LOCAL ] ERO: Loaded 41225 existing records from primary storage. [2025-09-30T18:36:49.565880] [INFO ] [MAIN ] ERO: Loaded 41225 existing records. [2025-09-30T18:36:49.753629] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:49.753830] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-30T18:36:49.753878] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-30T18:36:49.754284] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-30T18:36:49.754344] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-30T18:36:49.862185] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-30T18:36:50.135768] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:50.654375] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-30T18:36:51.061409] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-30T18:36:51.177399] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-30T18:36:51.305410] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T18:36:51.454391] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-30T18:36:51.848983] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-30T18:36:52.254375] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-30T18:36:53.054358] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-30T18:36:53.603690] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T18:36:53.854347] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-30T18:36:54.654441] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-30T18:36:54.766069] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T18:36:55.331921] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T18:36:55.333432] [INFO ] [REMOTE ] EQS: Full fetch complete (2536 records). [2025-09-30T18:36:55.333521] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-30T18:36:55.459538] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-30T18:36:55.536754] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-30T18:36:55.537861] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:36:55.538072] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:36:55.538262] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-30T18:36:55.538348] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-30T18:36:55.538389] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-30T18:36:55.538446] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-30T18:36:55.538550] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. EQS took 25.2s. Estimated remaining: 3h 24m 32s. Rate: 7.9 symbols/min [2025-09-30T18:36:55.733530] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:36:55.768472] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T18:36:55.835541] [DEBUG] [LOCAL ] ES: Loaded 52538 existing records from primary storage. [2025-09-30T18:36:55.836025] [INFO ] [MAIN ] ES: Loaded 52538 existing records. [2025-09-30T18:36:56.035194] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:36:56.035452] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-30T18:36:56.035505] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-30T18:36:56.036074] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-30T18:36:56.036137] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-30T18:36:56.263567] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-30T18:36:56.438990] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:36:57.054376] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-30T18:36:57.478103] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-30T18:36:57.513093] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:36:57.854370] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-30T18:36:58.654371] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-30T18:36:58.739736] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T18:36:59.454375] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-30T18:36:59.810337] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T18:37:00.156434] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T18:37:00.254400] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-30T18:37:01.054400] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-30T18:37:01.350348] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-30T18:37:01.854336] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-30T18:37:01.962910] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T18:37:02.654363] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-30T18:37:02.977492] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-30T18:37:02.987773] [INFO ] [REMOTE ] ERJ: Full fetch complete (71955 records). [2025-09-30T18:37:02.987919] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-30T18:37:02.989258] [FATAL] [VALIDATOR ] ERJ: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:37:02.989390] [FATAL] [MAIN ] ERJ: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:37:02.989462] [WARN ] [MAIN ] ERJ: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:37:02.989538] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-30T18:37:02.989621] [DEBUG] [LOCAL ] ERJ: No primary data file found to delete. [2025-09-30T18:37:02.989704] [INFO ] [LOCAL ] ERJ: Starting deletion of derivative data. [2025-09-30T18:37:02.989961] [DEBUG] [LOCAL ] ERJ: Deleted derivative data file. [2025-09-30T18:37:02.990071] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. ERJ took 32.6s. Estimated remaining: 3h 24m 24s. Rate: 7.9 symbols/min [2025-09-30T18:37:03.183572] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:03.212930] [DEBUG] [LOCAL ] ESAB: Loaded 26158 existing records from primary storage. [2025-09-30T18:37:03.213215] [INFO ] [MAIN ] ESAB: Loaded 26158 existing records. [2025-09-30T18:37:03.416935] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:03.417160] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-30T18:37:03.417209] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-30T18:37:03.417469] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-30T18:37:03.417530] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-30T18:37:03.461452] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-30T18:37:03.839089] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:03.882832] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-30T18:37:04.184681] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T18:37:04.254353] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-30T18:37:05.054387] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-30T18:37:05.189153] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T18:37:05.854356] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-30T18:37:05.967504] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T18:37:06.194951] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T18:37:06.654406] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-30T18:37:07.454392] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-30T18:37:07.717751] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T18:37:08.128031] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T18:37:08.150096] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T18:37:08.254380] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-30T18:37:09.054339] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-30T18:37:09.100492] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T18:37:09.854373] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-30T18:37:10.654376] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-30T18:37:10.935622] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-30T18:37:11.250102] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T18:37:11.454370] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-30T18:37:12.254416] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-30T18:37:12.641027] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T18:37:13.054346] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-30T18:37:13.210534] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T18:37:13.854381] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-30T18:37:14.032165] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T18:37:14.654331] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-30T18:37:14.803625] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T18:37:15.201662] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T18:37:15.213506] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-09-30T18:37:15.213693] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-30T18:37:15.461495] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-30T18:37:15.653869] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-30T18:37:15.653970] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-30T18:37:15.654998] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-30T18:37:15.655068] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-30T18:37:15.656809] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 53682 (keeping 200 days of data) [2025-09-30T18:37:16.003812] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T18:37:16.033594] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-09-30T18:37:16.033759] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-30T18:37:16.033897] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. EQT took 45.7s. Estimated remaining: 3h 24m 28s. Rate: 7.9 symbols/min [2025-09-30T18:37:16.217133] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:16.237924] [DEBUG] [LOCAL ] ESE: Loaded 16687 existing records from primary storage. [2025-09-30T18:37:16.238226] [INFO ] [MAIN ] ESE: Loaded 16687 existing records. [2025-09-30T18:37:16.261270] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-30T18:37:16.443701] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:16.443932] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-30T18:37:16.443980] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-30T18:37:16.444232] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-30T18:37:16.444292] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-30T18:37:16.825203] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:17.054329] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-30T18:37:17.508144] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-30T18:37:17.854390] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-30T18:37:18.244780] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T18:37:18.255089] [INFO ] [REMOTE ] ERO: Full fetch complete (59475 records). [2025-09-30T18:37:18.255230] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-30T18:37:18.648883] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T18:37:18.676577] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-30T18:37:18.708556] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-30T18:37:18.709507] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-30T18:37:18.710342] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-30T18:37:18.710470] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-30T18:37:18.711907] [DEBUG] [LOCAL ] ERO: Trimmed 59475 records to 41233 (keeping 200 days of data) [2025-09-30T18:37:18.977119] [DEBUG] [LOCAL ] ERO: Primary data saved (41233 records). [2025-09-30T18:37:18.977484] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-30T18:37:18.979071] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ERO took 29.7s. Estimated remaining: 3h 24m 10s. Rate: 7.9 symbols/min [2025-09-30T18:37:19.172313] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:19.238018] [DEBUG] [LOCAL ] ESI: Loaded 50777 existing records from primary storage. [2025-09-30T18:37:19.238461] [INFO ] [MAIN ] ESI: Loaded 50777 existing records. [2025-09-30T18:37:19.436512] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:19.436914] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-30T18:37:19.437013] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-30T18:37:19.437748] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-30T18:37:19.437971] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-30T18:37:19.461361] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-30T18:37:19.772719] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T18:37:19.775128] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T18:37:19.947770] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:20.254356] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-30T18:37:20.700420] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T18:37:21.054366] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-30T18:37:21.854375] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-30T18:37:22.096453] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T18:37:22.150892] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T18:37:22.654361] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-30T18:37:22.753360] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T18:37:23.454357] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-30T18:37:24.255974] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-30T18:37:24.259063] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T18:37:24.488671] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T18:37:25.054362] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-30T18:37:25.854408] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-30T18:37:26.152435] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T18:37:26.166433] [INFO ] [REMOTE ] ES: Full fetch complete (76180 records). [2025-09-30T18:37:26.166599] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-30T18:37:26.323879] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T18:37:26.591941] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-30T18:37:26.592029] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-30T18:37:26.592947] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-30T18:37:26.593012] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-30T18:37:26.594555] [DEBUG] [LOCAL ] ES: Trimmed 76180 records to 52556 (keeping 200 days of data) [2025-09-30T18:37:26.659912] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-30T18:37:26.951860] [DEBUG] [LOCAL ] ES: Primary data saved (52556 records). [2025-09-30T18:37:26.952007] [INFO ] [MAIN ] ES: Full history saved. [2025-09-30T18:37:26.952093] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ES took 31.4s. Estimated remaining: 3h 24m 4s. Rate: 7.9 symbols/min [2025-09-30T18:37:27.150607] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:27.185044] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T18:37:27.230438] [DEBUG] [LOCAL ] ESNT: Loaded 38376 existing records from primary storage. [2025-09-30T18:37:27.230803] [INFO ] [MAIN ] ESNT: Loaded 38376 existing records. [2025-09-30T18:37:27.433667] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:27.433873] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-30T18:37:27.433944] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-30T18:37:27.434240] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-30T18:37:27.434299] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-30T18:37:27.459497] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-30T18:37:27.780605] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T18:37:27.860199] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:28.254374] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-30T18:37:28.621604] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T18:37:29.054390] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-30T18:37:29.607560] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T18:37:29.798379] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T18:37:29.854357] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-30T18:37:30.613772] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T18:37:30.654382] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-30T18:37:31.454366] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-30T18:37:32.160187] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T18:37:32.254347] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-30T18:37:32.434421] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T18:37:33.054372] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-30T18:37:33.734457] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T18:37:33.854363] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-30T18:37:34.083317] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T18:37:34.654365] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-30T18:37:35.255262] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T18:37:35.454348] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-30T18:37:35.658487] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T18:37:36.254397] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-30T18:37:37.054357] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-30T18:37:37.344334] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-30T18:37:37.575430] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T18:37:37.806002] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-30T18:37:37.810620] [INFO ] [REMOTE ] ESE: Full fetch complete (22286 records). [2025-09-30T18:37:37.810815] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-30T18:37:37.859597] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-30T18:37:38.248065] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-30T18:37:38.248256] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-30T18:37:38.248833] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-30T18:37:38.248899] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-30T18:37:38.249699] [DEBUG] [LOCAL ] ESE: Trimmed 22286 records to 16678 (keeping 200 days of data) [2025-09-30T18:37:38.362145] [DEBUG] [LOCAL ] ESE: Primary data saved (16678 records). [2025-09-30T18:37:38.362296] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-30T18:37:38.362434] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ESE took 22.3s. Estimated remaining: 3h 24m 4s. Rate: 7.9 symbols/min [2025-09-30T18:37:38.554578] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:38.604494] [DEBUG] [LOCAL ] ESRT: Loaded 46398 existing records from primary storage. [2025-09-30T18:37:38.604905] [INFO ] [MAIN ] ESRT: Loaded 46398 existing records. [2025-09-30T18:37:38.664153] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-30T18:37:38.810285] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:38.810559] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-30T18:37:38.810619] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-30T18:37:38.811001] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-30T18:37:38.811080] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-30T18:37:39.217538] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:39.454341] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-30T18:37:39.492053] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:37:40.254325] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-30T18:37:40.367150] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T18:37:41.034214] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T18:37:41.054310] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-30T18:37:41.455610] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T18:37:41.854364] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-30T18:37:42.570694] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T18:37:42.654399] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-30T18:37:43.337448] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T18:37:43.344330] [INFO ] [REMOTE ] ESAB: Full fetch complete (35780 records). [2025-09-30T18:37:43.344457] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-30T18:37:43.459445] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-30T18:37:43.769520] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-30T18:37:43.769709] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-30T18:37:43.770447] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-30T18:37:43.770536] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-30T18:37:43.795636] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T18:37:43.804215] [DEBUG] [LOCAL ] ESAB: Trimmed 35780 records to 26186 (keeping 200 days of data) [2025-09-30T18:37:43.987790] [DEBUG] [LOCAL ] ESAB: Primary data saved (26186 records). [2025-09-30T18:37:43.987942] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-30T18:37:43.988055] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESAB took 41.0s. Estimated remaining: 3h 23m 52s. Rate: 7.9 symbols/min [2025-09-30T18:37:44.166730] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:44.200292] [DEBUG] [LOCAL ] ESS: Loaded 30019 existing records from primary storage. [2025-09-30T18:37:44.200590] [INFO ] [MAIN ] ESS: Loaded 30019 existing records. [2025-09-30T18:37:44.265733] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-30T18:37:44.393874] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:44.394133] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-30T18:37:44.394207] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-30T18:37:44.394468] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-30T18:37:44.394528] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-30T18:37:44.774828] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:44.925000] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T18:37:45.054374] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-30T18:37:45.694149] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T18:37:45.854365] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-30T18:37:46.641398] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:37:46.654311] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-30T18:37:47.379696] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T18:37:47.454376] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-30T18:37:47.839833] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T18:37:48.254403] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-30T18:37:48.930385] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T18:37:49.054379] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-30T18:37:49.797620] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:37:49.854366] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-30T18:37:50.420015] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T18:37:50.654402] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-30T18:37:51.270759] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T18:37:51.454420] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-30T18:37:52.254447] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-30T18:37:52.384454] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T18:37:53.054395] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-30T18:37:53.104512] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T18:37:53.744588] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T18:37:53.752962] [INFO ] [REMOTE ] ESNT: Full fetch complete (57108 records). [2025-09-30T18:37:53.753158] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-30T18:37:53.859554] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-30T18:37:54.178683] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-30T18:37:54.178836] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-30T18:37:54.179592] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-30T18:37:54.179673] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-30T18:37:54.180995] [DEBUG] [LOCAL ] ESNT: Trimmed 57108 records to 38357 (keeping 200 days of data) [2025-09-30T18:37:54.433437] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:37:54.460787] [DEBUG] [LOCAL ] ESNT: Primary data saved (38357 records). [2025-09-30T18:37:54.460956] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-30T18:37:54.461051] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESNT took 27.5s. Estimated remaining: 3h 23m 50s. Rate: 7.9 symbols/min [2025-09-30T18:37:54.647263] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:54.654359] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-30T18:37:54.696000] [DEBUG] [LOCAL ] ESTC: Loaded 49961 existing records from primary storage. [2025-09-30T18:37:54.696506] [INFO ] [MAIN ] ESTC: Loaded 49961 existing records. [2025-09-30T18:37:54.881847] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:37:54.882116] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-30T18:37:54.882173] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-30T18:37:54.882605] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-30T18:37:54.882720] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-30T18:37:55.270887] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:37:55.454353] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-30T18:37:55.686901] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T18:37:56.187418] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:37:56.254351] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-30T18:37:57.054356] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-30T18:37:57.326203] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T18:37:57.627010] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T18:37:57.854394] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-30T18:37:58.654390] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-30T18:37:58.878179] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T18:37:58.890495] [INFO ] [REMOTE ] ESRT: Full fetch complete (66500 records). [2025-09-30T18:37:58.890714] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-30T18:37:59.330476] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-30T18:37:59.330668] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-30T18:37:59.331727] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-30T18:37:59.331867] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-30T18:37:59.333738] [DEBUG] [LOCAL ] ESRT: Trimmed 66500 records to 46441 (keeping 200 days of data) [2025-09-30T18:37:59.455333] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-30T18:37:59.624511] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T18:37:59.706265] [DEBUG] [LOCAL ] ESRT: Primary data saved (46441 records). [2025-09-30T18:37:59.706414] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-30T18:37:59.706516] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESRT took 21.3s. Estimated remaining: 3h 23m 38s. Rate: 7.9 symbols/min [2025-09-30T18:37:59.899445] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:37:59.957504] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-09-30T18:37:59.957865] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-09-30T18:38:00.151615] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:00.151957] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-30T18:38:00.157997] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-30T18:38:00.169433] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:38:00.175568] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-30T18:38:00.176280] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-30T18:38:00.259447] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-30T18:38:00.579397] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:00.860789] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T18:38:01.054378] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-30T18:38:01.854432] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-30T18:38:01.986774] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T18:38:02.654327] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-30T18:38:02.918343] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T18:38:02.929589] [INFO ] [REMOTE ] ESI: Full fetch complete (72574 records). [2025-09-30T18:38:02.929769] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-30T18:38:03.345217] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-30T18:38:03.345341] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-30T18:38:03.346461] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-30T18:38:03.346540] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-30T18:38:03.348586] [DEBUG] [LOCAL ] ESI: Trimmed 72574 records to 50750 (keeping 200 days of data) [2025-09-30T18:38:03.454714] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-30T18:38:03.633293] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T18:38:03.735948] [DEBUG] [LOCAL ] ESI: Primary data saved (50750 records). [2025-09-30T18:38:03.736155] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-30T18:38:03.736859] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESI took 44.8s. Estimated remaining: 3h 23m 23s. Rate: 7.9 symbols/min [2025-09-30T18:38:03.922908] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:38:03.940933] [DEBUG] [LOCAL ] ETB: Loaded 12084 existing records from primary storage. [2025-09-30T18:38:03.941188] [INFO ] [MAIN ] ETB: Loaded 12084 existing records. [2025-09-30T18:38:04.133033] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:04.133458] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-30T18:38:04.133557] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-30T18:38:04.134115] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-30T18:38:04.134235] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-30T18:38:04.257552] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-30T18:38:04.305031] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-30T18:38:04.599966] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:05.051765] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T18:38:05.060434] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-30T18:38:05.236795] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T18:38:05.854368] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-30T18:38:06.654415] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-30T18:38:07.290600] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-30T18:38:07.454325] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-30T18:38:07.581539] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T18:38:07.806581] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-30T18:38:08.254411] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-30T18:38:09.054415] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-30T18:38:09.802388] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-30T18:38:09.854344] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-30T18:38:09.966369] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T18:38:10.157206] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T18:38:10.654399] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-30T18:38:11.454320] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-30T18:38:12.006294] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-30T18:38:12.222405] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T18:38:12.254323] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-30T18:38:12.514860] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T18:38:13.054425] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-30T18:38:13.460780] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T18:38:13.854398] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-30T18:38:14.654384] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-30T18:38:14.871903] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T18:38:15.183352] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-30T18:38:15.454408] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-30T18:38:16.254333] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-30T18:38:16.349702] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:38:16.409215] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T18:38:17.054410] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-30T18:38:17.854360] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-30T18:38:18.132342] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T18:38:18.546730] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-30T18:38:18.654373] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-30T18:38:19.190069] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T18:38:19.196175] [INFO ] [REMOTE ] ESS: Full fetch complete (43194 records). [2025-09-30T18:38:19.196275] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-30T18:38:19.197076] [FATAL] [VALIDATOR ] ESS: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:38:19.197190] [FATAL] [MAIN ] ESS: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:38:19.197265] [WARN ] [MAIN ] ESS: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:38:19.197361] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-30T18:38:19.197467] [DEBUG] [LOCAL ] ESS: No primary data file found to delete. [2025-09-30T18:38:19.197544] [INFO ] [LOCAL ] ESS: Starting deletion of derivative data. [2025-09-30T18:38:19.197912] [DEBUG] [LOCAL ] ESS: Deleted derivative data file. [2025-09-30T18:38:19.198046] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESS took 35.2s. Estimated remaining: 3h 23m 31s. Rate: 7.9 symbols/min [2025-09-30T18:38:19.385483] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:38:19.413954] [DEBUG] [LOCAL ] ETD: Loaded 27396 existing records from primary storage. [2025-09-30T18:38:19.414265] [INFO ] [MAIN ] ETD: Loaded 27396 existing records. [2025-09-30T18:38:19.460837] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-30T18:38:19.617888] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:19.618091] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-30T18:38:19.618139] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-30T18:38:19.618411] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-30T18:38:19.618474] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-30T18:38:20.002798] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:20.254377] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-30T18:38:20.897067] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-30T18:38:21.054326] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-30T18:38:21.452903] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-30T18:38:21.471591] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:38:21.854371] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-30T18:38:22.654622] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-30T18:38:22.656359] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T18:38:23.454325] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-30T18:38:23.523763] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-30T18:38:23.557265] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T18:38:24.238097] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T18:38:24.254312] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-30T18:38:24.914215] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T18:38:25.054364] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-30T18:38:25.854383] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-30T18:38:26.654365] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-30T18:38:26.764139] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T18:38:26.856634] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T18:38:27.454364] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-30T18:38:28.254330] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-30T18:38:28.371136] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-30T18:38:28.641175] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T18:38:29.054322] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-30T18:38:29.407514] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T18:38:29.854365] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-30T18:38:30.654329] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-30T18:38:30.721523] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T18:38:30.724753] [INFO ] [REMOTE ] ETB: Full fetch complete (18036 records). [2025-09-30T18:38:30.724852] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-30T18:38:31.117595] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-30T18:38:31.127615] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-30T18:38:31.147822] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-30T18:38:31.148101] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-30T18:38:31.150322] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T18:38:31.162988] [DEBUG] [LOCAL ] ETB: Trimmed 18036 records to 12062 (keeping 200 days of data) [2025-09-30T18:38:31.163253] [INFO ] [REMOTE ] ESTC: Full fetch complete (71985 records). [2025-09-30T18:38:31.163702] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-30T18:38:31.461681] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-30T18:38:31.686848] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-30T18:38:31.687470] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-30T18:38:31.689396] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-30T18:38:31.689751] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-30T18:38:31.693307] [DEBUG] [LOCAL ] ESTC: Trimmed 71985 records to 49963 (keeping 200 days of data) [2025-09-30T18:38:31.699431] [DEBUG] [LOCAL ] ETB: Primary data saved (12062 records). [2025-09-30T18:38:31.699591] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-30T18:38:31.699726] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ETB took 28.0s. Estimated remaining: 3h 23m 34s. Rate: 7.9 symbols/min [2025-09-30T18:38:32.001973] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:38:32.029188] [DEBUG] [LOCAL ] ETG: Loaded 16477 existing records from primary storage. [2025-09-30T18:38:32.032331] [INFO ] [MAIN ] ETG: Loaded 16477 existing records. [2025-09-30T18:38:32.322465] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:32.331585] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-30T18:38:32.331703] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-30T18:38:32.333461] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-30T18:38:32.334506] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-30T18:38:32.869478] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:32.870932] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-30T18:38:32.918437] [DEBUG] [LOCAL ] ESTC: Primary data saved (49963 records). [2025-09-30T18:38:32.918689] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-30T18:38:32.921019] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-30T18:38:32.919672] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ESTC took 38.5s. Estimated remaining: 3h 23m 13s. Rate: 7.9 symbols/min [2025-09-30T18:38:32.975822] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-09-30T18:38:33.034983] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-30T18:38:33.208781] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:38:33.226270] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:38:33.282219] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-30T18:38:33.481980] [DEBUG] [LOCAL ] ETJ: Loaded 16684 existing records from primary storage. [2025-09-30T18:38:33.522804] [INFO ] [MAIN ] ETJ: Loaded 16684 existing records. [2025-09-30T18:38:33.816727] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-30T18:38:33.837857] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-30T18:38:33.866152] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:33.867824] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-30T18:38:33.867930] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-30T18:38:33.868057] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-30T18:38:33.868318] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-30T18:38:33.868542] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-30T18:38:33.868602] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-30T18:38:33.985227] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 53789 (keeping 200 days of data) [2025-09-30T18:38:34.314839] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T18:38:34.363730] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-30T18:38:34.399855] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:34.655180] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T18:38:34.655298] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-30T18:38:34.691094] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-09-30T18:38:34.691293] [INFO ] [MAIN ] ET: Full history saved. [2025-09-30T18:38:34.691389] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ET took 35.0s. Estimated remaining: 3h 22m 53s. Rate: 7.9 symbols/min [2025-09-30T18:38:34.878805] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:38:34.932499] [DEBUG] [LOCAL ] ETN: Loaded 52799 existing records from primary storage. [2025-09-30T18:38:34.932880] [INFO ] [MAIN ] ETN: Loaded 52799 existing records. [2025-09-30T18:38:35.133351] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:35.133859] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-30T18:38:35.134184] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-30T18:38:35.135861] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-30T18:38:35.135938] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-30T18:38:35.305514] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T18:38:35.462736] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-30T18:38:35.593252] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:35.773875] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T18:38:36.254318] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-30T18:38:36.425116] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T18:38:37.054373] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-30T18:38:37.854325] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-30T18:38:38.045080] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T18:38:38.264794] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T18:38:38.654418] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-30T18:38:38.841259] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T18:38:39.454390] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-30T18:38:40.254391] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-30T18:38:40.450595] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T18:38:40.726264] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-30T18:38:41.054375] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-30T18:38:41.417074] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:38:41.854373] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-30T18:38:42.085807] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T18:38:42.654385] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-30T18:38:43.454444] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-30T18:38:43.715959] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T18:38:43.758904] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-30T18:38:44.254429] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-30T18:38:44.542518] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T18:38:44.552082] [INFO ] [REMOTE ] ETD: Full fetch complete (38269 records). [2025-09-30T18:38:44.552263] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-30T18:38:45.000565] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-30T18:38:45.000687] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-30T18:38:45.001304] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-30T18:38:45.001351] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-30T18:38:45.002357] [DEBUG] [LOCAL ] ETD: Trimmed 38269 records to 27384 (keeping 200 days of data) [2025-09-30T18:38:45.059620] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-30T18:38:45.190018] [DEBUG] [LOCAL ] ETD: Primary data saved (27384 records). [2025-09-30T18:38:45.190189] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-30T18:38:45.190339] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ETD took 26.0s. Estimated remaining: 3h 22m 51s. Rate: 7.9 symbols/min [2025-09-30T18:38:45.386196] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:38:45.400483] [DEBUG] [LOCAL ] ETO: Loaded 6496 existing records from primary storage. [2025-09-30T18:38:45.400798] [INFO ] [MAIN ] ETO: Loaded 6496 existing records. [2025-09-30T18:38:45.608057] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:38:45.608407] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-30T18:38:45.608483] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-30T18:38:45.608742] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-30T18:38:45.608836] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-30T18:38:45.880342] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-30T18:38:46.024231] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:38:46.295622] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-30T18:38:46.323978] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-30T18:38:46.654409] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-30T18:38:47.160770] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T18:38:47.454354] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-30T18:38:48.254350] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-30T18:38:48.455461] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T18:38:48.598534] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T18:38:48.981002] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T18:38:49.054387] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-30T18:38:49.686628] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T18:38:49.854395] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-30T18:38:50.654397] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-30T18:38:50.851100] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T18:38:51.454363] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-30T18:38:51.511818] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-30T18:38:52.254373] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-30T18:38:53.054366] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-30T18:38:53.116293] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T18:38:53.303527] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T18:38:53.654590] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T18:38:53.854373] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-30T18:38:54.581760] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T18:38:54.654359] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-30T18:38:55.345496] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-30T18:38:55.454380] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-30T18:38:56.254375] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-30T18:38:56.283393] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T18:38:56.925834] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T18:38:57.054359] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-30T18:38:57.854375] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-30T18:38:58.434110] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T18:38:58.654355] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-30T18:38:58.881085] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-30T18:38:59.454392] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-30T18:39:00.254382] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-30T18:39:00.559554] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-30T18:39:00.609602] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T18:39:00.614332] [INFO ] [REMOTE ] ETJ: Full fetch complete (25308 records). [2025-09-30T18:39:00.614467] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-30T18:39:01.054476] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-30T18:39:01.070300] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-30T18:39:01.070410] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-30T18:39:01.082938] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-30T18:39:01.083029] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-30T18:39:01.085670] [DEBUG] [LOCAL ] ETJ: Trimmed 25308 records to 16740 (keeping 200 days of data) [2025-09-30T18:39:01.084872] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T18:39:01.197881] [DEBUG] [LOCAL ] ETJ: Primary data saved (16740 records). [2025-09-30T18:39:01.198039] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-30T18:39:01.198129] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETJ took 28.3s. Estimated remaining: 3h 23m 1s. Rate: 7.9 symbols/min [2025-09-30T18:39:01.382380] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:01.434055] [DEBUG] [LOCAL ] ETR: Loaded 53220 existing records from primary storage. [2025-09-30T18:39:01.434407] [INFO ] [MAIN ] ETR: Loaded 53220 existing records. [2025-09-30T18:39:01.628957] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:39:01.629230] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-30T18:39:01.629316] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-30T18:39:01.629975] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-30T18:39:01.630067] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-30T18:39:01.859574] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-30T18:39:02.065509] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:02.654370] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-30T18:39:02.851370] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T18:39:03.215142] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-30T18:39:03.362464] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T18:39:03.454370] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-30T18:39:04.254402] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-30T18:39:05.054332] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-30T18:39:05.344015] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T18:39:05.364618] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T18:39:05.368468] [INFO ] [REMOTE ] ETG: Full fetch complete (24770 records). [2025-09-30T18:39:05.368596] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-30T18:39:05.765944] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-30T18:39:05.766038] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-30T18:39:05.766587] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-30T18:39:05.766630] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-30T18:39:05.767447] [DEBUG] [LOCAL ] ETG: Trimmed 24770 records to 16446 (keeping 200 days of data) [2025-09-30T18:39:05.824619] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T18:39:05.854502] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-30T18:39:05.888308] [DEBUG] [LOCAL ] ETG: Primary data saved (16446 records). [2025-09-30T18:39:05.888493] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-30T18:39:05.888679] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETG took 34.2s. Estimated remaining: 3h 22m 47s. Rate: 7.9 symbols/min [2025-09-30T18:39:06.067208] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:06.091930] [DEBUG] [LOCAL ] ETV: Loaded 21450 existing records from primary storage. [2025-09-30T18:39:06.092211] [INFO ] [MAIN ] ETV: Loaded 21450 existing records. [2025-09-30T18:39:06.283518] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:39:06.283790] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-30T18:39:06.283848] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-30T18:39:06.284115] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-30T18:39:06.284174] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-30T18:39:06.661141] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-30T18:39:06.687261] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:07.454354] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-30T18:39:07.608561] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T18:39:08.060874] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T18:39:08.254357] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-30T18:39:08.790551] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-30T18:39:09.054401] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-30T18:39:09.654684] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T18:39:09.757140] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T18:39:09.759028] [INFO ] [REMOTE ] ETO: Full fetch complete (9330 records). [2025-09-30T18:39:09.759101] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-30T18:39:09.863564] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-30T18:39:10.148740] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-30T18:39:10.148830] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-30T18:39:10.149087] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-30T18:39:10.149138] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-30T18:39:10.149722] [DEBUG] [LOCAL ] ETO: Trimmed 9330 records to 6485 (keeping 200 days of data) [2025-09-30T18:39:10.191955] [DEBUG] [LOCAL ] ETO: Primary data saved (6485 records). [2025-09-30T18:39:10.192113] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-30T18:39:10.192207] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETO took 25.0s. Estimated remaining: 3h 22m 33s. Rate: 7.9 symbols/min [2025-09-30T18:39:10.380448] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:10.405604] [DEBUG] [LOCAL ] ETW: Loaded 25073 existing records from primary storage. [2025-09-30T18:39:10.405945] [INFO ] [MAIN ] ETW: Loaded 25073 existing records. [2025-09-30T18:39:10.603544] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:39:10.603844] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-30T18:39:10.603905] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-30T18:39:10.604204] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-30T18:39:10.604279] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-30T18:39:10.661832] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-30T18:39:10.983199] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:11.454425] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-30T18:39:11.925384] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-30T18:39:12.087816] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T18:39:12.254421] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-30T18:39:12.596235] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T18:39:13.054393] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-30T18:39:13.854432] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-30T18:39:14.215346] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:39:14.654349] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-30T18:39:14.775976] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-30T18:39:14.787563] [INFO ] [REMOTE ] ETN: Full fetch complete (76578 records). [2025-09-30T18:39:14.787785] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-30T18:39:15.207780] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-30T18:39:15.207870] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-30T18:39:15.208860] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-30T18:39:15.208927] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-30T18:39:15.210470] [DEBUG] [LOCAL ] ETN: Trimmed 76578 records to 52783 (keeping 200 days of data) [2025-09-30T18:39:15.454549] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-30T18:39:15.587538] [DEBUG] [LOCAL ] ETN: Primary data saved (52783 records). [2025-09-30T18:39:15.587748] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-30T18:39:15.587912] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETN took 40.9s. Estimated remaining: 3h 22m 21s. Rate: 7.9 symbols/min [2025-09-30T18:39:15.791345] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:15.811992] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:39:15.822235] [DEBUG] [LOCAL ] ETX: Loaded 5023 existing records from primary storage. [2025-09-30T18:39:15.822679] [INFO ] [MAIN ] ETX: Loaded 5023 existing records. [2025-09-30T18:39:15.990134] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-30T18:39:16.088390] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:39:16.088697] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-30T18:39:16.088760] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-30T18:39:16.089016] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-30T18:39:16.089077] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-30T18:39:16.259735] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-30T18:39:16.489604] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:16.620741] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:39:17.054388] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-30T18:39:17.804612] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:39:17.854337] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-30T18:39:17.998057] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T18:39:18.654360] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-30T18:39:19.454373] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-30T18:39:19.456578] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T18:39:19.797246] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T18:39:20.254331] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-30T18:39:20.337121] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T18:39:21.054331] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-30T18:39:21.289549] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T18:39:21.854341] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-30T18:39:22.244578] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T18:39:22.654339] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-30T18:39:22.787942] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T18:39:23.454374] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-30T18:39:24.012482] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T18:39:24.254323] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-30T18:39:24.474158] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T18:39:25.054373] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-30T18:39:25.854340] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-30T18:39:26.164135] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T18:39:26.216969] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T18:39:26.427877] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T18:39:26.654376] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-30T18:39:27.454359] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-30T18:39:27.849814] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T18:39:28.254354] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-30T18:39:28.644551] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-30T18:39:29.054368] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-30T18:39:29.198252] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T18:39:29.554225] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-30T18:39:29.854331] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-30T18:39:30.654402] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-30T18:39:31.227748] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T18:39:31.454324] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-30T18:39:31.698631] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T18:39:31.712387] [INFO ] [REMOTE ] ETR: Full fetch complete (77041 records). [2025-09-30T18:39:31.712592] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-30T18:39:32.061429] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-30T18:39:32.175611] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-30T18:39:32.175744] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-30T18:39:32.176662] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-30T18:39:32.176775] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-30T18:39:32.178605] [DEBUG] [LOCAL ] ETR: Trimmed 77041 records to 53225 (keeping 200 days of data) [2025-09-30T18:39:32.273101] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-30T18:39:32.549393] [DEBUG] [LOCAL ] ETR: Primary data saved (53225 records). [2025-09-30T18:39:32.549582] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-30T18:39:32.549807] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETR took 31.4s. Estimated remaining: 3h 22m 32s. Rate: 7.9 symbols/min [2025-09-30T18:39:32.759335] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:32.787263] [DEBUG] [LOCAL ] ETY: Loaded 22661 existing records from primary storage. [2025-09-30T18:39:32.787614] [INFO ] [MAIN ] ETY: Loaded 22661 existing records. [2025-09-30T18:39:33.040163] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:39:33.040790] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-30T18:39:33.040848] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-30T18:39:33.041070] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-30T18:39:33.041130] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-30T18:39:33.059486] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-30T18:39:33.162771] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T18:39:33.478596] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:33.854371] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-30T18:39:34.271634] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T18:39:34.654320] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-30T18:39:35.034242] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T18:39:35.229188] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T18:39:35.454352] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-30T18:39:35.906962] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T18:39:36.254425] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-30T18:39:37.054459] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-30T18:39:37.305632] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T18:39:37.702800] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T18:39:37.704605] [INFO ] [REMOTE ] ETX: Full fetch complete (7049 records). [2025-09-30T18:39:37.704749] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-30T18:39:37.859990] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-30T18:39:38.105024] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-30T18:39:38.105117] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-30T18:39:38.105331] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-30T18:39:38.105412] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-30T18:39:38.105893] [DEBUG] [LOCAL ] ETX: Trimmed 7049 records to 5053 (keeping 200 days of data) [2025-09-30T18:39:38.139727] [DEBUG] [LOCAL ] ETX: Primary data saved (5053 records). [2025-09-30T18:39:38.139870] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-30T18:39:38.140090] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETX took 22.6s. Estimated remaining: 3h 22m 20s. Rate: 7.9 symbols/min [2025-09-30T18:39:38.334419] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:38.334697] [DEBUG] [LOCAL ] EVC: No existing data file found in primary storage. [2025-09-30T18:39:38.334752] [WARN ] [MAIN ] EVC: No existing data found, performing full refresh instead. [2025-09-30T18:39:38.334869] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-30T18:39:38.334914] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-30T18:39:38.334957] [DEBUG] [LOCAL ] EVC: No primary data file found to delete. [2025-09-30T18:39:38.335016] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-30T18:39:38.654887] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-30T18:39:38.746303] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:39.456462] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-30T18:39:39.468975] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T18:39:39.853090] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T18:39:39.858445] [INFO ] [REMOTE ] ETV: Full fetch complete (31875 records). [2025-09-30T18:39:39.858582] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-30T18:39:40.261272] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-30T18:39:40.263444] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-30T18:39:40.264325] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-30T18:39:40.265072] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-30T18:39:40.265139] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-30T18:39:40.266143] [DEBUG] [LOCAL ] ETV: Trimmed 31875 records to 21445 (keeping 200 days of data) [2025-09-30T18:39:40.406790] [DEBUG] [LOCAL ] ETV: Primary data saved (21445 records). [2025-09-30T18:39:40.406937] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-30T18:39:40.407043] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETV took 34.5s. Estimated remaining: 3h 22m 2s. Rate: 7.9 symbols/min [2025-09-30T18:39:40.654524] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:40.654801] [DEBUG] [LOCAL ] EVEX: No existing data file found in primary storage. [2025-09-30T18:39:40.654859] [WARN ] [MAIN ] EVEX: No existing data found, performing full refresh instead. [2025-09-30T18:39:40.654982] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-30T18:39:40.655026] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-30T18:39:40.655071] [DEBUG] [LOCAL ] EVEX: No primary data file found to delete. [2025-09-30T18:39:40.655105] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-30T18:39:41.071573] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:41.071668] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-30T18:39:41.090845] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T18:39:41.482951] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T18:39:41.854319] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-30T18:39:42.217628] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T18:39:42.654369] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-30T18:39:43.295861] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T18:39:43.448921] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T18:39:43.454533] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-30T18:39:44.254351] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-30T18:39:44.492136] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T18:39:45.054330] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-30T18:39:45.082986] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T18:39:45.854385] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-30T18:39:46.187896] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T18:39:46.654326] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-30T18:39:47.116306] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-30T18:39:47.454404] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-30T18:39:48.072584] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T18:39:48.081516] [INFO ] [REMOTE ] ETW: Full fetch complete (36380 records). [2025-09-30T18:39:48.081764] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-30T18:39:48.260390] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-30T18:39:48.437848] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T18:39:48.550588] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-30T18:39:48.550727] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-30T18:39:48.551467] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-30T18:39:48.551615] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-30T18:39:48.552553] [DEBUG] [LOCAL ] ETW: Trimmed 36380 records to 25073 (keeping 200 days of data) [2025-09-30T18:39:48.738131] [DEBUG] [LOCAL ] ETW: Primary data saved (25073 records). [2025-09-30T18:39:48.738312] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-30T18:39:48.738421] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETW took 38.5s. Estimated remaining: 3h 21m 55s. Rate: 7.9 symbols/min [2025-09-30T18:39:48.929103] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:39:48.944055] [DEBUG] [LOCAL ] EVF: Loaded 9377 existing records from primary storage. [2025-09-30T18:39:48.944301] [INFO ] [MAIN ] EVF: Loaded 9377 existing records. [2025-09-30T18:39:49.059195] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-30T18:39:49.147462] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:39:49.147708] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-30T18:39:49.147776] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-30T18:39:49.147976] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-30T18:39:49.148035] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-30T18:39:49.576501] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:39:49.570181] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T18:39:49.854329] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-30T18:39:50.155504] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T18:39:50.654341] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-30T18:39:50.764357] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T18:39:51.454325] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-30T18:39:51.688074] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T18:39:52.254314] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-30T18:39:52.652180] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T18:39:53.054388] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-30T18:39:53.385955] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T18:39:53.538295] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-30T18:39:53.854369] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-30T18:39:54.654364] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-30T18:39:54.906804] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T18:39:55.454336] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-30T18:39:55.776171] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T18:39:56.254381] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-30T18:39:56.401606] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T18:39:57.015458] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T18:39:57.054357] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-30T18:39:57.854386] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-30T18:39:58.142346] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T18:39:58.654414] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-30T18:39:59.241815] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T18:39:59.303714] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T18:39:59.454374] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-30T18:40:00.254399] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-30T18:40:00.513575] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T18:40:01.054398] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-30T18:40:01.480975] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T18:40:01.854380] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-30T18:40:02.471551] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T18:40:02.656669] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-30T18:40:02.659431] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T18:40:03.454357] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-30T18:40:04.254329] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-30T18:40:04.394792] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T18:40:04.602672] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T18:40:04.612935] [INFO ] [REMOTE ] EVEX: Full fetch complete (41843 records). [2025-09-30T18:40:04.613074] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-30T18:40:05.027283] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-30T18:40:05.027454] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-30T18:40:05.028515] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-30T18:40:05.028671] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-30T18:40:05.042890] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T18:40:05.043521] [DEBUG] [LOCAL ] EVEX: Trimmed 41843 records to 30362 (keeping 200 days of data) [2025-09-30T18:40:05.048534] [INFO ] [REMOTE ] EVC: Full fetch complete (30484 records). [2025-09-30T18:40:05.049027] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-30T18:40:05.061461] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-30T18:40:05.587224] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-30T18:40:05.587919] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-30T18:40:05.588880] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-30T18:40:05.588969] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-30T18:40:05.592618] [DEBUG] [LOCAL ] EVC: Trimmed 30484 records to 18717 (keeping 200 days of data) [2025-09-30T18:40:05.765039] [DEBUG] [LOCAL ] EVEX: Primary data saved (30362 records). [2025-09-30T18:40:05.766283] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-30T18:40:05.766847] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. EVEX took 25.4s. Estimated remaining: 3h 22m 7s. Rate: 7.8 symbols/min [2025-09-30T18:40:05.856525] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-30T18:40:05.981051] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:05.982483] [DEBUG] [LOCAL ] EVG: No existing data file found in primary storage. [2025-09-30T18:40:05.983381] [WARN ] [MAIN ] EVG: No existing data found, performing full refresh instead. [2025-09-30T18:40:05.984334] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-30T18:40:05.985171] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-30T18:40:05.986783] [DEBUG] [LOCAL ] EVG: No primary data file found to delete. [2025-09-30T18:40:05.987534] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-30T18:40:06.116531] [DEBUG] [LOCAL ] EVC: Primary data saved (18717 records). [2025-09-30T18:40:06.132347] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-30T18:40:06.132494] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVC took 28.0s. Estimated remaining: 3h 21m 44s. Rate: 7.9 symbols/min [2025-09-30T18:40:06.337588] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T18:40:06.607666] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:06.631233] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:06.664304] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-30T18:40:06.687200] [DEBUG] [LOCAL ] EVH: Loaded 49370 existing records from primary storage. [2025-09-30T18:40:06.687631] [INFO ] [MAIN ] EVH: Loaded 49370 existing records. [2025-09-30T18:40:06.907611] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:06.907914] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-30T18:40:06.907975] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-30T18:40:06.910149] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-30T18:40:06.910212] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-30T18:40:07.285086] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T18:40:07.378251] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:07.451119] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-30T18:40:07.454310] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-30T18:40:08.157176] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T18:40:08.254391] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-30T18:40:09.054398] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-30T18:40:09.640807] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T18:40:09.854413] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-30T18:40:10.172722] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-30T18:40:10.344772] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T18:40:10.654370] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-30T18:40:11.454390] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-30T18:40:11.721576] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T18:40:12.067845] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T18:40:12.254424] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-30T18:40:12.957198] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-30T18:40:13.054368] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-30T18:40:13.731523] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T18:40:13.854365] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-30T18:40:14.654372] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-30T18:40:14.783300] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T18:40:14.788302] [INFO ] [REMOTE ] ETY: Full fetch complete (34172 records). [2025-09-30T18:40:14.788453] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-30T18:40:15.200880] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-30T18:40:15.200969] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-30T18:40:15.201596] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-30T18:40:15.201664] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-30T18:40:15.202613] [DEBUG] [LOCAL ] ETY: Trimmed 34172 records to 22683 (keeping 200 days of data) [2025-09-30T18:40:15.373596] [DEBUG] [LOCAL ] ETY: Primary data saved (22683 records). [2025-09-30T18:40:15.373810] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-30T18:40:15.373932] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. ETY took 42.8s. Estimated remaining: 3h 21m 40s. Rate: 7.9 symbols/min [2025-09-30T18:40:15.454672] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-30T18:40:15.571695] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:15.578680] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T18:40:15.592555] [DEBUG] [LOCAL ] EVN: Loaded 11135 existing records from primary storage. [2025-09-30T18:40:15.592844] [INFO ] [MAIN ] EVN: Loaded 11135 existing records. [2025-09-30T18:40:15.788473] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:15.788731] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-30T18:40:15.788785] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-30T18:40:15.789516] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-30T18:40:15.789578] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-30T18:40:16.171879] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:16.254365] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-30T18:40:16.929928] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-30T18:40:17.054362] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-30T18:40:17.107944] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T18:40:17.748095] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-30T18:40:17.854382] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-30T18:40:18.654374] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-30T18:40:18.709369] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T18:40:19.163830] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-30T18:40:19.454396] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-30T18:40:20.230256] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-30T18:40:20.232908] [INFO ] [REMOTE ] EVG: Full fetch complete (8109 records). [2025-09-30T18:40:20.233009] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-30T18:40:20.263850] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-30T18:40:20.660913] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-30T18:40:20.661013] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-30T18:40:20.661242] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-30T18:40:20.661303] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-30T18:40:20.661814] [DEBUG] [LOCAL ] EVG: Trimmed 8109 records to 5828 (keeping 200 days of data) [2025-09-30T18:40:20.701075] [DEBUG] [LOCAL ] EVG: Primary data saved (5828 records). [2025-09-30T18:40:20.701232] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-30T18:40:20.701317] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVG took 14.9s. Estimated remaining: 3h 21m 28s. Rate: 7.9 symbols/min [2025-09-30T18:40:20.895218] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:20.943504] [DEBUG] [LOCAL ] EVR: Loaded 35058 existing records from primary storage. [2025-09-30T18:40:20.943822] [INFO ] [MAIN ] EVR: Loaded 35058 existing records. [2025-09-30T18:40:21.057829] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-30T18:40:21.149799] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:21.150034] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-30T18:40:21.150085] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-30T18:40:21.151218] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-30T18:40:21.151282] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-30T18:40:21.504209] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T18:40:21.587271] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:21.742876] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T18:40:21.854391] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-30T18:40:22.654349] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-30T18:40:23.385159] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T18:40:23.454343] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-30T18:40:24.254351] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-30T18:40:24.354540] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T18:40:24.357689] [INFO ] [REMOTE ] EVF: Full fetch complete (12158 records). [2025-09-30T18:40:24.357799] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-30T18:40:24.494104] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-30T18:40:24.787947] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-30T18:40:24.788065] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-30T18:40:24.788403] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-30T18:40:24.788463] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-30T18:40:24.789038] [DEBUG] [LOCAL ] EVF: Trimmed 12158 records to 9402 (keeping 200 days of data) [2025-09-30T18:40:24.848815] [DEBUG] [LOCAL ] EVF: Primary data saved (9402 records). [2025-09-30T18:40:24.848955] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-30T18:40:24.849040] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVF took 36.1s. Estimated remaining: 3h 21m 13s. Rate: 7.9 symbols/min [2025-09-30T18:40:25.043123] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:25.055192] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T18:40:25.054556] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-30T18:40:25.077331] [DEBUG] [LOCAL ] EVT: Loaded 16958 existing records from primary storage. [2025-09-30T18:40:25.077583] [INFO ] [MAIN ] EVT: Loaded 16958 existing records. [2025-09-30T18:40:25.275675] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:25.275912] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-30T18:40:25.275963] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-30T18:40:25.276627] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-30T18:40:25.276724] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-30T18:40:25.644431] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:25.854365] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-30T18:40:26.654506] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-30T18:40:26.716311] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T18:40:26.762185] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T18:40:27.454362] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-30T18:40:27.684770] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T18:40:28.254368] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-30T18:40:28.947667] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T18:40:29.054422] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-30T18:40:29.273067] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T18:40:29.854359] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-30T18:40:29.921323] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T18:40:30.659203] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-30T18:40:30.661434] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T18:40:31.454363] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-30T18:40:32.254402] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-30T18:40:32.305034] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T18:40:32.448041] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-30T18:40:33.054447] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-30T18:40:33.864733] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-30T18:40:33.870943] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T18:40:34.613922] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T18:40:34.654338] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-30T18:40:34.756524] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:40:35.149496] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-30T18:40:35.454411] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-30T18:40:36.254379] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-30T18:40:36.457986] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T18:40:37.054386] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-30T18:40:37.854346] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-30T18:40:37.894190] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:40:38.516752] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-30T18:40:38.640936] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:40:38.654345] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-30T18:40:39.454402] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-30T18:40:40.254345] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-30T18:40:40.339693] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T18:40:40.810802] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-30T18:40:41.054328] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-30T18:40:41.096075] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T18:40:41.854380] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-30T18:40:42.576417] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:40:42.654411] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-30T18:40:43.454375] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-30T18:40:43.603536] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T18:40:43.616373] [INFO ] [REMOTE ] EVH: Full fetch complete (71796 records). [2025-09-30T18:40:43.616530] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-30T18:40:43.771492] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T18:40:44.095737] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-30T18:40:44.095836] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-30T18:40:44.096832] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-30T18:40:44.096904] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-30T18:40:44.098807] [DEBUG] [LOCAL ] EVH: Trimmed 71796 records to 49371 (keeping 200 days of data) [2025-09-30T18:40:44.300952] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-30T18:40:44.447478] [DEBUG] [LOCAL ] EVH: Primary data saved (49371 records). [2025-09-30T18:40:44.447623] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-30T18:40:44.447762] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVH took 38.3s. Estimated remaining: 3h 21m 29s. Rate: 7.8 symbols/min [2025-09-30T18:40:44.643437] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:44.672161] [DEBUG] [LOCAL ] EVTC: Loaded 26254 existing records from primary storage. [2025-09-30T18:40:44.672712] [INFO ] [MAIN ] EVTC: Loaded 26254 existing records. [2025-09-30T18:40:44.863410] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T18:40:44.895831] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:44.896046] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-30T18:40:44.896096] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-30T18:40:44.896366] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-30T18:40:44.896438] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-30T18:40:45.068436] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-30T18:40:45.310264] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:45.529414] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T18:40:45.854407] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-30T18:40:46.654377] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-30T18:40:46.758028] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T18:40:46.938119] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T18:40:46.941732] [INFO ] [REMOTE ] EVN: Full fetch complete (17565 records). [2025-09-30T18:40:46.941849] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-30T18:40:46.942365] [FATAL] [VALIDATOR ] EVN: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:40:46.942452] [FATAL] [MAIN ] EVN: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:40:46.942502] [WARN ] [MAIN ] EVN: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:40:46.942574] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-30T18:40:46.942668] [DEBUG] [LOCAL ] EVN: No primary data file found to delete. [2025-09-30T18:40:46.942734] [INFO ] [LOCAL ] EVN: Starting deletion of derivative data. [2025-09-30T18:40:46.943009] [DEBUG] [LOCAL ] EVN: Deleted derivative data file. [2025-09-30T18:40:46.943106] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVN took 31.6s. Estimated remaining: 3h 21m 11s. Rate: 7.9 symbols/min [2025-09-30T18:40:47.135709] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:47.179461] [DEBUG] [LOCAL ] EVTL: Loaded 37802 existing records from primary storage. [2025-09-30T18:40:47.179848] [INFO ] [MAIN ] EVTL: Loaded 37802 existing records. [2025-09-30T18:40:47.381004] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:47.381217] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-30T18:40:47.381265] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-30T18:40:47.382350] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-30T18:40:47.382415] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-30T18:40:47.459494] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-30T18:40:47.827975] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:47.851320] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T18:40:48.254424] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-30T18:40:49.044243] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T18:40:49.054311] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-30T18:40:49.204921] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T18:40:49.854369] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-30T18:40:50.131110] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T18:40:50.654362] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-30T18:40:51.190588] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:40:51.454396] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-30T18:40:51.795812] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T18:40:52.220864] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T18:40:52.254319] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-30T18:40:52.982479] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T18:40:53.054405] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-30T18:40:53.854365] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-30T18:40:54.543566] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-30T18:40:54.550574] [INFO ] [REMOTE ] EVR: Full fetch complete (50768 records). [2025-09-30T18:40:54.550746] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-30T18:40:54.661750] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-30T18:40:54.765613] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T18:40:55.002831] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-30T18:40:55.002929] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-30T18:40:55.003683] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-30T18:40:55.003765] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-30T18:40:55.005166] [DEBUG] [LOCAL ] EVR: Trimmed 50768 records to 35004 (keeping 200 days of data) [2025-09-30T18:40:55.238964] [DEBUG] [LOCAL ] EVR: Primary data saved (35004 records). [2025-09-30T18:40:55.239109] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-30T18:40:55.240385] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVR took 34.5s. Estimated remaining: 3h 21m 5s. Rate: 7.9 symbols/min [2025-09-30T18:40:55.454564] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:55.454731] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-30T18:40:55.484612] [DEBUG] [LOCAL ] EVTR: Loaded 23510 existing records from primary storage. [2025-09-30T18:40:55.484961] [INFO ] [MAIN ] EVTR: Loaded 23510 existing records. [2025-09-30T18:40:55.689881] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:55.690220] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-30T18:40:55.690298] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-30T18:40:55.696531] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-30T18:40:55.696627] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-30T18:40:55.756988] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T18:40:56.105262] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:56.254395] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-30T18:40:57.054390] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-30T18:40:57.179692] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T18:40:57.221131] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T18:40:57.854360] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-30T18:40:57.922230] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T18:40:57.925819] [INFO ] [REMOTE ] EVT: Full fetch complete (25190 records). [2025-09-30T18:40:57.925897] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-30T18:40:57.926337] [FATAL] [VALIDATOR ] EVT: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:40:57.926470] [FATAL] [MAIN ] EVT: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:40:57.926540] [WARN ] [MAIN ] EVT: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:40:57.926612] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-30T18:40:57.926718] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-09-30T18:40:57.926806] [INFO ] [LOCAL ] EVT: Starting deletion of derivative data. [2025-09-30T18:40:57.927046] [DEBUG] [LOCAL ] EVT: Deleted derivative data file. [2025-09-30T18:40:57.927155] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVT took 33.1s. Estimated remaining: 3h 20m 48s. Rate: 7.9 symbols/min [2025-09-30T18:40:58.124086] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:40:58.182991] [DEBUG] [LOCAL ] EW: Loaded 53397 existing records from primary storage. [2025-09-30T18:40:58.183454] [INFO ] [MAIN ] EW: Loaded 53397 existing records. [2025-09-30T18:40:58.382317] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:40:58.382606] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-30T18:40:58.382693] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-30T18:40:58.384111] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-30T18:40:58.384175] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-30T18:40:58.659448] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-30T18:40:58.777567] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:40:59.034560] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T18:40:59.454358] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-30T18:40:59.887050] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T18:41:00.254402] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-30T18:41:00.899452] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T18:41:01.054407] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-30T18:41:01.854330] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-30T18:41:02.097093] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T18:41:02.136799] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T18:41:02.654382] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-30T18:41:03.321150] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T18:41:03.454354] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-30T18:41:03.715622] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T18:41:04.254360] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-30T18:41:04.726804] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-30T18:41:05.054343] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-30T18:41:05.270607] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T18:41:05.854368] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-30T18:41:06.475686] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T18:41:06.654373] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-30T18:41:07.077875] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T18:41:07.454351] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-30T18:41:07.764415] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T18:41:08.254338] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-30T18:41:08.502314] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T18:41:09.054389] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-30T18:41:09.347852] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T18:41:09.854356] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-30T18:41:10.193979] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-30T18:41:10.654359] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-30T18:41:11.197592] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T18:41:11.454352] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-30T18:41:11.726777] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T18:41:12.254394] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-30T18:41:13.054378] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-30T18:41:13.319122] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T18:41:13.854434] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-30T18:41:14.291757] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T18:41:14.290796] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T18:41:14.306907] [INFO ] [REMOTE ] EVTC: Full fetch complete (37870 records). [2025-09-30T18:41:14.307510] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-30T18:41:14.661463] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-30T18:41:14.703546] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-30T18:41:14.703633] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-30T18:41:14.704384] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-30T18:41:14.704453] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-30T18:41:14.705548] [DEBUG] [LOCAL ] EVTC: Trimmed 37870 records to 26224 (keeping 200 days of data) [2025-09-30T18:41:14.874577] [DEBUG] [LOCAL ] EVTC: Primary data saved (26224 records). [2025-09-30T18:41:14.874776] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-30T18:41:14.874910] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTC took 30.4s. Estimated remaining: 3h 20m 58s. Rate: 7.8 symbols/min [2025-09-30T18:41:15.067140] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:15.107573] [DEBUG] [LOCAL ] EXG: Loaded 34119 existing records from primary storage. [2025-09-30T18:41:15.107920] [INFO ] [MAIN ] EXG: Loaded 34119 existing records. [2025-09-30T18:41:15.313629] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:15.313939] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-30T18:41:15.314069] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-30T18:41:15.325385] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-30T18:41:15.345257] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-30T18:41:15.393272] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T18:41:15.471136] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-30T18:41:15.764243] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:15.955269] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T18:41:16.254401] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-30T18:41:17.012397] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:41:17.054347] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-30T18:41:17.854398] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-30T18:41:18.064335] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T18:41:18.654336] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-30T18:41:18.743678] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T18:41:18.910042] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T18:41:19.454382] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-30T18:41:20.254388] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-30T18:41:20.463910] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T18:41:20.525225] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T18:41:20.532282] [INFO ] [REMOTE ] EVTR: Full fetch complete (32102 records). [2025-09-30T18:41:20.532399] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-30T18:41:20.533056] [FATAL] [VALIDATOR ] EVTR: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:41:20.533146] [FATAL] [MAIN ] EVTR: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:41:20.533190] [WARN ] [MAIN ] EVTR: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:41:20.533232] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-30T18:41:20.533293] [DEBUG] [LOCAL ] EVTR: No primary data file found to delete. [2025-09-30T18:41:20.533331] [INFO ] [LOCAL ] EVTR: Starting deletion of derivative data. [2025-09-30T18:41:20.533522] [DEBUG] [LOCAL ] EVTR: Deleted derivative data file. [2025-09-30T18:41:20.533632] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTR took 25.3s. Estimated remaining: 3h 20m 47s. Rate: 7.8 symbols/min [2025-09-30T18:41:20.737174] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:20.804829] [DEBUG] [LOCAL ] EXK: Loaded 53126 existing records from primary storage. [2025-09-30T18:41:20.805236] [INFO ] [MAIN ] EXK: Loaded 53126 existing records. [2025-09-30T18:41:21.024450] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:21.024713] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-30T18:41:21.024771] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-30T18:41:21.026155] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-30T18:41:21.026226] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-30T18:41:21.062006] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-30T18:41:21.434520] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:21.661515] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T18:41:21.854362] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-30T18:41:22.654378] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-30T18:41:22.832389] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T18:41:23.166834] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T18:41:23.454364] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-30T18:41:24.156063] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T18:41:24.254371] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-30T18:41:25.054356] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-30T18:41:25.265563] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T18:41:25.309163] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T18:41:25.854347] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-30T18:41:26.654332] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-30T18:41:26.706149] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T18:41:27.374888] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T18:41:27.454403] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-30T18:41:28.254383] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-30T18:41:28.613142] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T18:41:28.760767] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T18:41:28.771974] [INFO ] [REMOTE ] EVTL: Full fetch complete (51536 records). [2025-09-30T18:41:28.772206] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-30T18:41:29.059619] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-30T18:41:29.192294] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-30T18:41:29.192375] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-30T18:41:29.193091] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-30T18:41:29.193156] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-30T18:41:29.194386] [DEBUG] [LOCAL ] EVTL: Trimmed 51536 records to 38020 (keeping 200 days of data) [2025-09-30T18:41:29.424494] [DEBUG] [LOCAL ] EVTL: Primary data saved (38020 records). [2025-09-30T18:41:29.424671] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-30T18:41:29.424780] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTL took 42.5s. Estimated remaining: 3h 20m 42s. Rate: 7.8 symbols/min [2025-09-30T18:41:29.617112] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:29.651340] [DEBUG] [LOCAL ] EXP: Loaded 29703 existing records from primary storage. [2025-09-30T18:41:29.651666] [INFO ] [MAIN ] EXP: Loaded 29703 existing records. [2025-09-30T18:41:29.851519] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:29.852028] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-30T18:41:29.852105] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-30T18:41:29.853260] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-30T18:41:29.853328] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-30T18:41:29.886799] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-30T18:41:30.262874] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T18:41:30.302877] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:30.593422] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T18:41:30.654369] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-30T18:41:31.454409] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-30T18:41:31.671000] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T18:41:32.006014] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:41:32.254371] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-30T18:41:32.913709] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T18:41:32.925449] [INFO ] [REMOTE ] EW: Full fetch complete (77349 records). [2025-09-30T18:41:32.925630] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-30T18:41:33.059487] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-30T18:41:33.372180] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-30T18:41:33.372264] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-30T18:41:33.373173] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-30T18:41:33.373239] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-30T18:41:33.374915] [DEBUG] [LOCAL ] EW: Trimmed 77349 records to 53400 (keeping 200 days of data) [2025-09-30T18:41:33.617601] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T18:41:33.768494] [DEBUG] [LOCAL ] EW: Primary data saved (53400 records). [2025-09-30T18:41:33.768676] [INFO ] [MAIN ] EW: Full history saved. [2025-09-30T18:41:33.768800] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EW took 35.8s. Estimated remaining: 3h 20m 28s. Rate: 7.9 symbols/min [2025-09-30T18:41:33.854379] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-30T18:41:34.625995] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T18:41:34.654380] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-30T18:41:35.123205] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T18:41:35.454404] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-30T18:41:36.254385] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-30T18:41:36.463349] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T18:41:36.672375] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T18:41:37.054422] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-30T18:41:37.488702] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T18:41:37.854448] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-30T18:41:38.654446] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-30T18:41:38.849084] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:41:38.902587] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T18:41:39.454365] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-30T18:41:39.762530] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T18:41:39.769984] [INFO ] [REMOTE ] EXG: Full fetch complete (49947 records). [2025-09-30T18:41:39.770132] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-30T18:41:40.198611] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-30T18:41:40.198733] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-30T18:41:40.199520] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-30T18:41:40.199666] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-30T18:41:40.200979] [DEBUG] [LOCAL ] EXG: Trimmed 49947 records to 34116 (keeping 200 days of data) [2025-09-30T18:41:40.255876] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-30T18:41:40.424597] [DEBUG] [LOCAL ] EXG: Primary data saved (34116 records). [2025-09-30T18:41:40.424782] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-30T18:41:40.424874] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EXG took 25.5s. Estimated remaining: 3h 20m 18s. Rate: 7.9 symbols/min [2025-09-30T18:41:40.945336] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T18:41:41.054352] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-30T18:41:41.706018] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:41:41.854407] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-30T18:41:42.750670] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:41:42.761582] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-30T18:41:43.114973] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:41:43.454415] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-30T18:41:44.558190] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T18:41:44.569984] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-30T18:41:44.641526] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-30T18:41:45.054431] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-30T18:41:46.217141] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T18:41:46.228952] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-30T18:41:46.410197] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T18:41:46.654387] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-30T18:41:47.962203] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T18:41:47.968941] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-30T18:41:48.287790] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-30T18:41:48.299576] [INFO ] [REMOTE ] EXK: Full fetch complete (76513 records). [2025-09-30T18:41:48.299774] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-30T18:41:48.724262] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-30T18:41:48.724358] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-30T18:41:48.725380] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-30T18:41:48.725466] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-30T18:41:48.727275] [DEBUG] [LOCAL ] EXK: Trimmed 76513 records to 53127 (keeping 200 days of data) [2025-09-30T18:41:49.059376] [DEBUG] [LOCAL ] EXK: Primary data saved (53127 records). [2025-09-30T18:41:49.059515] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-30T18:41:49.061053] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXK took 28.5s. Estimated remaining: 3h 20m 12s. Rate: 7.9 symbols/min [2025-09-30T18:41:49.300849] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T18:41:49.306911] [INFO ] [REMOTE ] EXP: Full fetch complete (42914 records). [2025-09-30T18:41:49.307008] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-30T18:41:49.724985] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-30T18:41:49.725112] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-30T18:41:49.725838] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-30T18:41:49.725911] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-30T18:41:49.727555] [DEBUG] [LOCAL ] EXP: Trimmed 42914 records to 29652 (keeping 200 days of data) [2025-09-30T18:41:49.926282] [DEBUG] [LOCAL ] EXP: Primary data saved (29652 records). [2025-09-30T18:41:49.926436] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-30T18:41:49.926608] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXP took 20.5s. Estimated remaining: 3h 19m 51s. Rate: 7.9 symbols/min [2025-09-30T18:41:50.564940] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:50.737887] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:50.741459] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:50.763103] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:41:50.845131] [DEBUG] [LOCAL ] EXR: Loaded 45310 existing records from primary storage. [2025-09-30T18:41:50.858210] [INFO ] [MAIN ] EXR: Loaded 45310 existing records. [2025-09-30T18:41:50.917423] [DEBUG] [LOCAL ] FAF: Loaded 41799 existing records from primary storage. [2025-09-30T18:41:50.987605] [INFO ] [MAIN ] FAF: Loaded 41799 existing records. [2025-09-30T18:41:51.019410] [DEBUG] [LOCAL ] EXPD: Loaded 48037 existing records from primary storage. [2025-09-30T18:41:51.055910] [INFO ] [MAIN ] EXPD: Loaded 48037 existing records. [2025-09-30T18:41:51.167789] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-30T18:41:51.204450] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-09-30T18:41:51.462339] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:51.504904] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-30T18:41:51.577732] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:51.571728] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-30T18:41:51.588339] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-30T18:41:51.642147] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-30T18:41:51.621871] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-30T18:41:51.676054] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-30T18:41:51.679461] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:51.679821] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-30T18:41:51.690700] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-30T18:41:51.695986] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-30T18:41:51.713873] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-30T18:41:51.724165] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-30T18:41:51.778747] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-30T18:41:52.002022] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:41:52.044889] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-30T18:41:52.088197] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-30T18:41:52.152115] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-30T18:41:52.218094] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-30T18:41:53.092712] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:53.170832] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-30T18:41:53.300514] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:53.342218] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-30T18:41:53.389771] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:53.415756] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-30T18:41:53.523151] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:41:53.523568] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-30T18:41:54.947467] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T18:41:54.958267] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-30T18:41:54.983345] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:41:55.005619] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-30T18:41:55.017455] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T18:41:55.026852] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-30T18:41:56.079753] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-30T18:41:56.091668] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-30T18:41:56.330194] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:41:56.337599] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-30T18:41:56.562139] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:41:56.572385] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-30T18:41:56.648067] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T18:41:56.658123] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-30T18:41:57.757114] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T18:41:57.764505] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-30T18:41:57.849845] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T18:41:57.858617] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-30T18:41:58.250825] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-30T18:41:58.290638] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T18:41:58.654368] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-30T18:41:59.171517] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T18:41:59.454377] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-30T18:41:59.525628] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T18:42:00.200904] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T18:42:00.254368] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-30T18:42:01.054406] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-30T18:42:01.854402] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-30T18:42:01.931358] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-30T18:42:01.973557] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T18:42:02.654352] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-30T18:42:02.822999] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T18:42:03.454330] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-30T18:42:03.642042] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:42:04.254394] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-30T18:42:04.957322] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T18:42:05.054339] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-30T18:42:05.095054] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-30T18:42:05.854351] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-30T18:42:05.913097] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T18:42:06.654419] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-30T18:42:06.810330] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:42:07.454374] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-30T18:42:07.965502] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:42:08.254397] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-30T18:42:08.304097] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-30T18:42:08.653811] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T18:42:09.054394] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-30T18:42:09.854335] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-30T18:42:09.949136] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T18:42:10.654371] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-30T18:42:11.172502] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T18:42:11.454356] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-30T18:42:11.590232] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-30T18:42:12.060170] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T18:42:12.254362] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-30T18:42:13.054347] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-30T18:42:13.092549] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:42:13.718183] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T18:42:13.854384] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-30T18:42:14.654371] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-30T18:42:15.113546] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T18:42:15.122992] [INFO ] [REMOTE ] FAF: Full fetch complete (57596 records). [2025-09-30T18:42:15.123143] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-30T18:42:15.459726] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-30T18:42:15.490797] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-30T18:42:15.603118] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-30T18:42:15.603230] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-30T18:42:15.604167] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-30T18:42:15.604241] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-30T18:42:15.607441] [DEBUG] [LOCAL ] FAF: Trimmed 57596 records to 41733 (keeping 200 days of data) [2025-09-30T18:42:15.881424] [DEBUG] [LOCAL ] FAF: Primary data saved (41733 records). [2025-09-30T18:42:15.881589] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-30T18:42:15.881786] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. FAF took 25.9s. Estimated remaining: 3h 20m 20s. Rate: 7.8 symbols/min [2025-09-30T18:42:16.066711] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:16.115907] [DEBUG] [LOCAL ] FBIN: Loaded 50319 existing records from primary storage. [2025-09-30T18:42:16.116265] [INFO ] [MAIN ] FBIN: Loaded 50319 existing records. [2025-09-30T18:42:16.267519] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-30T18:42:16.312814] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:42:16.314151] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-30T18:42:16.314320] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-30T18:42:16.316791] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-30T18:42:16.316897] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-30T18:42:16.519397] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T18:42:16.775819] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:16.804397] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:42:17.054361] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-30T18:42:17.854372] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-30T18:42:18.654452] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-30T18:42:19.006385] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T18:42:19.018686] [INFO ] [REMOTE ] EXPD: Full fetch complete (69287 records). [2025-09-30T18:42:19.018834] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-30T18:42:19.204798] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-30T18:42:19.461073] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-30T18:42:19.523808] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-30T18:42:19.523909] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-30T18:42:19.524800] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-30T18:42:19.524884] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-30T18:42:19.528831] [DEBUG] [LOCAL ] EXPD: Trimmed 69287 records to 47976 (keeping 200 days of data) [2025-09-30T18:42:19.688684] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T18:42:19.701183] [INFO ] [REMOTE ] EXR: Full fetch complete (65916 records). [2025-09-30T18:42:19.701841] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-30T18:42:20.238912] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-30T18:42:20.239276] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-30T18:42:20.240851] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-30T18:42:20.241519] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-30T18:42:20.247817] [DEBUG] [LOCAL ] EXR: Trimmed 65916 records to 45275 (keeping 200 days of data) [2025-09-30T18:42:20.386759] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T18:42:20.399263] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-30T18:42:20.486697] [DEBUG] [LOCAL ] EXPD: Primary data saved (47976 records). [2025-09-30T18:42:20.487624] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-30T18:42:20.490078] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. EXPD took 30.6s. Estimated remaining: 3h 20m 6s. Rate: 7.8 symbols/min [2025-09-30T18:42:20.687391] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:20.688433] [DEBUG] [LOCAL ] FBK: No existing data file found in primary storage. [2025-09-30T18:42:20.688509] [WARN ] [MAIN ] FBK: No existing data found, performing full refresh instead. [2025-09-30T18:42:20.692705] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-30T18:42:20.695155] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-30T18:42:20.695272] [DEBUG] [LOCAL ] FBK: No primary data file found to delete. [2025-09-30T18:42:20.695310] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-30T18:42:21.261805] [DEBUG] [LOCAL ] EXR: Primary data saved (45275 records). [2025-09-30T18:42:21.266223] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-30T18:42:21.265971] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:21.266742] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-30T18:42:21.266425] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. EXR took 31.3s. Estimated remaining: 3h 19m 45s. Rate: 7.8 symbols/min [2025-09-30T18:42:21.458025] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:21.458260] [DEBUG] [LOCAL ] FBP: No existing data file found in primary storage. [2025-09-30T18:42:21.458314] [WARN ] [MAIN ] FBP: No existing data found, performing full refresh instead. [2025-09-30T18:42:21.458486] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-30T18:42:21.458530] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-30T18:42:21.458572] [DEBUG] [LOCAL ] FBP: No primary data file found to delete. [2025-09-30T18:42:21.458605] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-30T18:42:21.858407] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:21.858835] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-30T18:42:21.968125] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T18:42:22.074443] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-30T18:42:22.405263] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T18:42:22.654365] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-30T18:42:23.370282] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T18:42:23.454314] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-30T18:42:23.634394] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T18:42:24.069818] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-30T18:42:24.254357] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-30T18:42:25.054363] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-30T18:42:25.854380] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-30T18:42:25.936007] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:42:26.654377] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-30T18:42:27.274842] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-30T18:42:27.454359] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-30T18:42:27.854765] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-09-30T18:42:27.867145] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-09-30T18:42:27.867324] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-30T18:42:28.273309] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-30T18:42:28.319316] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-30T18:42:28.319626] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-30T18:42:28.321256] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-30T18:42:28.321411] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-30T18:42:28.323828] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-30T18:42:28.459334] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T18:42:28.508991] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T18:42:28.760721] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-09-30T18:42:28.760900] [INFO ] [MAIN ] F: Full history saved. [2025-09-30T18:42:28.761474] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 38.8s. Estimated remaining: 3h 19m 37s. Rate: 7.9 symbols/min [2025-09-30T18:42:28.935572] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:28.973182] [DEBUG] [LOCAL ] FBRT: Loaded 34454 existing records from primary storage. [2025-09-30T18:42:28.973515] [INFO ] [MAIN ] FBRT: Loaded 34454 existing records. [2025-09-30T18:42:29.055250] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-30T18:42:29.160487] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:42:29.160887] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-30T18:42:29.160941] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-30T18:42:29.161721] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-30T18:42:29.161791] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-30T18:42:29.519146] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T18:42:29.564059] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:29.854387] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-30T18:42:30.576733] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T18:42:30.654437] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-30T18:42:31.147746] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T18:42:31.454394] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-30T18:42:31.944922] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T18:42:32.254414] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-30T18:42:33.054364] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-30T18:42:33.446724] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T18:42:33.539663] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-30T18:42:33.854385] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-30T18:42:34.587498] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:42:34.654369] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-30T18:42:34.893728] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T18:42:35.454372] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-30T18:42:36.254329] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-30T18:42:36.358010] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T18:42:36.682777] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T18:42:37.054401] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-30T18:42:37.230480] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T18:42:37.854360] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-30T18:42:38.654407] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-30T18:42:38.873746] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T18:42:38.932810] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T18:42:39.454373] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-30T18:42:39.883961] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T18:42:40.254369] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-30T18:42:41.054410] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-30T18:42:41.163414] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T18:42:41.695172] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T18:42:41.700857] [INFO ] [REMOTE ] FBK: Full fetch complete (33422 records). [2025-09-30T18:42:41.700985] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-30T18:42:41.859507] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-30T18:42:42.093777] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-30T18:42:42.093934] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-30T18:42:42.094686] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-30T18:42:42.094851] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-30T18:42:42.095971] [DEBUG] [LOCAL ] FBK: Trimmed 33422 records to 25945 (keeping 200 days of data) [2025-09-30T18:42:42.240278] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T18:42:42.316705] [DEBUG] [LOCAL ] FBK: Primary data saved (25945 records). [2025-09-30T18:42:42.316861] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-30T18:42:42.316963] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBK took 21.8s. Estimated remaining: 3h 19m 41s. Rate: 7.8 symbols/min [2025-09-30T18:42:42.494541] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:42.511154] [DEBUG] [LOCAL ] FC: Loaded 15423 existing records from primary storage. [2025-09-30T18:42:42.511406] [INFO ] [MAIN ] FC: Loaded 15423 existing records. [2025-09-30T18:42:42.659478] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-30T18:42:42.746515] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:42:42.746931] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-30T18:42:42.746987] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-30T18:42:42.747563] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-30T18:42:42.747626] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-30T18:42:43.138343] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:43.383225] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:42:43.454338] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-30T18:42:43.899003] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T18:42:44.137896] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-30T18:42:44.254397] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-30T18:42:45.054417] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-30T18:42:45.758372] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:42:45.854381] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-30T18:42:46.525157] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T18:42:46.654362] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-30T18:42:47.246326] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T18:42:47.454425] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-30T18:42:48.254388] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-30T18:42:48.418480] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T18:42:48.430128] [INFO ] [REMOTE ] FBIN: Full fetch complete (72572 records). [2025-09-30T18:42:48.430308] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-30T18:42:48.883359] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-30T18:42:48.883558] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-30T18:42:48.884619] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-30T18:42:48.884818] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-30T18:42:48.906521] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T18:42:48.916116] [DEBUG] [LOCAL ] FBIN: Trimmed 72572 records to 50325 (keeping 200 days of data) [2025-09-30T18:42:49.028458] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T18:42:49.054436] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-30T18:42:49.275926] [DEBUG] [LOCAL ] FBIN: Primary data saved (50325 records). [2025-09-30T18:42:49.276088] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-30T18:42:49.276202] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBIN took 33.4s. Estimated remaining: 3h 19m 32s. Rate: 7.8 symbols/min [2025-09-30T18:42:49.473210] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:49.515324] [DEBUG] [LOCAL ] FCF: Loaded 39462 existing records from primary storage. [2025-09-30T18:42:49.515666] [INFO ] [MAIN ] FCF: Loaded 39462 existing records. [2025-09-30T18:42:49.709993] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:42:49.710203] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-30T18:42:49.710252] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-30T18:42:49.711483] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-30T18:42:49.711546] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-30T18:42:49.857228] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-30T18:42:50.058604] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T18:42:50.135259] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:50.654436] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-30T18:42:51.454382] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-30T18:42:51.638824] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T18:42:52.041910] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-30T18:42:52.254399] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-30T18:42:52.297844] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T18:42:53.054390] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-30T18:42:53.624230] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T18:42:53.854426] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-30T18:42:54.587780] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T18:42:54.663006] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-30T18:42:54.665617] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T18:42:55.454382] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-30T18:42:56.151788] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T18:42:56.254402] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-30T18:42:57.041812] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T18:42:57.052031] [INFO ] [REMOTE ] FBP: Full fetch complete (66378 records). [2025-09-30T18:42:57.052301] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-30T18:42:57.065020] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-30T18:42:57.503792] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-30T18:42:57.503903] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-30T18:42:57.505071] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-30T18:42:57.505150] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-30T18:42:57.507897] [DEBUG] [LOCAL ] FBP: Trimmed 66378 records to 46045 (keeping 200 days of data) [2025-09-30T18:42:57.778214] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T18:42:57.793466] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-30T18:42:57.857689] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-30T18:42:57.871841] [DEBUG] [LOCAL ] FBP: Primary data saved (46045 records). [2025-09-30T18:42:57.872025] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-30T18:42:57.872134] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBP took 36.6s. Estimated remaining: 3h 19m 26s. Rate: 7.8 symbols/min [2025-09-30T18:42:58.100920] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:58.101161] [DEBUG] [LOCAL ] FCN: No existing data file found in primary storage. [2025-09-30T18:42:58.101215] [WARN ] [MAIN ] FCN: No existing data found, performing full refresh instead. [2025-09-30T18:42:58.101361] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-30T18:42:58.101420] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-30T18:42:58.101467] [DEBUG] [LOCAL ] FCN: No primary data file found to delete. [2025-09-30T18:42:58.101507] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-30T18:42:58.510429] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:42:58.654407] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-30T18:42:58.969496] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T18:42:58.977189] [INFO ] [REMOTE ] FBRT: Full fetch complete (48751 records). [2025-09-30T18:42:58.977359] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-30T18:42:59.418881] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-30T18:42:59.419004] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-30T18:42:59.419735] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-30T18:42:59.419798] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-30T18:42:59.421040] [DEBUG] [LOCAL ] FBRT: Trimmed 48751 records to 34527 (keeping 200 days of data) [2025-09-30T18:42:59.484487] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-30T18:42:59.543750] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T18:42:59.672722] [DEBUG] [LOCAL ] FBRT: Primary data saved (34527 records). [2025-09-30T18:42:59.672898] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-30T18:42:59.673904] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBRT took 30.9s. Estimated remaining: 3h 19m 7s. Rate: 7.8 symbols/min [2025-09-30T18:42:59.854398] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:42:59.893684] [DEBUG] [LOCAL ] FCPT: Loaded 37247 existing records from primary storage. [2025-09-30T18:42:59.894027] [INFO ] [MAIN ] FCPT: Loaded 37247 existing records. [2025-09-30T18:43:00.086347] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:43:00.086590] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-30T18:43:00.086687] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-30T18:43:00.087803] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-30T18:43:00.087866] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-30T18:43:00.273506] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-30T18:43:00.464049] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:00.817527] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T18:43:01.054385] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-30T18:43:01.407236] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T18:43:01.854393] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-30T18:43:02.507575] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T18:43:02.654344] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-30T18:43:02.806487] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T18:43:03.454371] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-30T18:43:04.237246] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:43:04.254326] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-30T18:43:04.502372] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T18:43:04.505961] [INFO ] [REMOTE ] FC: Full fetch complete (21644 records). [2025-09-30T18:43:04.506039] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-30T18:43:04.907013] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-30T18:43:04.907093] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-30T18:43:04.907628] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-30T18:43:04.907713] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-30T18:43:04.908367] [DEBUG] [LOCAL ] FC: Trimmed 21644 records to 15429 (keeping 200 days of data) [2025-09-30T18:43:05.005058] [DEBUG] [LOCAL ] FC: Primary data saved (15429 records). [2025-09-30T18:43:05.005212] [INFO ] [MAIN ] FC: Full history saved. [2025-09-30T18:43:05.005301] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FC took 22.7s. Estimated remaining: 3h 18m 55s. Rate: 7.9 symbols/min [2025-09-30T18:43:05.061023] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-30T18:43:05.218779] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:43:05.218989] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-30T18:43:05.219066] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-30T18:43:05.219192] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-30T18:43:05.219235] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-30T18:43:05.219278] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-30T18:43:05.219312] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-30T18:43:05.611067] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:05.850422] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T18:43:05.859857] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-30T18:43:06.238832] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T18:43:06.530273] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-30T18:43:06.654382] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-30T18:43:07.454387] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-30T18:43:07.895307] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-30T18:43:08.119412] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T18:43:08.254362] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-30T18:43:09.054377] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-30T18:43:09.562196] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:43:09.854407] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-30T18:43:10.049088] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T18:43:10.654347] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-30T18:43:11.146411] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T18:43:11.320011] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T18:43:11.454351] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-30T18:43:12.254372] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-30T18:43:12.638399] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-30T18:43:13.054375] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-30T18:43:13.651988] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T18:43:13.854384] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-30T18:43:14.495568] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T18:43:14.654355] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-30T18:43:15.198882] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T18:43:15.454354] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-30T18:43:15.680618] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T18:43:15.879276] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T18:43:16.254357] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-30T18:43:16.600345] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T18:43:17.054355] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-30T18:43:17.370627] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-30T18:43:17.854359] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-30T18:43:18.252625] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T18:43:18.654358] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-30T18:43:19.454373] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-30T18:43:20.113394] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T18:43:20.254356] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-30T18:43:20.655438] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-30T18:43:21.054360] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-30T18:43:21.266944] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:43:21.275303] [INFO ] [REMOTE ] FCF: Full fetch complete (58074 records). [2025-09-30T18:43:21.275424] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-30T18:43:21.495316] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-30T18:43:21.715768] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-30T18:43:21.715890] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-30T18:43:21.716775] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-30T18:43:21.716882] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-30T18:43:21.718553] [DEBUG] [LOCAL ] FCF: Trimmed 58074 records to 39428 (keeping 200 days of data) [2025-09-30T18:43:21.898770] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-30T18:43:21.971679] [DEBUG] [LOCAL ] FCF: Primary data saved (39428 records). [2025-09-30T18:43:21.971831] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-30T18:43:21.971935] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCF took 32.7s. Estimated remaining: 3h 19m 5s. Rate: 7.8 symbols/min [2025-09-30T18:43:22.164880] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:43:22.182772] [DEBUG] [LOCAL ] FCT: Loaded 14519 existing records from primary storage. [2025-09-30T18:43:22.183017] [INFO ] [MAIN ] FCT: Loaded 14519 existing records. [2025-09-30T18:43:22.301464] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-30T18:43:22.379248] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:43:22.379491] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-30T18:43:22.379545] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-30T18:43:22.379851] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-30T18:43:22.379913] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-30T18:43:22.659508] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-30T18:43:22.772876] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:23.454380] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-30T18:43:23.962429] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T18:43:23.994478] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-30T18:43:23.995724] [INFO ] [REMOTE ] FCRX: Full fetch complete (1677 records). [2025-09-30T18:43:23.995828] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-30T18:43:23.996331] [FATAL] [VALIDATOR ] FCRX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:43:23.996435] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:43:23.996544] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:43:23.996628] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-30T18:43:23.996757] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-30T18:43:23.996813] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-30T18:43:23.996857] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-30T18:43:23.996923] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCRX took 19.0s. Estimated remaining: 3h 18m 47s. Rate: 7.8 symbols/min [2025-09-30T18:43:24.215954] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:43:24.254415] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-30T18:43:24.281950] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-09-30T18:43:24.282412] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-09-30T18:43:24.507365] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:43:24.507630] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-30T18:43:24.507723] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-30T18:43:24.509814] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-30T18:43:24.509892] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-30T18:43:24.895289] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:25.054318] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-30T18:43:25.115744] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T18:43:25.854383] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-30T18:43:26.645584] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T18:43:26.654317] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-30T18:43:27.097512] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-30T18:43:27.454365] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-30T18:43:27.918793] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T18:43:28.254360] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-30T18:43:29.054370] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-30T18:43:29.082787] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T18:43:29.392095] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T18:43:29.854368] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-30T18:43:30.654330] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-30T18:43:31.081376] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-30T18:43:31.428612] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T18:43:31.454327] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-30T18:43:31.956265] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T18:43:31.961688] [INFO ] [REMOTE ] FCN: Full fetch complete (35656 records). [2025-09-30T18:43:31.961816] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-30T18:43:32.259501] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-30T18:43:32.383662] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-30T18:43:32.383760] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-30T18:43:32.384468] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-30T18:43:32.384539] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-30T18:43:32.385637] [DEBUG] [LOCAL ] FCN: Trimmed 35656 records to 26000 (keeping 200 days of data) [2025-09-30T18:43:32.561542] [DEBUG] [LOCAL ] FCN: Primary data saved (26000 records). [2025-09-30T18:43:32.561741] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-30T18:43:32.561848] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCN took 34.7s. Estimated remaining: 3h 18m 41s. Rate: 7.8 symbols/min [2025-09-30T18:43:32.749842] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:43:32.783154] [DEBUG] [LOCAL ] FDP: Loaded 30255 existing records from primary storage. [2025-09-30T18:43:32.783505] [INFO ] [MAIN ] FDP: Loaded 30255 existing records. [2025-09-30T18:43:33.007979] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:43:33.009015] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-30T18:43:33.009097] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-30T18:43:33.010272] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T18:43:33.017861] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-30T18:43:33.018369] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-30T18:43:33.063817] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-30T18:43:33.398413] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:33.854404] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-30T18:43:34.228917] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T18:43:34.459775] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T18:43:34.654376] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-30T18:43:35.072893] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:43:35.454383] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-30T18:43:36.254397] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-30T18:43:36.788697] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T18:43:36.893331] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-30T18:43:37.054362] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-30T18:43:37.114711] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-30T18:43:37.854342] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-30T18:43:38.046148] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T18:43:38.654332] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-30T18:43:38.819872] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T18:43:39.454415] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-30T18:43:40.254414] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-30T18:43:40.610777] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T18:43:40.722892] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-30T18:43:41.054367] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-30T18:43:41.795906] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T18:43:41.854395] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-30T18:43:41.976692] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T18:43:42.654377] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-30T18:43:42.964407] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T18:43:43.226294] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T18:43:43.454370] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-30T18:43:44.254363] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-30T18:43:45.054378] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-30T18:43:45.096388] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T18:43:45.105370] [INFO ] [REMOTE ] FCPT: Full fetch complete (53593 records). [2025-09-30T18:43:45.105494] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-30T18:43:45.514016] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-30T18:43:45.514112] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-30T18:43:45.515037] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-30T18:43:45.515112] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-30T18:43:45.516397] [DEBUG] [LOCAL ] FCPT: Trimmed 53593 records to 37298 (keeping 200 days of data) [2025-09-30T18:43:45.788406] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:43:45.817958] [DEBUG] [LOCAL ] FCPT: Primary data saved (37298 records). [2025-09-30T18:43:45.818125] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-30T18:43:45.818748] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCPT took 46.1s. Estimated remaining: 3h 18m 44s. Rate: 7.8 symbols/min [2025-09-30T18:43:45.859548] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-30T18:43:46.013733] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:43:46.042857] [DEBUG] [LOCAL ] FDS: Loaded 26449 existing records from primary storage. [2025-09-30T18:43:46.043166] [INFO ] [MAIN ] FDS: Loaded 26449 existing records. [2025-09-30T18:43:46.290186] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:43:46.290530] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-30T18:43:46.290732] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-30T18:43:46.291574] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-30T18:43:46.291637] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-30T18:43:46.620793] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T18:43:46.659444] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-30T18:43:46.720235] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:47.454333] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-30T18:43:47.529830] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T18:43:47.564727] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T18:43:48.254370] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-30T18:43:48.730207] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T18:43:49.054338] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-30T18:43:49.188788] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T18:43:49.854375] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-30T18:43:50.538228] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T18:43:50.654433] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-30T18:43:51.106848] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T18:43:51.454372] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-30T18:43:52.254329] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-30T18:43:52.300701] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T18:43:52.699314] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-30T18:43:53.054388] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-30T18:43:53.180190] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T18:43:53.854349] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-30T18:43:54.244240] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T18:43:54.654350] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-30T18:43:54.882789] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T18:43:54.886787] [INFO ] [REMOTE ] FCT: Full fetch complete (21043 records). [2025-09-30T18:43:54.886901] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-30T18:43:55.284085] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-30T18:43:55.284192] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-30T18:43:55.284692] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-30T18:43:55.284755] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-30T18:43:55.285832] [DEBUG] [LOCAL ] FCT: Trimmed 21043 records to 14501 (keeping 200 days of data) [2025-09-30T18:43:55.378874] [DEBUG] [LOCAL ] FCT: Primary data saved (14501 records). [2025-09-30T18:43:55.379051] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-30T18:43:55.379184] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCT took 33.4s. Estimated remaining: 3h 18m 40s. Rate: 7.8 symbols/min [2025-09-30T18:43:55.462218] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-30T18:43:55.577078] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:43:55.577309] [DEBUG] [LOCAL ] FDX: No existing data file found in primary storage. [2025-09-30T18:43:55.577368] [WARN ] [MAIN ] FDX: No existing data found, performing full refresh instead. [2025-09-30T18:43:55.577481] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-30T18:43:55.577523] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-30T18:43:55.577567] [DEBUG] [LOCAL ] FDX: No primary data file found to delete. [2025-09-30T18:43:55.577600] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-30T18:43:55.984231] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:43:56.002485] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T18:43:56.254375] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-30T18:43:56.635729] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T18:43:57.054352] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-30T18:43:57.225298] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-30T18:43:57.854334] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-30T18:43:57.896021] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T18:43:58.654387] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-30T18:43:58.710785] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T18:43:59.454367] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-30T18:44:00.254361] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-30T18:44:00.732987] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-30T18:44:00.831051] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T18:44:00.837404] [INFO ] [REMOTE ] FDP: Full fetch complete (42776 records). [2025-09-30T18:44:00.837498] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-30T18:44:01.062750] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-30T18:44:01.257540] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-30T18:44:01.257691] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-30T18:44:01.258484] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-30T18:44:01.258550] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-30T18:44:01.259772] [DEBUG] [LOCAL ] FDP: Trimmed 42776 records to 30158 (keeping 200 days of data) [2025-09-30T18:44:01.473637] [DEBUG] [LOCAL ] FDP: Primary data saved (30158 records). [2025-09-30T18:44:01.473836] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-30T18:44:01.474465] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FDP took 28.9s. Estimated remaining: 3h 18m 29s. Rate: 7.8 symbols/min [2025-09-30T18:44:01.665637] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:01.726221] [DEBUG] [LOCAL ] FE: Loaded 53427 existing records from primary storage. [2025-09-30T18:44:01.726705] [INFO ] [MAIN ] FE: Loaded 53427 existing records. [2025-09-30T18:44:01.859449] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-30T18:44:01.935517] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:44:01.935876] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-30T18:44:01.936151] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-30T18:44:01.936755] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-30T18:44:01.936819] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-30T18:44:02.337606] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-30T18:44:02.372094] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:02.540021] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T18:44:02.654387] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-30T18:44:03.288877] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T18:44:03.454370] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-30T18:44:04.254350] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-30T18:44:04.433424] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T18:44:04.499504] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T18:44:05.054358] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-30T18:44:05.854375] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-30T18:44:06.417595] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-30T18:44:06.661626] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-30T18:44:06.668022] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-30T18:44:06.679919] [INFO ] [REMOTE ] FCX: Full fetch complete (77350 records). [2025-09-30T18:44:06.680087] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-30T18:44:06.680990] [FATAL] [VALIDATOR ] FCX: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:44:06.681086] [FATAL] [MAIN ] FCX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:44:06.681138] [WARN ] [MAIN ] FCX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:44:06.681216] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-30T18:44:06.681310] [DEBUG] [LOCAL ] FCX: No primary data file found to delete. [2025-09-30T18:44:06.681369] [INFO ] [LOCAL ] FCX: Starting deletion of derivative data. [2025-09-30T18:44:06.681740] [DEBUG] [LOCAL ] FCX: Deleted derivative data file. [2025-09-30T18:44:06.681844] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FCX took 42.7s. Estimated remaining: 3h 18m 17s. Rate: 7.8 symbols/min [2025-09-30T18:44:06.865754] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:06.865956] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-30T18:44:06.865996] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-30T18:44:06.866110] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-30T18:44:06.866152] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-30T18:44:06.866195] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-30T18:44:06.866226] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-30T18:44:07.263856] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:07.442994] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T18:44:07.454308] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-30T18:44:07.974454] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-30T18:44:07.983063] [INFO ] [REMOTE ] FDS: Full fetch complete (37439 records). [2025-09-30T18:44:07.983208] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-30T18:44:08.259547] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-30T18:44:08.383397] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-30T18:44:08.383486] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-30T18:44:08.384104] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-30T18:44:08.384176] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-30T18:44:08.385373] [DEBUG] [LOCAL ] FDS: Trimmed 37439 records to 26508 (keeping 200 days of data) [2025-09-30T18:44:08.556356] [DEBUG] [LOCAL ] FDS: Primary data saved (26508 records). [2025-09-30T18:44:08.556495] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-30T18:44:08.556681] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FDS took 22.7s. Estimated remaining: 3h 17m 58s. Rate: 7.8 symbols/min [2025-09-30T18:44:08.731029] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:08.734311] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-30T18:44:08.795153] [DEBUG] [LOCAL ] FERG: Loaded 48889 existing records from primary storage. [2025-09-30T18:44:08.795602] [INFO ] [MAIN ] FERG: Loaded 48889 existing records. [2025-09-30T18:44:08.992059] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:44:08.992348] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-30T18:44:08.992531] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-30T18:44:08.993206] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-30T18:44:08.993270] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-30T18:44:09.059486] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-30T18:44:09.421306] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:09.423832] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T18:44:09.564424] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-30T18:44:09.854362] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-30T18:44:10.259864] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-30T18:44:10.654377] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-30T18:44:11.454354] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-30T18:44:11.967750] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T18:44:12.254368] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-30T18:44:12.400852] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T18:44:13.054377] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-30T18:44:13.789028] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T18:44:13.854318] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-30T18:44:14.654363] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-30T18:44:14.812002] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T18:44:14.997121] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-30T18:44:15.454358] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-30T18:44:15.935072] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T18:44:16.023334] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-30T18:44:16.254417] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-30T18:44:16.598990] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-30T18:44:17.054386] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-30T18:44:17.854354] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-30T18:44:18.654379] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-30T18:44:18.896552] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T18:44:19.130348] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-30T18:44:19.454325] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-30T18:44:19.570110] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T18:44:20.254385] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-30T18:44:21.054334] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-30T18:44:21.418784] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T18:44:21.854400] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-30T18:44:22.120030] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T18:44:22.654339] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-30T18:44:22.703554] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T18:44:23.454502] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-30T18:44:23.818258] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-30T18:44:23.821348] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T18:44:24.254335] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-30T18:44:24.369521] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T18:44:25.026054] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-30T18:44:25.027275] [INFO ] [REMOTE ] FENG: Full fetch complete (2254 records). [2025-09-30T18:44:25.027411] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-30T18:44:25.060571] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-30T18:44:25.232017] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T18:44:25.232227] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:44:25.232308] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:44:25.232393] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-30T18:44:25.232487] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-30T18:44:25.232561] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-30T18:44:25.232658] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-30T18:44:25.232806] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FENG took 18.6s. Estimated remaining: 3h 18m 8s. Rate: 7.8 symbols/min [2025-09-30T18:44:25.423982] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:25.443763] [DEBUG] [LOCAL ] FET: Loaded 12877 existing records from primary storage. [2025-09-30T18:44:25.444033] [INFO ] [MAIN ] FET: Loaded 12877 existing records. [2025-09-30T18:44:25.636389] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:44:25.636608] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-30T18:44:25.636683] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-30T18:44:25.637201] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-30T18:44:25.637276] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-30T18:44:25.859783] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-30T18:44:26.016632] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:26.654407] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-30T18:44:27.407667] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-30T18:44:27.452974] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:44:27.464095] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-30T18:44:28.254374] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-30T18:44:28.600280] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-30T18:44:29.054427] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-30T18:44:29.596008] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-30T18:44:29.854348] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-30T18:44:30.167448] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T18:44:30.277351] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:44:30.654360] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-30T18:44:31.454351] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-30T18:44:32.178378] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-30T18:44:32.254332] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-30T18:44:32.449042] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T18:44:33.054397] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-30T18:44:33.133855] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T18:44:33.854331] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-30T18:44:34.028741] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:44:34.042341] [INFO ] [REMOTE ] FE: Full fetch complete (77250 records). [2025-09-30T18:44:34.042548] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-30T18:44:34.209535] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:44:34.599973] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-30T18:44:34.600074] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-30T18:44:34.601136] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-30T18:44:34.601230] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-30T18:44:34.603033] [DEBUG] [LOCAL ] FE: Trimmed 77250 records to 53429 (keeping 200 days of data) [2025-09-30T18:44:34.661893] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-30T18:44:34.968607] [DEBUG] [LOCAL ] FE: Primary data saved (53429 records). [2025-09-30T18:44:34.968793] [INFO ] [MAIN ] FE: Full history saved. [2025-09-30T18:44:34.968893] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FE took 33.5s. Estimated remaining: 3h 18m 4s. Rate: 7.8 symbols/min [2025-09-30T18:44:35.152603] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:35.179474] [DEBUG] [LOCAL ] FF: Loaded 25233 existing records from primary storage. [2025-09-30T18:44:35.179816] [INFO ] [MAIN ] FF: Loaded 25233 existing records. [2025-09-30T18:44:35.374614] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:44:35.374899] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-30T18:44:35.375036] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-30T18:44:35.376886] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-30T18:44:35.376957] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-30T18:44:35.459504] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-30T18:44:35.810629] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:35.838468] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-30T18:44:36.256837] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-30T18:44:36.262381] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T18:44:36.607002] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T18:44:36.620053] [INFO ] [REMOTE ] FDX: Full fetch complete (74472 records). [2025-09-30T18:44:36.620209] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-30T18:44:37.046534] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-30T18:44:37.046637] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-30T18:44:37.047830] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-30T18:44:37.047909] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-30T18:44:37.049393] [DEBUG] [LOCAL ] FDX: Trimmed 74472 records to 51595 (keeping 200 days of data) [2025-09-30T18:44:37.108274] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-30T18:44:37.389513] [DEBUG] [LOCAL ] FDX: Primary data saved (51595 records). [2025-09-30T18:44:37.389742] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-30T18:44:37.389828] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FDX took 42.0s. Estimated remaining: 3h 17m 47s. Rate: 7.8 symbols/min [2025-09-30T18:44:37.597210] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:37.599909] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T18:44:37.600081] [DEBUG] [LOCAL ] FFA: No existing data file found in primary storage. [2025-09-30T18:44:37.600293] [WARN ] [MAIN ] FFA: No existing data found, performing full refresh instead. [2025-09-30T18:44:37.606783] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-30T18:44:37.606867] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-30T18:44:37.606937] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-09-30T18:44:37.606978] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-30T18:44:37.859549] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-30T18:44:38.007815] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:38.118843] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T18:44:38.654351] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-30T18:44:38.803071] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T18:44:39.359942] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T18:44:39.454375] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-30T18:44:40.254389] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-30T18:44:40.288232] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T18:44:41.054358] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-30T18:44:41.345288] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:44:41.656107] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T18:44:41.854360] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-30T18:44:42.653284] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T18:44:42.655063] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-30T18:44:43.454370] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-30T18:44:43.680678] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T18:44:44.254413] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-30T18:44:44.426624] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T18:44:45.054367] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-30T18:44:45.820901] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T18:44:45.854311] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-30T18:44:46.184716] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T18:44:46.654376] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-30T18:44:46.672881] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T18:44:47.454339] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-30T18:44:48.227934] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T18:44:48.254308] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-30T18:44:48.501003] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T18:44:49.054331] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-30T18:44:49.332788] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:44:49.854396] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-30T18:44:50.654327] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-30T18:44:50.688209] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T18:44:50.756920] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-30T18:44:51.454375] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-30T18:44:51.807104] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T18:44:52.131987] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T18:44:52.254381] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-30T18:44:53.054360] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-30T18:44:53.854333] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-30T18:44:53.959434] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T18:44:53.975831] [INFO ] [REMOTE ] FERG: Full fetch complete (70974 records). [2025-09-30T18:44:53.976073] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-30T18:44:54.099030] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-30T18:44:54.414008] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-30T18:44:54.414099] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-30T18:44:54.415079] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-30T18:44:54.415186] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-30T18:44:54.416717] [DEBUG] [LOCAL ] FERG: Trimmed 70974 records to 48873 (keeping 200 days of data) [2025-09-30T18:44:54.655057] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-30T18:44:54.743814] [DEBUG] [LOCAL ] FERG: Primary data saved (48873 records). [2025-09-30T18:44:54.743951] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-30T18:44:54.744840] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FERG took 46.2s. Estimated remaining: 3h 17m 57s. Rate: 7.8 symbols/min [2025-09-30T18:44:54.921132] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:54.940978] [DEBUG] [LOCAL ] FFC: Loaded 16759 existing records from primary storage. [2025-09-30T18:44:54.941248] [INFO ] [MAIN ] FFC: Loaded 16759 existing records. [2025-09-30T18:44:55.146421] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:44:55.140715] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T18:44:55.151594] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-30T18:44:55.151691] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-30T18:44:55.152559] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-30T18:44:55.152623] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-30T18:44:55.459482] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-30T18:44:55.539333] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:55.832288] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T18:44:55.836440] [INFO ] [REMOTE ] FET: Full fetch complete (18281 records). [2025-09-30T18:44:55.836532] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-30T18:44:55.962120] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-30T18:44:56.240559] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-30T18:44:56.240636] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-30T18:44:56.241096] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-30T18:44:56.241163] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-30T18:44:56.241783] [DEBUG] [LOCAL ] FET: Trimmed 18281 records to 12840 (keeping 200 days of data) [2025-09-30T18:44:56.279225] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-30T18:44:56.329511] [DEBUG] [LOCAL ] FET: Primary data saved (12840 records). [2025-09-30T18:44:56.329671] [INFO ] [MAIN ] FET: Full history saved. [2025-09-30T18:44:56.329804] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FET took 31.1s. Estimated remaining: 3h 17m 38s. Rate: 7.8 symbols/min [2025-09-30T18:44:56.506266] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:44:56.549688] [DEBUG] [LOCAL ] FFWM: Loaded 35823 existing records from primary storage. [2025-09-30T18:44:56.550177] [INFO ] [MAIN ] FFWM: Loaded 35823 existing records. [2025-09-30T18:44:56.743191] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:44:56.743490] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-30T18:44:56.743544] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-30T18:44:56.744498] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-30T18:44:56.744561] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-30T18:44:57.059536] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-30T18:44:57.135148] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:44:57.241048] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T18:44:57.726478] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-30T18:44:57.854359] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-30T18:44:58.654381] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-30T18:44:59.232525] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T18:44:59.454380] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-30T18:44:59.694493] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T18:45:00.063403] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T18:45:00.254381] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-30T18:45:01.054383] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-30T18:45:01.106136] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T18:45:01.113554] [INFO ] [REMOTE ] FFA: Full fetch complete (8347 records). [2025-09-30T18:45:01.113960] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-30T18:45:01.114534] [FATAL] [VALIDATOR ] FFA: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:45:01.114877] [FATAL] [MAIN ] FFA: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:45:01.114926] [WARN ] [MAIN ] FFA: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:45:01.115010] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-30T18:45:01.115110] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-09-30T18:45:01.115176] [INFO ] [LOCAL ] FFA: Starting deletion of derivative data. [2025-09-30T18:45:01.115254] [DEBUG] [LOCAL ] FFA: No derivative data file found to delete. [2025-09-30T18:45:01.115345] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FFA took 23.7s. Estimated remaining: 3h 17m 25s. Rate: 7.8 symbols/min [2025-09-30T18:45:01.335918] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:01.336175] [DEBUG] [LOCAL ] FG: No existing data file found in primary storage. [2025-09-30T18:45:01.336232] [WARN ] [MAIN ] FG: No existing data found, performing full refresh instead. [2025-09-30T18:45:01.336371] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-30T18:45:01.336427] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-30T18:45:01.336487] [DEBUG] [LOCAL ] FG: No primary data file found to delete. [2025-09-30T18:45:01.336536] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-30T18:45:01.745612] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:01.854352] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-30T18:45:02.554906] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T18:45:02.654398] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-30T18:45:02.686135] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T18:45:03.454363] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-30T18:45:03.567020] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T18:45:04.254397] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-30T18:45:04.655321] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T18:45:05.006561] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T18:45:05.054398] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-30T18:45:05.854377] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-30T18:45:06.481728] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T18:45:06.654395] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-30T18:45:06.776423] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T18:45:07.454359] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-30T18:45:07.649715] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T18:45:08.254399] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-30T18:45:08.828957] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T18:45:09.054414] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-30T18:45:09.073461] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T18:45:09.854373] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-30T18:45:10.429697] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T18:45:10.434358] [INFO ] [REMOTE ] FF: Full fetch complete (36673 records). [2025-09-30T18:45:10.434480] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-30T18:45:10.435123] [FATAL] [VALIDATOR ] FF: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:45:10.435211] [FATAL] [MAIN ] FF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:45:10.435256] [WARN ] [MAIN ] FF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:45:10.435323] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-30T18:45:10.435387] [DEBUG] [LOCAL ] FF: No primary data file found to delete. [2025-09-30T18:45:10.435425] [INFO ] [LOCAL ] FF: Starting deletion of derivative data. [2025-09-30T18:45:10.435733] [DEBUG] [LOCAL ] FF: Deleted derivative data file. [2025-09-30T18:45:10.435873] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FF took 35.5s. Estimated remaining: 3h 17m 21s. Rate: 7.8 symbols/min [2025-09-30T18:45:10.620048] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:10.626864] [DEBUG] [LOCAL ] FGN: Loaded 3865 existing records from primary storage. [2025-09-30T18:45:10.627103] [INFO ] [MAIN ] FGN: Loaded 3865 existing records. [2025-09-30T18:45:10.664690] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-30T18:45:10.830704] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:45:10.831485] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-30T18:45:10.831576] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-30T18:45:10.831941] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-30T18:45:10.832008] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-30T18:45:11.261582] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:11.264557] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T18:45:11.454366] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-30T18:45:11.689418] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T18:45:12.254381] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-30T18:45:12.789176] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T18:45:13.054404] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-30T18:45:13.310913] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T18:45:13.854351] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-30T18:45:14.518592] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T18:45:14.654337] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-30T18:45:14.700457] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T18:45:15.454363] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-30T18:45:15.679621] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T18:45:16.254361] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-30T18:45:16.516290] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T18:45:17.054402] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-30T18:45:17.684484] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T18:45:17.691854] [INFO ] [REMOTE ] FFWM: Full fetch complete (51656 records). [2025-09-30T18:45:17.691994] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-30T18:45:17.861915] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-30T18:45:18.136863] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-30T18:45:18.136969] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-30T18:45:18.137776] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-30T18:45:18.137844] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-30T18:45:18.139109] [DEBUG] [LOCAL ] FFWM: Trimmed 51656 records to 35772 (keeping 200 days of data) [2025-09-30T18:45:18.238933] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T18:45:18.373966] [DEBUG] [LOCAL ] FFWM: Primary data saved (35772 records). [2025-09-30T18:45:18.374126] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-30T18:45:18.374220] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FFWM took 22.0s. Estimated remaining: 3h 17m 14s. Rate: 7.8 symbols/min [2025-09-30T18:45:18.561952] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:18.563264] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-30T18:45:18.563320] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-30T18:45:18.563531] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-30T18:45:18.563586] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-30T18:45:18.563630] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-30T18:45:18.563701] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-30T18:45:18.663535] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-30T18:45:18.961858] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:19.029064] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T18:45:19.454374] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-30T18:45:19.664520] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:45:19.664917] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-30T18:45:19.665030] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:45:19.665101] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-09-30T18:45:19.665246] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:45:19.665322] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-30T18:45:19.665393] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-30T18:45:19.665441] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-30T18:45:19.665491] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-30T18:45:19.665544] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FGSN took 1.3s. Estimated remaining: 3h 16m 54s. Rate: 7.8 symbols/min [2025-09-30T18:45:19.815808] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T18:45:19.872862] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:19.873045] [DEBUG] [LOCAL ] FHI: No existing data file found in primary storage. [2025-09-30T18:45:19.873085] [WARN ] [MAIN ] FHI: No existing data found, performing full refresh instead. [2025-09-30T18:45:19.873197] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-30T18:45:19.873250] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-30T18:45:19.873339] [DEBUG] [LOCAL ] FHI: No primary data file found to delete. [2025-09-30T18:45:19.873394] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-30T18:45:20.255368] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-30T18:45:20.284897] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:21.054334] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-30T18:45:21.366192] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T18:45:21.370394] [INFO ] [REMOTE ] FFC: Full fetch complete (24628 records). [2025-09-30T18:45:21.370545] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-30T18:45:21.371105] [FATAL] [VALIDATOR ] FFC: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:45:21.371187] [FATAL] [MAIN ] FFC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:45:21.371256] [WARN ] [MAIN ] FFC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:45:21.371329] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-30T18:45:21.371398] [DEBUG] [LOCAL ] FFC: No primary data file found to delete. [2025-09-30T18:45:21.371437] [INFO ] [LOCAL ] FFC: Starting deletion of derivative data. [2025-09-30T18:45:21.371827] [DEBUG] [LOCAL ] FFC: Deleted derivative data file. [2025-09-30T18:45:21.371922] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FFC took 26.6s. Estimated remaining: 3h 16m 35s. Rate: 7.9 symbols/min [2025-09-30T18:45:21.566713] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:21.633988] [DEBUG] [LOCAL ] FHN: Loaded 53366 existing records from primary storage. [2025-09-30T18:45:21.634380] [INFO ] [MAIN ] FHN: Loaded 53366 existing records. [2025-09-30T18:45:21.840449] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:45:21.840764] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-30T18:45:21.840817] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-30T18:45:21.842829] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-30T18:45:21.842891] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-30T18:45:21.859541] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-30T18:45:22.269770] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:22.444317] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T18:45:22.654394] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-30T18:45:23.254208] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T18:45:23.454397] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-30T18:45:23.735770] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T18:45:23.816863] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-30T18:45:24.254405] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-30T18:45:25.054401] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-30T18:45:25.460963] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T18:45:25.854434] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-30T18:45:26.388464] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T18:45:26.654421] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-30T18:45:27.403040] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T18:45:27.454391] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-30T18:45:27.662933] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-30T18:45:28.254371] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-30T18:45:29.054341] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-30T18:45:29.198839] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T18:45:29.361257] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T18:45:29.797145] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T18:45:29.854348] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-30T18:45:30.654423] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-30T18:45:31.454386] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-30T18:45:31.512174] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T18:45:32.235176] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:45:32.254306] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-30T18:45:32.290028] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T18:45:33.054359] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-30T18:45:33.854354] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-30T18:45:34.040874] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:45:34.428589] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T18:45:34.504206] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-30T18:45:34.654414] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-30T18:45:35.454410] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-30T18:45:36.167958] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T18:45:36.254380] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-30T18:45:36.385823] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T18:45:36.390489] [INFO ] [REMOTE ] FG: Full fetch complete (27517 records). [2025-09-30T18:45:36.390577] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-30T18:45:36.701484] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-30T18:45:36.798245] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-30T18:45:36.798340] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-30T18:45:36.799005] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-30T18:45:36.799074] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-30T18:45:36.800103] [DEBUG] [LOCAL ] FG: Trimmed 27517 records to 22827 (keeping 200 days of data) [2025-09-30T18:45:36.964168] [DEBUG] [LOCAL ] FG: Primary data saved (22827 records). [2025-09-30T18:45:36.964320] [INFO ] [MAIN ] FG: Full history saved. [2025-09-30T18:45:36.964435] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FG took 35.8s. Estimated remaining: 3h 16m 42s. Rate: 7.8 symbols/min [2025-09-30T18:45:37.059540] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-30T18:45:37.161387] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:37.217735] [DEBUG] [LOCAL ] FI: Loaded 53497 existing records from primary storage. [2025-09-30T18:45:37.218099] [INFO ] [MAIN ] FI: Loaded 53497 existing records. [2025-09-30T18:45:37.446824] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:45:37.447088] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-30T18:45:37.447137] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-30T18:45:37.448637] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-30T18:45:37.448729] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-30T18:45:37.711769] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T18:45:37.839086] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:37.854336] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-30T18:45:38.654367] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-30T18:45:39.454398] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-30T18:45:39.680366] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T18:45:40.046816] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T18:45:40.179034] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T18:45:40.254360] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-30T18:45:41.054423] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-30T18:45:41.525543] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T18:45:41.854372] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-30T18:45:42.001375] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T18:45:42.390230] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-30T18:45:42.654364] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-30T18:45:43.454341] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-30T18:45:44.254378] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-30T18:45:44.346299] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T18:45:44.965136] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T18:45:44.989764] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T18:45:44.990970] [INFO ] [REMOTE ] FGN: Full fetch complete (5733 records). [2025-09-30T18:45:44.991044] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-30T18:45:44.991477] [FATAL] [VALIDATOR ] FGN: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:45:44.991582] [FATAL] [MAIN ] FGN: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:45:44.991631] [WARN ] [MAIN ] FGN: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:45:44.991729] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-30T18:45:44.991839] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-09-30T18:45:44.991880] [INFO ] [LOCAL ] FGN: Starting deletion of derivative data. [2025-09-30T18:45:44.992089] [DEBUG] [LOCAL ] FGN: Deleted derivative data file. [2025-09-30T18:45:44.992193] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FGN took 34.6s. Estimated remaining: 3h 16m 35s. Rate: 7.8 symbols/min [2025-09-30T18:45:45.059550] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-30T18:45:45.180054] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:45.208107] [DEBUG] [LOCAL ] FICO: Loaded 20330 existing records from primary storage. [2025-09-30T18:45:45.208407] [INFO ] [MAIN ] FICO: Loaded 20330 existing records. [2025-09-30T18:45:45.396222] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:45:45.396450] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-30T18:45:45.396497] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-30T18:45:45.397135] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-30T18:45:45.397195] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-30T18:45:45.787918] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:45:45.854319] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-30T18:45:46.654331] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-30T18:45:46.759405] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T18:45:46.941964] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T18:45:47.454412] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-30T18:45:48.259583] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-30T18:45:48.280436] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:45:49.054388] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-30T18:45:49.239151] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T18:45:49.415815] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T18:45:49.854358] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-30T18:45:50.275357] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T18:45:50.654393] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-30T18:45:50.862208] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T18:45:51.454403] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-30T18:45:52.052435] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T18:45:52.254387] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-30T18:45:53.054367] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-30T18:45:53.567902] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-30T18:45:53.754723] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T18:45:53.854373] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-30T18:45:53.894321] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T18:45:54.654405] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-30T18:45:55.459486] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-30T18:45:55.480638] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T18:45:56.254391] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-30T18:45:56.527700] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T18:45:56.642534] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-30T18:45:57.054364] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-30T18:45:57.854390] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-30T18:45:58.079769] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T18:45:58.654336] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-30T18:45:58.681442] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T18:45:58.690848] [INFO ] [REMOTE ] FHI: Full fetch complete (57737 records). [2025-09-30T18:45:58.691018] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-30T18:45:59.145914] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-30T18:45:59.146082] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-30T18:45:59.147037] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-30T18:45:59.147170] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-30T18:45:59.148667] [DEBUG] [LOCAL ] FHI: Trimmed 57737 records to 40285 (keeping 200 days of data) [2025-09-30T18:45:59.287256] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T18:45:59.437454] [DEBUG] [LOCAL ] FHI: Primary data saved (40285 records). [2025-09-30T18:45:59.437588] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-30T18:45:59.437693] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FHI took 39.8s. Estimated remaining: 3h 16m 40s. Rate: 7.8 symbols/min [2025-09-30T18:45:59.459538] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-30T18:45:59.635997] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:45:59.636213] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-30T18:45:59.636264] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-30T18:45:59.636392] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-30T18:45:59.636437] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-30T18:45:59.636482] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-30T18:45:59.636519] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-30T18:46:00.009531] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:00.254371] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-30T18:46:00.546309] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T18:46:00.644183] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-30T18:46:01.054386] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-30T18:46:01.243536] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-30T18:46:01.306287] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-30T18:46:01.854370] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-30T18:46:02.654377] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-30T18:46:03.454400] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-30T18:46:03.662051] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T18:46:03.676062] [INFO ] [REMOTE ] FHN: Full fetch complete (77280 records). [2025-09-30T18:46:03.676213] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-30T18:46:03.759720] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-30T18:46:04.122638] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-30T18:46:04.122867] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-30T18:46:04.123955] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-30T18:46:04.124092] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-30T18:46:04.143823] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T18:46:04.144026] [DEBUG] [LOCAL ] FHN: Trimmed 77280 records to 53366 (keeping 200 days of data) [2025-09-30T18:46:04.260886] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-30T18:46:04.542822] [DEBUG] [LOCAL ] FHN: Primary data saved (53366 records). [2025-09-30T18:46:04.543007] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-30T18:46:04.543758] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FHN took 43.2s. Estimated remaining: 3h 16m 28s. Rate: 7.8 symbols/min [2025-09-30T18:46:04.781801] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:46:04.835877] [DEBUG] [LOCAL ] FIGS: Loaded 48861 existing records from primary storage. [2025-09-30T18:46:04.836219] [INFO ] [MAIN ] FIGS: Loaded 48861 existing records. [2025-09-30T18:46:05.028007] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:46:05.028281] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-30T18:46:05.028344] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-30T18:46:05.029459] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-30T18:46:05.029523] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-30T18:46:05.060926] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-30T18:46:05.469168] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:05.854348] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-30T18:46:05.911955] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T18:46:06.323789] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-30T18:46:06.347681] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T18:46:06.654348] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-30T18:46:07.454370] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-30T18:46:07.796661] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-30T18:46:08.254342] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-30T18:46:08.830430] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-30T18:46:08.842706] [INFO ] [REMOTE ] FI: Full fetch complete (77169 records). [2025-09-30T18:46:08.842890] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-30T18:46:09.059569] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-30T18:46:09.269942] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-30T18:46:09.270043] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-30T18:46:09.271041] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-30T18:46:09.271112] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-30T18:46:09.272783] [DEBUG] [LOCAL ] FI: Trimmed 77169 records to 53499 (keeping 200 days of data) [2025-09-30T18:46:09.496032] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-30T18:46:09.625073] [DEBUG] [LOCAL ] FI: Primary data saved (53499 records). [2025-09-30T18:46:09.625231] [INFO ] [MAIN ] FI: Full history saved. [2025-09-30T18:46:09.625346] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FI took 32.7s. Estimated remaining: 3h 16m 16s. Rate: 7.8 symbols/min [2025-09-30T18:46:09.809435] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:46:09.848325] [DEBUG] [LOCAL ] FIHL: Loaded 39998 existing records from primary storage. [2025-09-30T18:46:09.848628] [INFO ] [MAIN ] FIHL: Loaded 39998 existing records. [2025-09-30T18:46:09.859918] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-30T18:46:10.047544] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:46:10.047937] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-30T18:46:10.048028] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-30T18:46:10.058531] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-30T18:46:10.066003] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-30T18:46:10.150854] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T18:46:10.494728] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:10.654380] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-30T18:46:11.001885] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T18:46:11.006415] [INFO ] [REMOTE ] FICO: Full fetch complete (28409 records). [2025-09-30T18:46:11.006534] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-30T18:46:11.425679] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-30T18:46:11.425783] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-30T18:46:11.426455] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-30T18:46:11.426518] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-30T18:46:11.427632] [DEBUG] [LOCAL ] FICO: Trimmed 28409 records to 20420 (keeping 200 days of data) [2025-09-30T18:46:11.488474] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-30T18:46:11.574183] [DEBUG] [LOCAL ] FICO: Primary data saved (20420 records). [2025-09-30T18:46:11.574328] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-30T18:46:11.574415] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FICO took 26.6s. Estimated remaining: 3h 15m 57s. Rate: 7.8 symbols/min [2025-09-30T18:46:11.778575] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:46:11.801509] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T18:46:11.815686] [DEBUG] [LOCAL ] FINS: Loaded 8262 existing records from primary storage. [2025-09-30T18:46:11.815930] [INFO ] [MAIN ] FINS: Loaded 8262 existing records. [2025-09-30T18:46:12.024516] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:46:12.024796] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-30T18:46:12.024848] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-30T18:46:12.025096] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-30T18:46:12.025156] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-30T18:46:12.259768] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-30T18:46:12.423216] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:12.571569] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:46:12.571982] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-30T18:46:12.572097] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:46:12.572199] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-09-30T18:46:12.572283] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:46:12.572376] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-30T18:46:12.572460] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-30T18:46:12.572527] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-30T18:46:12.572618] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-30T18:46:12.572735] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FIG took 13.1s. Estimated remaining: 3h 15m 38s. Rate: 7.9 symbols/min [2025-09-30T18:46:12.777682] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:46:12.826912] [DEBUG] [LOCAL ] FINV: Loaded 45191 existing records from primary storage. [2025-09-30T18:46:12.827605] [INFO ] [MAIN ] FINV: Loaded 45191 existing records. [2025-09-30T18:46:13.061382] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:46:13.057889] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-30T18:46:13.062594] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-30T18:46:13.062779] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-30T18:46:13.063310] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-30T18:46:13.063422] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-30T18:46:13.378490] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T18:46:13.560849] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:13.854348] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-30T18:46:13.977532] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T18:46:14.654371] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-30T18:46:15.084391] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T18:46:15.454359] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-30T18:46:16.064200] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T18:46:16.254413] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-30T18:46:16.516522] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T18:46:17.054389] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-30T18:46:17.420958] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:46:17.854598] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-30T18:46:18.518989] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T18:46:18.575312] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T18:46:18.654433] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-30T18:46:19.454395] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-30T18:46:20.068074] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T18:46:20.254353] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-30T18:46:20.424533] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T18:46:20.847915] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T18:46:21.054406] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-30T18:46:21.854400] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-30T18:46:22.353638] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-30T18:46:22.600347] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T18:46:22.654374] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-30T18:46:23.410801] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T18:46:23.454382] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-30T18:46:24.254411] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-30T18:46:24.774600] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:46:25.054380] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-30T18:46:25.542954] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-30T18:46:25.699172] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T18:46:25.854398] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-30T18:46:26.654412] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-30T18:46:27.461016] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-30T18:46:27.466791] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T18:46:28.153114] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T18:46:28.189049] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T18:46:28.254310] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-30T18:46:29.054421] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-30T18:46:29.854383] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-30T18:46:29.982868] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T18:46:30.477354] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T18:46:30.654358] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-30T18:46:30.834081] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T18:46:31.454426] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-30T18:46:32.254324] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-30T18:46:32.372230] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T18:46:32.712621] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:46:33.054387] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-30T18:46:33.836337] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:46:33.854348] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-30T18:46:34.351349] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T18:46:34.362143] [INFO ] [REMOTE ] FINV: Full fetch complete (63519 records). [2025-09-30T18:46:34.362308] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-30T18:46:34.659603] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-30T18:46:34.785739] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-30T18:46:34.785845] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-30T18:46:34.786808] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-30T18:46:34.786886] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-30T18:46:34.788343] [DEBUG] [LOCAL ] FINV: Trimmed 63519 records to 45240 (keeping 200 days of data) [2025-09-30T18:46:35.065120] [DEBUG] [LOCAL ] FINV: Primary data saved (45240 records). [2025-09-30T18:46:35.065277] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-30T18:46:35.065400] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FINV took 22.5s. Estimated remaining: 3h 15m 57s. Rate: 7.8 symbols/min [2025-09-30T18:46:35.265140] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:46:35.327420] [DEBUG] [LOCAL ] FIS: Loaded 53364 existing records from primary storage. [2025-09-30T18:46:35.327898] [INFO ] [MAIN ] FIS: Loaded 53364 existing records. [2025-09-30T18:46:35.461289] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-30T18:46:35.536994] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:46:35.545173] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-30T18:46:35.544946] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T18:46:35.545504] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-30T18:46:35.576959] [INFO ] [REMOTE ] FINS: Full fetch complete (12395 records). [2025-09-30T18:46:35.577258] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-30T18:46:35.577517] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-30T18:46:35.606690] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-30T18:46:35.614228] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T18:46:36.265301] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-30T18:46:36.417562] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-30T18:46:36.424867] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-30T18:46:36.439124] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-30T18:46:36.492459] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:36.492930] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-30T18:46:36.494462] [DEBUG] [LOCAL ] FINS: Trimmed 12395 records to 8282 (keeping 200 days of data) [2025-09-30T18:46:36.553818] [DEBUG] [LOCAL ] FINS: Primary data saved (8282 records). [2025-09-30T18:46:36.553976] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-30T18:46:36.554109] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINS took 25.0s. Estimated remaining: 3h 15m 38s. Rate: 7.8 symbols/min [2025-09-30T18:46:36.740670] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:46:36.797693] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T18:46:36.796527] [DEBUG] [LOCAL ] FIX: Loaded 30013 existing records from primary storage. [2025-09-30T18:46:36.806128] [INFO ] [MAIN ] FIX: Loaded 30013 existing records. [2025-09-30T18:46:37.003250] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:46:37.003539] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-30T18:46:37.003609] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-30T18:46:37.003920] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-30T18:46:37.004002] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-30T18:46:37.059476] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-30T18:46:37.478582] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:46:37.854372] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-30T18:46:37.991490] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T18:46:38.654389] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-30T18:46:38.865544] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T18:46:38.894121] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T18:46:39.454378] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-30T18:46:40.262230] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-30T18:46:40.264250] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T18:46:40.951619] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T18:46:41.054369] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-30T18:46:41.854379] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-30T18:46:42.113160] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T18:46:42.610419] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T18:46:42.654346] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-30T18:46:43.395041] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T18:46:43.454365] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-30T18:46:44.007155] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:46:44.254403] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-30T18:46:44.938465] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T18:46:44.947322] [INFO ] [REMOTE ] FIHL: Full fetch complete (55755 records). [2025-09-30T18:46:44.947454] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-30T18:46:45.057010] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-30T18:46:45.377265] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-30T18:46:45.377435] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-30T18:46:45.379817] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-30T18:46:45.379903] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-30T18:46:45.382071] [DEBUG] [LOCAL ] FIHL: Trimmed 55755 records to 39905 (keeping 200 days of data) [2025-09-30T18:46:45.655298] [DEBUG] [LOCAL ] FIHL: Primary data saved (39905 records). [2025-09-30T18:46:45.655508] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-30T18:46:45.655701] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FIHL took 36.0s. Estimated remaining: 3h 15m 33s. Rate: 7.8 symbols/min [2025-09-30T18:46:45.854435] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-30T18:46:45.956618] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T18:46:46.662521] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-30T18:46:46.693389] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T18:46:47.214339] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T18:46:47.454390] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-30T18:46:48.088449] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T18:46:48.099883] [INFO ] [REMOTE ] FIGS: Full fetch complete (71056 records). [2025-09-30T18:46:48.100102] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-30T18:46:48.268861] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-30T18:46:48.547350] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-30T18:46:48.547440] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-30T18:46:48.548446] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-30T18:46:48.548518] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-30T18:46:48.550125] [DEBUG] [LOCAL ] FIGS: Trimmed 71056 records to 48853 (keeping 200 days of data) [2025-09-30T18:46:48.821556] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T18:46:48.907494] [DEBUG] [LOCAL ] FIGS: Primary data saved (48853 records). [2025-09-30T18:46:48.907708] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-30T18:46:48.908702] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FIGS took 44.4s. Estimated remaining: 3h 15m 18s. Rate: 7.8 symbols/min [2025-09-30T18:46:49.054377] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-30T18:46:49.730124] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T18:46:49.854394] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-30T18:46:50.891955] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T18:46:50.906405] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-30T18:46:51.373219] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:46:51.454351] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-30T18:46:52.631404] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T18:46:52.637576] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-30T18:46:52.813587] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T18:46:53.054370] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-30T18:46:53.990154] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:46:53.996907] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-30T18:46:54.540981] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T18:46:54.654405] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-30T18:46:55.324049] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T18:46:55.454384] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-30T18:46:56.108208] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T18:46:56.254361] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-30T18:46:56.902993] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T18:46:56.909483] [INFO ] [REMOTE ] FIX: Full fetch complete (45552 records). [2025-09-30T18:46:56.909679] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-30T18:46:57.316057] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-30T18:46:57.316158] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-30T18:46:57.316895] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-30T18:46:57.316960] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-30T18:46:57.318033] [DEBUG] [LOCAL ] FIX: Trimmed 45552 records to 29896 (keeping 200 days of data) [2025-09-30T18:46:57.533706] [DEBUG] [LOCAL ] FIX: Primary data saved (29896 records). [2025-09-30T18:46:57.533862] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-30T18:46:57.533994] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIX took 21.0s. Estimated remaining: 3h 15m 12s. Rate: 7.8 symbols/min [2025-09-30T18:46:58.110674] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T18:46:58.125173] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-30T18:46:59.961705] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T18:46:59.973383] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-30T18:47:02.065942] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-30T18:47:02.078366] [INFO ] [REMOTE ] FIS: Full fetch complete (77175 records). [2025-09-30T18:47:02.078550] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-30T18:47:02.518946] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-30T18:47:02.519086] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-30T18:47:02.520119] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-30T18:47:02.520200] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-30T18:47:02.522024] [DEBUG] [LOCAL ] FIS: Trimmed 77175 records to 53363 (keeping 200 days of data) [2025-09-30T18:47:02.885087] [DEBUG] [LOCAL ] FIS: Primary data saved (53363 records). [2025-09-30T18:47:02.885263] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-30T18:47:02.885404] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIS took 27.8s. Estimated remaining: 3h 14m 60s. Rate: 7.9 symbols/min [2025-09-30T18:47:03.482820] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:03.560415] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-30T18:47:03.560742] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-30T18:47:03.606412] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-30T18:47:03.619836] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-30T18:47:03.632753] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:03.647348] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-30T18:47:03.668164] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-30T18:47:03.677481] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:03.745013] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:03.891606] [DEBUG] [LOCAL ] FLC: Loaded 5476 existing records from primary storage. [2025-09-30T18:47:03.926979] [INFO ] [MAIN ] FLC: Loaded 5476 existing records. [2025-09-30T18:47:04.031601] [DEBUG] [LOCAL ] FLNG: Loaded 33774 existing records from primary storage. [2025-09-30T18:47:04.049047] [INFO ] [MAIN ] FLNG: Loaded 33774 existing records. [2025-09-30T18:47:04.402403] [DEBUG] [LOCAL ] FLG: Loaded 53325 existing records from primary storage. [2025-09-30T18:47:04.451003] [INFO ] [MAIN ] FLG: Loaded 53325 existing records. [2025-09-30T18:47:04.445468] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:04.451236] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-30T18:47:04.493278] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-30T18:47:04.637091] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-30T18:47:04.664167] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:04.679423] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-30T18:47:04.687139] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-30T18:47:04.745720] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-30T18:47:04.765566] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:04.827875] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-30T18:47:04.828070] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-30T18:47:04.845069] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-30T18:47:05.022120] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:05.131992] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:47:05.108681] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-30T18:47:05.168023] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-30T18:47:05.179161] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-30T18:47:05.193818] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:47:05.256526] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-30T18:47:05.261918] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-30T18:47:05.246144] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-09-30T18:47:05.315903] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:47:05.416277] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-30T18:47:05.515716] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-30T18:47:05.531381] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-30T18:47:05.651713] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-30T18:47:05.716201] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FIXT took 2.8s. Estimated remaining: 3h 14m 44s. Rate: 7.9 symbols/min [2025-09-30T18:47:05.716001] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:05.774736] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-30T18:47:06.037487] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:06.059696] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-30T18:47:06.230750] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:06.318030] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:06.318530] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-30T18:47:06.369690] [DEBUG] [LOCAL ] FLO: Loaded 51900 existing records from primary storage. [2025-09-30T18:47:06.370028] [INFO ] [MAIN ] FLO: Loaded 51900 existing records. [2025-09-30T18:47:06.567997] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:06.568390] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-30T18:47:06.568448] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-30T18:47:06.568991] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-30T18:47:06.569117] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-30T18:47:06.700414] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T18:47:06.740297] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-30T18:47:06.992107] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:06.992453] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-30T18:47:07.437325] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-30T18:47:07.440121] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-30T18:47:07.607279] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T18:47:07.616044] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-30T18:47:07.777446] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T18:47:07.779103] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-30T18:47:08.180762] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T18:47:08.192820] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-30T18:47:08.339315] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T18:47:08.341289] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-30T18:47:08.698040] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-30T18:47:08.705791] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-30T18:47:08.742017] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T18:47:08.752824] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-30T18:47:08.799177] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T18:47:09.054357] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-30T18:47:09.805853] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T18:47:09.859486] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-30T18:47:09.878874] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:47:10.170807] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-30T18:47:10.330424] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T18:47:10.534106] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T18:47:10.654421] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-30T18:47:11.454381] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-30T18:47:12.053910] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T18:47:12.227287] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T18:47:12.254331] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-30T18:47:13.054409] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-30T18:47:13.779569] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T18:47:13.813285] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T18:47:13.854367] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-30T18:47:14.654426] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-30T18:47:14.742001] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T18:47:14.743854] [INFO ] [REMOTE ] FLC: Full fetch complete (7981 records). [2025-09-30T18:47:14.744003] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-30T18:47:15.144100] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-30T18:47:15.144216] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-30T18:47:15.144549] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-30T18:47:15.144614] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-30T18:47:15.145116] [DEBUG] [LOCAL ] FLC: Trimmed 7981 records to 5462 (keeping 200 days of data) [2025-09-30T18:47:15.182725] [DEBUG] [LOCAL ] FLC: Primary data saved (5462 records). [2025-09-30T18:47:15.182883] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-30T18:47:15.183034] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLC took 12.3s. Estimated remaining: 3h 14m 39s. Rate: 7.9 symbols/min [2025-09-30T18:47:15.392077] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:15.392328] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-30T18:47:15.392381] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-30T18:47:15.392501] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-30T18:47:15.392544] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-30T18:47:15.392587] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-30T18:47:15.392620] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-30T18:47:15.459610] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-30T18:47:15.816785] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:16.254361] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-30T18:47:16.324068] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T18:47:17.054355] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-30T18:47:17.107481] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T18:47:17.235113] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T18:47:17.854394] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-30T18:47:18.063944] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T18:47:18.064274] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-30T18:47:18.064384] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:47:18.064447] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-09-30T18:47:18.064558] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:47:18.064637] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-30T18:47:18.064745] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-30T18:47:18.064786] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-30T18:47:18.064827] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-30T18:47:18.064878] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLOC took 2.9s. Estimated remaining: 3h 14m 23s. Rate: 7.9 symbols/min [2025-09-30T18:47:18.260585] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:18.324154] [DEBUG] [LOCAL ] FLR: Loaded 53111 existing records from primary storage. [2025-09-30T18:47:18.324582] [INFO ] [MAIN ] FLR: Loaded 53111 existing records. [2025-09-30T18:47:18.522861] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:18.523850] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-30T18:47:18.523910] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-30T18:47:18.524820] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-30T18:47:18.524882] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-30T18:47:18.659502] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-30T18:47:18.920747] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:18.962352] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T18:47:19.454387] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-30T18:47:20.254325] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-30T18:47:20.343529] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T18:47:21.054399] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-30T18:47:21.326010] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T18:47:21.620930] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T18:47:21.854386] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-30T18:47:22.654354] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-30T18:47:22.697139] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-30T18:47:22.759885] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-30T18:47:23.454353] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-30T18:47:24.254348] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-30T18:47:24.372763] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T18:47:24.816353] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T18:47:25.054404] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-30T18:47:25.772968] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:47:25.854387] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-30T18:47:26.527632] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T18:47:26.654368] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-30T18:47:27.454383] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-30T18:47:27.624572] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T18:47:28.254369] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-30T18:47:28.465054] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T18:47:28.943520] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T18:47:29.054388] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-30T18:47:29.683098] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T18:47:29.854380] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-30T18:47:30.408303] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T18:47:30.654395] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-30T18:47:31.454354] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-30T18:47:31.815270] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T18:47:31.922276] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T18:47:31.931120] [INFO ] [REMOTE ] FLNG: Full fetch complete (50703 records). [2025-09-30T18:47:31.931292] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-30T18:47:32.259564] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-30T18:47:32.386736] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-30T18:47:32.386840] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-30T18:47:32.387780] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-30T18:47:32.387896] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-30T18:47:32.389216] [DEBUG] [LOCAL ] FLNG: Trimmed 50703 records to 33756 (keeping 200 days of data) [2025-09-30T18:47:32.610483] [DEBUG] [LOCAL ] FLNG: Primary data saved (33756 records). [2025-09-30T18:47:32.610738] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-30T18:47:32.610894] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLNG took 29.7s. Estimated remaining: 3h 14m 28s. Rate: 7.9 symbols/min [2025-09-30T18:47:32.794673] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:32.844896] [DEBUG] [LOCAL ] FLS: Loaded 50154 existing records from primary storage. [2025-09-30T18:47:32.845223] [INFO ] [MAIN ] FLS: Loaded 50154 existing records. [2025-09-30T18:47:33.045619] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:33.045872] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-30T18:47:33.045919] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-30T18:47:33.046478] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-30T18:47:33.046536] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-30T18:47:33.069525] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-30T18:47:33.453720] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:33.484189] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-30T18:47:33.854339] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-30T18:47:34.130132] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T18:47:34.654387] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-30T18:47:34.819825] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T18:47:34.834565] [INFO ] [REMOTE ] FLG: Full fetch complete (77297 records). [2025-09-30T18:47:34.834807] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-30T18:47:35.311359] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-30T18:47:35.311616] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-30T18:47:35.312627] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-30T18:47:35.312738] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-30T18:47:35.315038] [DEBUG] [LOCAL ] FLG: Trimmed 77297 records to 53321 (keeping 200 days of data) [2025-09-30T18:47:35.451210] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T18:47:35.461571] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-30T18:47:35.752336] [DEBUG] [LOCAL ] FLG: Primary data saved (53321 records). [2025-09-30T18:47:35.752538] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-30T18:47:35.752875] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLG took 32.9s. Estimated remaining: 3h 14m 12s. Rate: 7.9 symbols/min [2025-09-30T18:47:35.976886] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:36.032030] [DEBUG] [LOCAL ] FLUT: Loaded 50763 existing records from primary storage. [2025-09-30T18:47:36.032440] [INFO ] [MAIN ] FLUT: Loaded 50763 existing records. [2025-09-30T18:47:36.240095] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:36.240329] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-30T18:47:36.240381] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-30T18:47:36.240778] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-30T18:47:36.240839] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-30T18:47:36.286373] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-30T18:47:36.626193] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:36.698475] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T18:47:36.711475] [INFO ] [REMOTE ] FLO: Full fetch complete (74633 records). [2025-09-30T18:47:36.711715] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-30T18:47:36.712892] [FATAL] [VALIDATOR ] FLO: Data is stale - most recent date (2025-09-29) is before last completed trading day (2025-09-30). Symbol may be delisted or halted. [2025-09-30T18:47:36.713002] [FATAL] [MAIN ] FLO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:47:36.713056] [WARN ] [MAIN ] FLO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:47:36.713111] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-30T18:47:36.713185] [DEBUG] [LOCAL ] FLO: No primary data file found to delete. [2025-09-30T18:47:36.713230] [INFO ] [LOCAL ] FLO: Starting deletion of derivative data. [2025-09-30T18:47:36.713589] [DEBUG] [LOCAL ] FLO: Deleted derivative data file. [2025-09-30T18:47:36.713753] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLO took 31.0s. Estimated remaining: 3h 13m 52s. Rate: 7.9 symbols/min [2025-09-30T18:47:36.922625] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:36.959062] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T18:47:36.985675] [DEBUG] [LOCAL ] FLXR: Loaded 20158 existing records from primary storage. [2025-09-30T18:47:36.985982] [INFO ] [MAIN ] FLXR: Loaded 20158 existing records. [2025-09-30T18:47:37.059479] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-30T18:47:37.188285] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:37.188519] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-30T18:47:37.188568] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-30T18:47:37.188822] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-30T18:47:37.188882] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-30T18:47:37.573015] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:37.603389] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:47:37.854372] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-30T18:47:38.654363] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-30T18:47:38.861294] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T18:47:39.423883] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T18:47:39.453624] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T18:47:39.454516] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-30T18:47:40.254353] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-30T18:47:41.054331] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-30T18:47:41.272348] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T18:47:41.794697] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T18:47:41.854344] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-30T18:47:42.207354] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-30T18:47:42.654368] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-30T18:47:43.454415] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-30T18:47:43.531829] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T18:47:44.254398] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-30T18:47:44.398956] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T18:47:44.813864] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T18:47:45.041928] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T18:47:45.054334] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-30T18:47:45.854388] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-30T18:47:46.038334] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T18:47:46.654364] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-30T18:47:47.454358] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-30T18:47:47.601563] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-30T18:47:48.242802] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T18:47:48.254682] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-30T18:47:49.054332] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-30T18:47:49.126293] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T18:47:49.215880] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T18:47:49.854355] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-30T18:47:50.654360] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-30T18:47:50.855104] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T18:47:51.063568] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-30T18:47:51.454357] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-30T18:47:52.217168] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T18:47:52.254348] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-30T18:47:52.561889] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T18:47:53.054374] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-30T18:47:53.854348] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-30T18:47:54.102820] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T18:47:54.654373] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-30T18:47:54.782729] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T18:47:55.418688] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T18:47:55.430828] [INFO ] [REMOTE ] FLR: Full fetch complete (76385 records). [2025-09-30T18:47:55.431002] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-30T18:47:55.465693] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-30T18:47:55.854334] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T18:47:55.882816] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-30T18:47:55.883201] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-30T18:47:55.884234] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-30T18:47:55.884313] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-30T18:47:55.885793] [DEBUG] [LOCAL ] FLR: Trimmed 76385 records to 53116 (keeping 200 days of data) [2025-09-30T18:47:56.223052] [DEBUG] [LOCAL ] FLR: Primary data saved (53116 records). [2025-09-30T18:47:56.223210] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-30T18:47:56.223888] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLR took 38.2s. Estimated remaining: 3h 14m 6s. Rate: 7.9 symbols/min [2025-09-30T18:47:56.259468] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-30T18:47:56.411450] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:47:56.462101] [DEBUG] [LOCAL ] FMC: Loaded 51780 existing records from primary storage. [2025-09-30T18:47:56.462413] [INFO ] [MAIN ] FMC: Loaded 51780 existing records. [2025-09-30T18:47:56.653896] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:47:56.654126] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-30T18:47:56.654172] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-30T18:47:56.654551] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-30T18:47:56.654611] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-30T18:47:57.050716] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:47:57.064940] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-30T18:47:57.088055] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T18:47:57.854372] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-30T18:47:58.182484] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T18:47:58.654372] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-30T18:47:59.104219] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-30T18:47:59.209350] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T18:47:59.454351] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-30T18:48:00.254347] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-30T18:48:00.476849] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T18:48:01.054512] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-30T18:48:01.090510] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T18:48:01.102055] [INFO ] [REMOTE ] FLS: Full fetch complete (71525 records). [2025-09-30T18:48:01.102222] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-30T18:48:01.301251] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T18:48:01.548513] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-30T18:48:01.548608] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-30T18:48:01.549557] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-30T18:48:01.549622] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-30T18:48:01.551271] [DEBUG] [LOCAL ] FLS: Trimmed 71525 records to 50162 (keeping 200 days of data) [2025-09-30T18:48:01.854589] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-30T18:48:01.870147] [DEBUG] [LOCAL ] FLS: Primary data saved (50162 records). [2025-09-30T18:48:01.870289] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-30T18:48:01.870373] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLS took 29.3s. Estimated remaining: 3h 13m 55s. Rate: 7.9 symbols/min [2025-09-30T18:48:02.060865] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:02.069412] [DEBUG] [LOCAL ] FMN: Loaded 5776 existing records from primary storage. [2025-09-30T18:48:02.069629] [INFO ] [MAIN ] FMN: Loaded 5776 existing records. [2025-09-30T18:48:02.266750] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:02.266980] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-30T18:48:02.267076] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-30T18:48:02.267318] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-30T18:48:02.267391] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-30T18:48:02.654631] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-30T18:48:02.678387] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:02.866875] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T18:48:03.199199] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T18:48:03.206282] [INFO ] [REMOTE ] FLXR: Full fetch complete (25415 records). [2025-09-30T18:48:03.206453] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-30T18:48:03.459681] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-30T18:48:03.840363] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-30T18:48:03.840547] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-30T18:48:03.841707] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-30T18:48:03.841795] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-30T18:48:03.843283] [DEBUG] [LOCAL ] FLXR: Trimmed 25415 records to 20265 (keeping 200 days of data) [2025-09-30T18:48:04.046959] [DEBUG] [LOCAL ] FLXR: Primary data saved (20265 records). [2025-09-30T18:48:04.047246] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-30T18:48:04.047476] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLXR took 27.3s. Estimated remaining: 3h 13m 37s. Rate: 7.9 symbols/min [2025-09-30T18:48:04.260955] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-30T18:48:04.275327] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:04.314931] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T18:48:04.348464] [DEBUG] [LOCAL ] FMS: Loaded 30196 existing records from primary storage. [2025-09-30T18:48:04.348778] [INFO ] [MAIN ] FMS: Loaded 30196 existing records. [2025-09-30T18:48:04.544244] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:04.544482] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-30T18:48:04.544530] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-30T18:48:04.544871] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-30T18:48:04.544930] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-30T18:48:04.929712] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:05.036790] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-30T18:48:05.054335] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-30T18:48:05.303640] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T18:48:05.837413] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T18:48:05.854300] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-30T18:48:06.605981] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T18:48:06.654359] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-30T18:48:07.444834] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-30T18:48:07.454302] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-30T18:48:07.971424] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-30T18:48:08.254413] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-30T18:48:09.054376] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-30T18:48:09.471067] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:48:09.854384] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-30T18:48:10.658582] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-30T18:48:10.665474] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T18:48:11.454324] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-30T18:48:11.573376] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T18:48:11.623982] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T18:48:11.791963] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-30T18:48:12.254379] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-30T18:48:13.054453] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-30T18:48:13.854369] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-30T18:48:14.015546] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T18:48:14.624733] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T18:48:14.654362] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-30T18:48:14.954245] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T18:48:14.965439] [INFO ] [REMOTE ] FLUT: Full fetch complete (72794 records). [2025-09-30T18:48:14.965741] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-30T18:48:15.403151] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-30T18:48:15.403356] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-30T18:48:15.404332] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-30T18:48:15.404401] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-30T18:48:15.406064] [DEBUG] [LOCAL ] FLUT: Trimmed 72794 records to 50769 (keeping 200 days of data) [2025-09-30T18:48:15.461130] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-30T18:48:15.783225] [DEBUG] [LOCAL ] FLUT: Primary data saved (50769 records). [2025-09-30T18:48:15.783384] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-30T18:48:15.783512] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLUT took 40.0s. Estimated remaining: 3h 13m 37s. Rate: 7.9 symbols/min [2025-09-30T18:48:15.961785] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T18:48:16.000828] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:16.044149] [DEBUG] [LOCAL ] FMX: Loaded 40666 existing records from primary storage. [2025-09-30T18:48:16.044469] [INFO ] [MAIN ] FMX: Loaded 40666 existing records. [2025-09-30T18:48:16.164328] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T18:48:16.257577] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-30T18:48:16.261165] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:16.262527] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-30T18:48:16.262585] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-30T18:48:16.263093] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-30T18:48:16.263173] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-30T18:48:16.661130] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:16.999884] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T18:48:17.054397] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-30T18:48:17.854378] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-30T18:48:17.872668] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T18:48:17.874337] [INFO ] [REMOTE ] FMN: Full fetch complete (10022 records). [2025-09-30T18:48:17.874412] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-30T18:48:18.307017] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-30T18:48:18.307100] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-30T18:48:18.307359] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-30T18:48:18.307399] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-30T18:48:18.308026] [DEBUG] [LOCAL ] FMN: Trimmed 10022 records to 5711 (keeping 200 days of data) [2025-09-30T18:48:18.344743] [DEBUG] [LOCAL ] FMN: Primary data saved (5711 records). [2025-09-30T18:48:18.344878] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-30T18:48:18.344967] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMN took 16.5s. Estimated remaining: 3h 13m 20s. Rate: 7.9 symbols/min [2025-09-30T18:48:18.528786] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:18.533141] [DEBUG] [LOCAL ] FMY: Loaded 1400 existing records from primary storage. [2025-09-30T18:48:18.533347] [INFO ] [MAIN ] FMY: Loaded 1400 existing records. [2025-09-30T18:48:18.659467] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-30T18:48:18.737579] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:18.737991] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-30T18:48:18.738111] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-30T18:48:18.738412] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-30T18:48:18.738489] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-30T18:48:19.168045] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:19.454351] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-30T18:48:19.601814] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T18:48:19.721828] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-30T18:48:20.161309] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T18:48:20.254444] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-30T18:48:21.054400] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-30T18:48:21.413360] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-30T18:48:21.854368] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-30T18:48:22.122869] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T18:48:22.654423] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-30T18:48:22.924969] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-30T18:48:23.454359] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-30T18:48:24.036568] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T18:48:24.254403] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-30T18:48:24.719798] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T18:48:24.946906] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T18:48:25.054384] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-30T18:48:25.854385] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-30T18:48:26.230059] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-30T18:48:26.229929] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T18:48:26.654410] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-30T18:48:27.085633] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T18:48:27.454408] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-30T18:48:28.254327] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-30T18:48:28.561421] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T18:48:28.626660] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-30T18:48:29.054412] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-30T18:48:29.854360] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-30T18:48:30.493503] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T18:48:30.654412] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-30T18:48:31.454376] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-30T18:48:31.596980] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T18:48:31.818744] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-30T18:48:31.911344] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T18:48:32.254370] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-30T18:48:33.054393] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-30T18:48:33.505706] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T18:48:33.854418] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-30T18:48:34.047200] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T18:48:34.654377] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-30T18:48:35.404061] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T18:48:35.454374] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-30T18:48:36.254376] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-30T18:48:36.393342] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T18:48:36.623385] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T18:48:37.054393] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-30T18:48:37.413248] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T18:48:37.502497] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-30T18:48:37.854378] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-30T18:48:38.654384] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-30T18:48:39.131247] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-30T18:48:39.132566] [INFO ] [REMOTE ] FMY: Full fetch complete (1979 records). [2025-09-30T18:48:39.151094] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-30T18:48:39.193382] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:48:39.459587] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-30T18:48:39.560141] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-30T18:48:39.560243] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-30T18:48:39.560377] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-30T18:48:39.560481] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-30T18:48:39.560884] [DEBUG] [LOCAL ] FMY: Trimmed 1979 records to 1401 (keeping 200 days of data) [2025-09-30T18:48:39.571713] [DEBUG] [LOCAL ] FMY: Primary data saved (1401 records). [2025-09-30T18:48:39.571794] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-30T18:48:39.571974] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMY took 21.2s. Estimated remaining: 3h 13m 37s. Rate: 7.8 symbols/min [2025-09-30T18:48:39.752187] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:39.807086] [DEBUG] [LOCAL ] FN: Loaded 38886 existing records from primary storage. [2025-09-30T18:48:39.807391] [INFO ] [MAIN ] FN: Loaded 38886 existing records. [2025-09-30T18:48:40.002923] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:40.003202] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-30T18:48:40.003278] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-30T18:48:40.003671] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-30T18:48:40.003750] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-30T18:48:40.259512] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-30T18:48:40.384439] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:41.054358] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-30T18:48:41.503063] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T18:48:41.515244] [INFO ] [REMOTE ] FMC: Full fetch complete (75078 records). [2025-09-30T18:48:41.515440] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-30T18:48:41.860564] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-30T18:48:41.982824] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-30T18:48:42.012525] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-30T18:48:42.012986] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-30T18:48:42.014370] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-30T18:48:42.014463] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-30T18:48:42.016377] [DEBUG] [LOCAL ] FMC: Trimmed 75078 records to 51779 (keeping 200 days of data) [2025-09-30T18:48:42.372869] [DEBUG] [LOCAL ] FMC: Primary data saved (51779 records). [2025-09-30T18:48:42.373077] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-30T18:48:42.374278] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMC took 46.2s. Estimated remaining: 3h 13m 21s. Rate: 7.9 symbols/min [2025-09-30T18:48:42.576685] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:42.630586] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T18:48:42.637961] [INFO ] [REMOTE ] FMS: Full fetch complete (42396 records). [2025-09-30T18:48:42.638088] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-30T18:48:42.660967] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-30T18:48:42.788245] [DEBUG] [LOCAL ] FNB: Loaded 52447 existing records from primary storage. [2025-09-30T18:48:42.809819] [INFO ] [MAIN ] FNB: Loaded 52447 existing records. [2025-09-30T18:48:43.315346] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:43.342943] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-30T18:48:43.343126] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-30T18:48:43.379390] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-30T18:48:43.371511] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-30T18:48:43.386948] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-30T18:48:43.387029] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-30T18:48:43.401507] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-30T18:48:43.407501] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-30T18:48:43.409099] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T18:48:43.482052] [DEBUG] [LOCAL ] FMS: Trimmed 42396 records to 30147 (keeping 200 days of data) [2025-09-30T18:48:43.476425] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-30T18:48:43.920933] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:44.010235] [DEBUG] [LOCAL ] FMS: Primary data saved (30147 records). [2025-09-30T18:48:44.010439] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-30T18:48:44.010576] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMS took 40.0s. Estimated remaining: 3h 13m 3s. Rate: 7.9 symbols/min [2025-09-30T18:48:44.211067] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:44.265255] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-30T18:48:44.286686] [DEBUG] [LOCAL ] FND: Loaded 52098 existing records from primary storage. [2025-09-30T18:48:44.302296] [INFO ] [MAIN ] FND: Loaded 52098 existing records. [2025-09-30T18:48:44.310176] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T18:48:44.537132] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:44.537396] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-30T18:48:44.537465] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-30T18:48:44.537880] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-30T18:48:44.537940] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-30T18:48:44.942633] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:44.964525] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T18:48:45.054388] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-30T18:48:45.854359] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-30T18:48:46.013199] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T18:48:46.238321] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T18:48:46.654386] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-30T18:48:47.454366] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-30T18:48:47.504745] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T18:48:48.180862] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:48:48.254360] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-30T18:48:49.054387] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-30T18:48:49.271620] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T18:48:49.854386] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-30T18:48:49.897389] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T18:48:50.654339] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-30T18:48:50.846217] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T18:48:51.203925] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T18:48:51.454371] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-30T18:48:52.254327] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-30T18:48:52.357611] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T18:48:52.367437] [INFO ] [REMOTE ] FMX: Full fetch complete (57726 records). [2025-09-30T18:48:52.367605] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-30T18:48:52.812308] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-30T18:48:52.812417] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-30T18:48:52.813750] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-30T18:48:52.813828] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-30T18:48:52.815135] [DEBUG] [LOCAL ] FMX: Trimmed 57726 records to 40706 (keeping 200 days of data) [2025-09-30T18:48:53.055794] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-30T18:48:53.087246] [DEBUG] [LOCAL ] FMX: Primary data saved (40706 records). [2025-09-30T18:48:53.087386] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-30T18:48:53.087494] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMX took 37.3s. Estimated remaining: 3h 12m 57s. Rate: 7.9 symbols/min [2025-09-30T18:48:53.277287] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:48:53.311932] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T18:48:53.370815] [DEBUG] [LOCAL ] FNF: Loaded 49115 existing records from primary storage. [2025-09-30T18:48:53.371191] [INFO ] [MAIN ] FNF: Loaded 49115 existing records. [2025-09-30T18:48:53.578782] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:48:53.579057] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-30T18:48:53.579304] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-30T18:48:53.579885] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-30T18:48:53.579947] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-30T18:48:53.876945] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-30T18:48:53.991318] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:48:54.030419] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T18:48:54.654354] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-30T18:48:54.687465] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:48:55.410270] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:48:55.454345] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-30T18:48:56.212002] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T18:48:56.254360] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-30T18:48:57.054361] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-30T18:48:57.206020] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T18:48:57.760801] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T18:48:57.854374] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-30T18:48:58.654367] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-30T18:48:58.769327] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T18:48:59.454366] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-30T18:48:59.643789] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T18:49:00.254336] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-30T18:49:00.442687] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T18:49:01.054386] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-30T18:49:01.311541] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T18:49:01.767045] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T18:49:01.854372] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-30T18:49:01.989541] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T18:49:02.654353] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-30T18:49:03.454359] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-30T18:49:03.663736] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T18:49:04.266891] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-30T18:49:04.273495] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T18:49:04.834481] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T18:49:05.054408] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-30T18:49:05.854357] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-30T18:49:05.930920] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T18:49:06.654331] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-30T18:49:06.858342] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T18:49:07.129932] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T18:49:07.454361] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-30T18:49:08.254336] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-30T18:49:08.350891] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T18:49:09.054349] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-30T18:49:09.182900] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T18:49:09.854356] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-30T18:49:09.904700] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T18:49:10.661797] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-30T18:49:10.669097] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T18:49:11.454360] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-30T18:49:11.670588] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T18:49:11.682132] [INFO ] [REMOTE ] FNB: Full fetch complete (75813 records). [2025-09-30T18:49:11.682314] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-30T18:49:12.114837] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-30T18:49:12.114996] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-30T18:49:12.116129] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-30T18:49:12.116308] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-30T18:49:12.118042] [DEBUG] [LOCAL ] FNB: Trimmed 75813 records to 52455 (keeping 200 days of data) [2025-09-30T18:49:12.254471] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-30T18:49:12.399328] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T18:49:12.520304] [DEBUG] [LOCAL ] FNB: Primary data saved (52455 records). [2025-09-30T18:49:12.520465] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-30T18:49:12.521618] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FNB took 30.1s. Estimated remaining: 3h 13m 11s. Rate: 7.8 symbols/min [2025-09-30T18:49:12.697392] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:12.748021] [DEBUG] [LOCAL ] FNV: Loaded 46253 existing records from primary storage. [2025-09-30T18:49:12.748403] [INFO ] [MAIN ] FNV: Loaded 46253 existing records. [2025-09-30T18:49:12.953414] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:12.953950] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-30T18:49:12.954020] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-30T18:49:12.954714] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-30T18:49:12.954786] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-30T18:49:13.063413] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-30T18:49:13.354950] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:13.396215] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:49:13.854366] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-30T18:49:14.016422] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T18:49:14.024703] [INFO ] [REMOTE ] FN: Full fetch complete (56375 records). [2025-09-30T18:49:14.024834] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-30T18:49:14.535866] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-30T18:49:14.536046] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-30T18:49:14.537045] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-30T18:49:14.537115] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-30T18:49:14.538474] [DEBUG] [LOCAL ] FN: Trimmed 56375 records to 38754 (keeping 200 days of data) [2025-09-30T18:49:14.654518] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-30T18:49:14.803925] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T18:49:14.842610] [DEBUG] [LOCAL ] FN: Primary data saved (38754 records). [2025-09-30T18:49:14.842777] [INFO ] [MAIN ] FN: Full history saved. [2025-09-30T18:49:14.842879] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FN took 35.3s. Estimated remaining: 3h 12m 54s. Rate: 7.8 symbols/min [2025-09-30T18:49:15.021267] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:15.037759] [DEBUG] [LOCAL ] FOA: Loaded 13128 existing records from primary storage. [2025-09-30T18:49:15.037997] [INFO ] [MAIN ] FOA: Loaded 13128 existing records. [2025-09-30T18:49:15.238336] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:15.238594] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-30T18:49:15.238661] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-30T18:49:15.239342] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-30T18:49:15.239402] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-30T18:49:15.457765] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-30T18:49:15.640614] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:15.661591] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T18:49:16.180795] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T18:49:16.254442] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-30T18:49:17.054365] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-30T18:49:17.484185] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-30T18:49:17.495769] [INFO ] [REMOTE ] FND: Full fetch complete (74485 records). [2025-09-30T18:49:17.495964] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-30T18:49:17.855085] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-30T18:49:17.861883] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T18:49:17.967227] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-30T18:49:17.967365] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-30T18:49:17.968409] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-30T18:49:17.968495] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-30T18:49:17.971278] [DEBUG] [LOCAL ] FND: Trimmed 74485 records to 52101 (keeping 200 days of data) [2025-09-30T18:49:18.293302] [DEBUG] [LOCAL ] FND: Primary data saved (52101 records). [2025-09-30T18:49:18.293450] [INFO ] [MAIN ] FND: Full history saved. [2025-09-30T18:49:18.293632] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FND took 34.3s. Estimated remaining: 3h 12m 39s. Rate: 7.9 symbols/min [2025-09-30T18:49:18.475377] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:18.486734] [DEBUG] [LOCAL ] FOF: Loaded 8434 existing records from primary storage. [2025-09-30T18:49:18.486922] [INFO ] [MAIN ] FOF: Loaded 8434 existing records. [2025-09-30T18:49:18.656264] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-30T18:49:18.690083] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:18.690582] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-30T18:49:18.690685] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-30T18:49:18.690889] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-30T18:49:18.690950] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-30T18:49:18.885269] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T18:49:19.115479] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:19.293118] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T18:49:19.306162] [INFO ] [REMOTE ] FNF: Full fetch complete (69611 records). [2025-09-30T18:49:19.306319] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-30T18:49:19.465611] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-30T18:49:19.745633] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T18:49:19.843375] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-30T18:49:19.843474] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-30T18:49:19.844432] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-30T18:49:19.844504] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-30T18:49:19.846128] [DEBUG] [LOCAL ] FNF: Trimmed 69611 records to 49101 (keeping 200 days of data) [2025-09-30T18:49:20.160625] [DEBUG] [LOCAL ] FNF: Primary data saved (49101 records). [2025-09-30T18:49:20.160812] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-30T18:49:20.160932] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FNF took 27.1s. Estimated remaining: 3h 12m 21s. Rate: 7.9 symbols/min [2025-09-30T18:49:20.260985] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-30T18:49:20.338250] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:20.362630] [DEBUG] [LOCAL ] FOR: Loaded 19910 existing records from primary storage. [2025-09-30T18:49:20.362944] [INFO ] [MAIN ] FOR: Loaded 19910 existing records. [2025-09-30T18:49:20.549621] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:20.549900] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-30T18:49:20.549948] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-30T18:49:20.550208] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-30T18:49:20.550265] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-30T18:49:20.967070] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:21.054367] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-30T18:49:21.155373] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T18:49:21.232223] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T18:49:21.751468] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T18:49:21.854346] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-30T18:49:22.581246] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T18:49:22.654341] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-30T18:49:23.413437] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-30T18:49:23.454404] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-30T18:49:24.203936] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T18:49:24.254351] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-30T18:49:25.054424] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-30T18:49:25.746770] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-30T18:49:25.835104] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T18:49:25.854322] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-30T18:49:26.654369] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-30T18:49:27.454326] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-30T18:49:27.498003] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-30T18:49:27.500815] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T18:49:28.254365] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-30T18:49:28.704459] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:49:29.054377] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-30T18:49:29.819236] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T18:49:29.854315] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-30T18:49:30.090548] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T18:49:30.654378] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-30T18:49:31.250742] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T18:49:31.288868] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T18:49:31.454375] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-30T18:49:32.254420] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-30T18:49:33.054333] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-30T18:49:33.091601] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:49:33.206037] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T18:49:33.804544] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T18:49:33.854367] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-30T18:49:34.583291] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T18:49:34.654337] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-30T18:49:35.454416] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-30T18:49:36.121987] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T18:49:36.254400] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-30T18:49:36.623358] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T18:49:37.054384] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-30T18:49:37.854329] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-30T18:49:38.031867] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T18:49:38.041528] [INFO ] [REMOTE ] FNV: Full fetch complete (66175 records). [2025-09-30T18:49:38.041720] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-30T18:49:38.220808] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T18:49:38.497113] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-30T18:49:38.497209] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-30T18:49:38.498103] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-30T18:49:38.498200] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-30T18:49:38.499688] [DEBUG] [LOCAL ] FNV: Trimmed 66175 records to 46188 (keeping 200 days of data) [2025-09-30T18:49:38.690586] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-30T18:49:38.814322] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T18:49:38.831048] [DEBUG] [LOCAL ] FNV: Primary data saved (46188 records). [2025-09-30T18:49:38.831186] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-30T18:49:38.831838] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FNV took 26.3s. Estimated remaining: 3h 12m 33s. Rate: 7.8 symbols/min [2025-09-30T18:49:39.022915] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:39.079168] [DEBUG] [LOCAL ] FOUR: Loaded 49547 existing records from primary storage. [2025-09-30T18:49:39.079508] [INFO ] [MAIN ] FOUR: Loaded 49547 existing records. [2025-09-30T18:49:39.275213] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:39.275492] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-30T18:49:39.275552] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-30T18:49:39.275930] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-30T18:49:39.275991] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-30T18:49:39.461613] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-30T18:49:39.659126] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:39.678373] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T18:49:40.254384] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-30T18:49:40.428875] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T18:49:40.433146] [INFO ] [REMOTE ] FOA: Full fetch complete (22507 records). [2025-09-30T18:49:40.433352] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-30T18:49:40.826115] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-30T18:49:40.826201] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-30T18:49:40.826769] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-30T18:49:40.826839] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-30T18:49:40.827457] [DEBUG] [LOCAL ] FOA: Trimmed 22507 records to 13156 (keeping 200 days of data) [2025-09-30T18:49:40.907968] [DEBUG] [LOCAL ] FOA: Primary data saved (13156 records). [2025-09-30T18:49:40.908111] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-30T18:49:40.908255] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FOA took 26.1s. Estimated remaining: 3h 12m 15s. Rate: 7.9 symbols/min [2025-09-30T18:49:41.059570] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-30T18:49:41.087363] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:41.108046] [DEBUG] [LOCAL ] FPF: Loaded 17885 existing records from primary storage. [2025-09-30T18:49:41.108325] [INFO ] [MAIN ] FPF: Loaded 17885 existing records. [2025-09-30T18:49:41.300558] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:41.300829] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-30T18:49:41.300886] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-30T18:49:41.301164] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-30T18:49:41.301225] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-30T18:49:41.695907] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:41.854346] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-30T18:49:41.874590] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-30T18:49:41.921387] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T18:49:42.556431] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-30T18:49:42.654355] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-30T18:49:43.454352] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-30T18:49:43.485712] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T18:49:44.254379] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-30T18:49:44.445045] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T18:49:45.054340] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-30T18:49:45.202337] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-30T18:49:45.854381] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-30T18:49:46.654402] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-30T18:49:46.693401] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T18:49:46.726834] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T18:49:47.454367] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-30T18:49:47.659499] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T18:49:48.254363] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-30T18:49:49.047395] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T18:49:49.057257] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-30T18:49:49.372000] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T18:49:49.376408] [INFO ] [REMOTE ] FOR: Full fetch complete (29955 records). [2025-09-30T18:49:49.376515] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-30T18:49:49.809083] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-30T18:49:49.809216] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-30T18:49:49.809793] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-30T18:49:49.809864] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-30T18:49:49.810692] [DEBUG] [LOCAL ] FOR: Trimmed 29955 records to 19856 (keeping 200 days of data) [2025-09-30T18:49:49.865356] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-30T18:49:49.942988] [DEBUG] [LOCAL ] FOR: Primary data saved (19856 records). [2025-09-30T18:49:49.943151] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-30T18:49:49.943244] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOR took 29.8s. Estimated remaining: 3h 12m 10s. Rate: 7.9 symbols/min [2025-09-30T18:49:50.075398] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T18:49:50.156697] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:50.176740] [DEBUG] [LOCAL ] FPH: Loaded 19569 existing records from primary storage. [2025-09-30T18:49:50.177002] [INFO ] [MAIN ] FPH: Loaded 19569 existing records. [2025-09-30T18:49:50.370075] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:50.370295] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-30T18:49:50.370345] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-30T18:49:50.370560] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-30T18:49:50.370619] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-30T18:49:50.659525] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-30T18:49:50.770262] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:51.454344] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-30T18:49:51.479019] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T18:49:51.821722] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T18:49:52.254333] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-30T18:49:52.388892] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T18:49:52.780166] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-30T18:49:53.054358] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-30T18:49:53.788941] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T18:49:53.854344] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-30T18:49:54.654340] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-30T18:49:54.733817] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T18:49:54.736581] [INFO ] [REMOTE ] FOF: Full fetch complete (11871 records). [2025-09-30T18:49:54.736696] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-30T18:49:55.133120] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-30T18:49:55.133215] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-30T18:49:55.133564] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-30T18:49:55.133626] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-30T18:49:55.134183] [DEBUG] [LOCAL ] FOF: Trimmed 11871 records to 8432 (keeping 200 days of data) [2025-09-30T18:49:55.192849] [DEBUG] [LOCAL ] FOF: Primary data saved (8432 records). [2025-09-30T18:49:55.193020] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-30T18:49:55.193126] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOF took 36.9s. Estimated remaining: 3h 11m 58s. Rate: 7.9 symbols/min [2025-09-30T18:49:55.395593] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:49:55.437771] [DEBUG] [LOCAL ] FPI: Loaded 31022 existing records from primary storage. [2025-09-30T18:49:55.438062] [INFO ] [MAIN ] FPI: Loaded 31022 existing records. [2025-09-30T18:49:55.459708] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-30T18:49:55.635771] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:49:55.635982] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-30T18:49:55.636028] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-30T18:49:55.636596] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-30T18:49:55.636689] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-30T18:49:56.033277] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:49:56.081231] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T18:49:56.254332] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-30T18:49:56.569093] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T18:49:57.054361] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-30T18:49:57.854347] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-30T18:49:57.956601] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T18:49:57.978253] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T18:49:58.654356] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-30T18:49:59.218482] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T18:49:59.454356] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-30T18:50:00.254328] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-30T18:50:00.296261] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T18:50:00.505579] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T18:50:01.054781] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-30T18:50:01.057025] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-30T18:50:01.854355] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-30T18:50:02.641088] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T18:50:02.654331] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-30T18:50:03.202265] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T18:50:03.454333] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-30T18:50:03.824202] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T18:50:04.254387] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-30T18:50:04.801626] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-30T18:50:05.054359] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-30T18:50:05.403912] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T18:50:05.854362] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-30T18:50:06.654401] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-30T18:50:06.984486] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T18:50:07.047673] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T18:50:07.454366] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-30T18:50:07.709752] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T18:50:08.254421] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-30T18:50:08.609449] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T18:50:09.054416] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-30T18:50:09.854321] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-30T18:50:10.184205] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T18:50:10.223422] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T18:50:10.234735] [INFO ] [REMOTE ] FOUR: Full fetch complete (71980 records). [2025-09-30T18:50:10.234905] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-30T18:50:10.664552] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-30T18:50:10.671618] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-30T18:50:10.671722] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-30T18:50:10.672698] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-30T18:50:10.672860] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-30T18:50:10.674599] [DEBUG] [LOCAL ] FOUR: Trimmed 71980 records to 49547 (keeping 200 days of data) [2025-09-30T18:50:10.934259] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:50:11.024001] [DEBUG] [LOCAL ] FOUR: Primary data saved (49547 records). [2025-09-30T18:50:11.024155] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-30T18:50:11.024844] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FOUR took 32.2s. Estimated remaining: 3h 12m 5s. Rate: 7.8 symbols/min [2025-09-30T18:50:11.210434] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:11.260013] [DEBUG] [LOCAL ] FR: Loaded 46393 existing records from primary storage. [2025-09-30T18:50:11.260355] [INFO ] [MAIN ] FR: Loaded 46393 existing records. [2025-09-30T18:50:11.460258] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:11.460379] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-30T18:50:11.461865] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-30T18:50:11.462075] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-30T18:50:11.462617] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-30T18:50:11.462760] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-30T18:50:11.807160] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T18:50:11.897720] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:12.254331] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-30T18:50:12.397883] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-30T18:50:12.971008] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-30T18:50:13.054382] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-30T18:50:13.854380] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-30T18:50:14.122604] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T18:50:14.127243] [INFO ] [REMOTE ] FPF: Full fetch complete (26579 records). [2025-09-30T18:50:14.127384] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-30T18:50:14.540844] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-30T18:50:14.540971] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-30T18:50:14.541789] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-30T18:50:14.541874] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-30T18:50:14.553602] [DEBUG] [LOCAL ] FPF: Trimmed 26579 records to 18101 (keeping 200 days of data) [2025-09-30T18:50:14.553465] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-30T18:50:14.661312] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-30T18:50:14.678089] [DEBUG] [LOCAL ] FPF: Primary data saved (18101 records). [2025-09-30T18:50:14.678279] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-30T18:50:14.678384] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FPF took 33.8s. Estimated remaining: 3h 11m 50s. Rate: 7.9 symbols/min [2025-09-30T18:50:14.871437] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:14.890040] [DEBUG] [LOCAL ] FRA: Loaded 14517 existing records from primary storage. [2025-09-30T18:50:14.890285] [INFO ] [MAIN ] FRA: Loaded 14517 existing records. [2025-09-30T18:50:15.104065] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:15.104320] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-30T18:50:15.104381] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-30T18:50:15.104701] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-30T18:50:15.104762] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-30T18:50:15.459533] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-30T18:50:15.524439] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:16.236051] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T18:50:16.254311] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-30T18:50:16.625688] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T18:50:17.054401] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-30T18:50:17.692695] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T18:50:17.854378] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-30T18:50:18.340155] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T18:50:18.654363] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-30T18:50:19.227204] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T18:50:19.454402] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-30T18:50:20.254318] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-30T18:50:20.287611] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:50:20.525996] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T18:50:20.533364] [INFO ] [REMOTE ] FPH: Full fetch complete (31407 records). [2025-09-30T18:50:20.533526] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-30T18:50:21.002223] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-30T18:50:21.002303] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-30T18:50:21.002920] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-30T18:50:21.002984] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-30T18:50:21.003811] [DEBUG] [LOCAL ] FPH: Trimmed 31407 records to 19466 (keeping 200 days of data) [2025-09-30T18:50:21.057102] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-30T18:50:21.119388] [DEBUG] [LOCAL ] FPH: Primary data saved (19466 records). [2025-09-30T18:50:21.119545] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-30T18:50:21.119629] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FPH took 31.2s. Estimated remaining: 3h 11m 40s. Rate: 7.9 symbols/min [2025-09-30T18:50:21.316071] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:21.325017] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T18:50:21.351347] [DEBUG] [LOCAL ] FRGE: Loaded 17953 existing records from primary storage. [2025-09-30T18:50:21.351668] [INFO ] [MAIN ] FRGE: Loaded 17953 existing records. [2025-09-30T18:50:21.552472] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:21.552729] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-30T18:50:21.552788] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-30T18:50:21.553059] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-30T18:50:21.553121] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-30T18:50:21.860049] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-30T18:50:22.015453] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:22.424195] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-30T18:50:22.654403] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-30T18:50:23.067888] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T18:50:23.454366] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-30T18:50:24.254402] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-30T18:50:24.323926] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T18:50:24.966346] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T18:50:25.054370] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-30T18:50:25.227043] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T18:50:25.854384] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-30T18:50:26.654365] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-30T18:50:26.706615] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T18:50:27.020511] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T18:50:27.454371] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-30T18:50:27.621008] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T18:50:28.254410] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-30T18:50:28.661574] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T18:50:29.054387] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-30T18:50:29.656627] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T18:50:29.854362] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-30T18:50:29.921608] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T18:50:30.654401] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-30T18:50:31.225032] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T18:50:31.454403] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-30T18:50:31.484243] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T18:50:32.254372] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-30T18:50:33.023602] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T18:50:33.054317] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-30T18:50:33.336444] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T18:50:33.854397] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-30T18:50:34.633537] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T18:50:34.654330] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-30T18:50:35.379392] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T18:50:35.388310] [INFO ] [REMOTE ] FPI: Full fetch complete (44233 records). [2025-09-30T18:50:35.388541] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-30T18:50:35.464309] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-30T18:50:35.869025] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-30T18:50:35.869161] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-30T18:50:35.869876] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-30T18:50:35.869940] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-30T18:50:35.871098] [DEBUG] [LOCAL ] FPI: Trimmed 44233 records to 31004 (keeping 200 days of data) [2025-09-30T18:50:36.070995] [DEBUG] [LOCAL ] FPI: Primary data saved (31004 records). [2025-09-30T18:50:36.071137] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-30T18:50:36.071249] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FPI took 40.9s. Estimated remaining: 3h 11m 45s. Rate: 7.8 symbols/min [2025-09-30T18:50:36.255914] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-30T18:50:36.259968] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:36.318165] [DEBUG] [LOCAL ] FRO: Loaded 51814 existing records from primary storage. [2025-09-30T18:50:36.318616] [INFO ] [MAIN ] FRO: Loaded 51814 existing records. [2025-09-30T18:50:36.545459] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:36.556864] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T18:50:36.558716] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-30T18:50:36.559523] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-30T18:50:36.565462] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T18:50:36.576775] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-30T18:50:36.577517] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-30T18:50:36.998925] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:37.054341] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-30T18:50:37.518337] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-30T18:50:37.854377] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-30T18:50:38.519419] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T18:50:38.654409] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-30T18:50:39.454346] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-30T18:50:39.886338] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-30T18:50:40.254892] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-30T18:50:40.274403] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T18:50:40.285629] [INFO ] [REMOTE ] FR: Full fetch complete (66615 records). [2025-09-30T18:50:40.285825] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-30T18:50:40.431619] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T18:50:40.728789] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-30T18:50:40.728883] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-30T18:50:40.729780] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-30T18:50:40.729853] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-30T18:50:40.731317] [DEBUG] [LOCAL ] FR: Trimmed 66615 records to 46417 (keeping 200 days of data) [2025-09-30T18:50:41.048035] [DEBUG] [LOCAL ] FR: Primary data saved (46417 records). [2025-09-30T18:50:41.048240] [INFO ] [MAIN ] FR: Full history saved. [2025-09-30T18:50:41.049625] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FR took 30.0s. Estimated remaining: 3h 11m 33s. Rate: 7.8 symbols/min [2025-09-30T18:50:41.055031] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-30T18:50:41.181872] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T18:50:41.255332] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:41.303469] [DEBUG] [LOCAL ] FRT: Loaded 42096 existing records from primary storage. [2025-09-30T18:50:41.303813] [INFO ] [MAIN ] FRT: Loaded 42096 existing records. [2025-09-30T18:50:41.504275] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:41.504487] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-30T18:50:41.504552] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-30T18:50:41.505013] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-30T18:50:41.505079] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-30T18:50:41.868420] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-30T18:50:41.914005] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:42.654393] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-30T18:50:42.788535] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T18:50:42.792261] [INFO ] [REMOTE ] FRA: Full fetch complete (24117 records). [2025-09-30T18:50:42.792368] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-30T18:50:43.202867] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-30T18:50:43.202955] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-30T18:50:43.203523] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-30T18:50:43.203588] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-30T18:50:43.204414] [DEBUG] [LOCAL ] FRA: Trimmed 24117 records to 14539 (keeping 200 days of data) [2025-09-30T18:50:43.316722] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-30T18:50:43.360025] [DEBUG] [LOCAL ] FRA: Primary data saved (14539 records). [2025-09-30T18:50:43.360182] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-30T18:50:43.360269] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FRA took 28.7s. Estimated remaining: 3h 11m 16s. Rate: 7.9 symbols/min [2025-09-30T18:50:43.459550] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-30T18:50:43.560321] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:43.603994] [DEBUG] [LOCAL ] FSCO: Loaded 37264 existing records from primary storage. [2025-09-30T18:50:43.604385] [INFO ] [MAIN ] FSCO: Loaded 37264 existing records. [2025-09-30T18:50:43.808932] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:43.809164] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-30T18:50:43.809213] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-30T18:50:43.809573] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-30T18:50:43.809629] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-30T18:50:44.229501] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:44.251945] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T18:50:44.259462] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-30T18:50:45.054367] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-30T18:50:45.140081] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:50:45.703328] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T18:50:45.854372] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-30T18:50:45.882957] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T18:50:46.654379] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-30T18:50:47.302481] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T18:50:47.454385] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-30T18:50:47.720074] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T18:50:48.254370] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-30T18:50:48.581722] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T18:50:49.054405] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-30T18:50:49.854328] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-30T18:50:49.998768] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T18:50:50.002121] [INFO ] [REMOTE ] FRGE: Full fetch complete (32973 records). [2025-09-30T18:50:50.002220] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-30T18:50:50.451506] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-30T18:50:50.451743] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-30T18:50:50.452613] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-30T18:50:50.452784] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-30T18:50:50.487960] [DEBUG] [LOCAL ] FRGE: Trimmed 32973 records to 17802 (keeping 200 days of data) [2025-09-30T18:50:50.491121] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-30T18:50:50.651507] [DEBUG] [LOCAL ] FRGE: Primary data saved (17802 records). [2025-09-30T18:50:50.651678] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-30T18:50:50.651893] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRGE took 29.5s. Estimated remaining: 3h 11m 8s. Rate: 7.9 symbols/min [2025-09-30T18:50:50.659430] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-30T18:50:50.836379] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:50:50.890346] [DEBUG] [LOCAL ] FSK: Loaded 49406 existing records from primary storage. [2025-09-30T18:50:50.890746] [INFO ] [MAIN ] FSK: Loaded 49406 existing records. [2025-09-30T18:50:51.084158] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:50:51.084513] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-30T18:50:51.084735] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-30T18:50:51.085227] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-30T18:50:51.085344] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-30T18:50:51.223587] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T18:50:51.464021] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-30T18:50:51.510907] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:50:52.254353] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-30T18:50:52.600117] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T18:50:53.014474] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:50:53.054376] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-30T18:50:53.854478] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-30T18:50:54.108011] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T18:50:54.444584] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T18:50:54.654366] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-30T18:50:54.880934] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T18:50:55.454378] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-30T18:50:56.254369] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-30T18:50:56.310041] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T18:50:56.388408] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T18:50:57.054369] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-30T18:50:57.854380] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-30T18:50:58.062166] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T18:50:58.654361] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-30T18:50:58.728596] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:50:59.463117] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-30T18:50:59.483502] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T18:50:59.661891] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T18:51:00.254362] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-30T18:51:01.054446] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-30T18:51:01.469542] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T18:51:01.854436] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-30T18:51:01.941482] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T18:51:02.595733] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T18:51:02.654394] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-30T18:51:03.454338] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-30T18:51:03.651990] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T18:51:04.254395] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-30T18:51:04.346143] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T18:51:04.570813] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T18:51:05.054409] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-30T18:51:05.854336] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-30T18:51:06.162216] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T18:51:06.174372] [INFO ] [REMOTE ] FRO: Full fetch complete (75313 records). [2025-09-30T18:51:06.174629] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-30T18:51:06.659337] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-30T18:51:06.715069] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-30T18:51:06.715347] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-30T18:51:06.716555] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-30T18:51:06.716968] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-30T18:51:06.718748] [DEBUG] [LOCAL ] FRO: Trimmed 75313 records to 51794 (keeping 200 days of data) [2025-09-30T18:51:06.974132] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T18:51:07.047323] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T18:51:07.136736] [DEBUG] [LOCAL ] FRO: Primary data saved (51794 records). [2025-09-30T18:51:07.136910] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-30T18:51:07.137091] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRO took 31.1s. Estimated remaining: 3h 11m 16s. Rate: 7.8 symbols/min [2025-09-30T18:51:07.315625] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:51:07.374723] [DEBUG] [LOCAL ] FSLY: Loaded 51193 existing records from primary storage. [2025-09-30T18:51:07.375084] [INFO ] [MAIN ] FSLY: Loaded 51193 existing records. [2025-09-30T18:51:07.459551] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-30T18:51:07.571079] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:51:07.571319] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-30T18:51:07.571369] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-30T18:51:07.571804] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-30T18:51:07.571887] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-30T18:51:07.965658] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:51:08.122915] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T18:51:08.254358] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-30T18:51:09.054394] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-30T18:51:09.379915] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T18:51:09.854360] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-30T18:51:09.886709] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T18:51:10.150568] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T18:51:10.654389] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-30T18:51:11.454331] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-30T18:51:11.738714] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-30T18:51:12.173021] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T18:51:12.254407] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-30T18:51:12.722304] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T18:51:12.731524] [INFO ] [REMOTE ] FSCO: Full fetch complete (54231 records). [2025-09-30T18:51:12.731716] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-30T18:51:13.054869] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-30T18:51:13.154876] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-30T18:51:13.154972] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-30T18:51:13.155835] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-30T18:51:13.155924] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-30T18:51:13.158543] [DEBUG] [LOCAL ] FSCO: Trimmed 54231 records to 37393 (keeping 200 days of data) [2025-09-30T18:51:13.409371] [DEBUG] [LOCAL ] FSCO: Primary data saved (37393 records). [2025-09-30T18:51:13.409506] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-30T18:51:13.409613] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FSCO took 30.0s. Estimated remaining: 3h 11m 6s. Rate: 7.8 symbols/min [2025-09-30T18:51:13.653196] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:51:13.713934] [DEBUG] [LOCAL ] FSM: Loaded 53287 existing records from primary storage. [2025-09-30T18:51:13.714249] [INFO ] [MAIN ] FSM: Loaded 53287 existing records. [2025-09-30T18:51:13.864595] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-30T18:51:13.923619] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:51:13.924077] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-30T18:51:13.924192] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-30T18:51:13.924728] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-30T18:51:13.924793] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-30T18:51:14.136383] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T18:51:14.235835] [INFO ] [REMOTE ] FRT: Full fetch complete (60247 records). [2025-09-30T18:51:14.253557] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-30T18:51:14.477744] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:51:14.660539] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-30T18:51:14.826969] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-30T18:51:14.827090] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-30T18:51:14.828621] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-30T18:51:14.828773] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-30T18:51:14.857425] [DEBUG] [LOCAL ] FRT: Trimmed 60247 records to 42039 (keeping 200 days of data) [2025-09-30T18:51:14.858505] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T18:51:15.160000] [DEBUG] [LOCAL ] FRT: Primary data saved (42039 records). [2025-09-30T18:51:15.160162] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-30T18:51:15.160276] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FRT took 34.1s. Estimated remaining: 3h 10m 48s. Rate: 7.9 symbols/min [2025-09-30T18:51:15.374440] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:51:15.417131] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:51:15.459588] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-30T18:51:15.462449] [DEBUG] [LOCAL ] FSS: Loaded 34208 existing records from primary storage. [2025-09-30T18:51:15.462941] [INFO ] [MAIN ] FSS: Loaded 34208 existing records. [2025-09-30T18:51:15.670822] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:51:15.671140] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-30T18:51:15.671194] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-30T18:51:15.671749] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-30T18:51:15.671810] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-30T18:51:16.081205] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:51:16.254416] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-30T18:51:16.492880] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T18:51:17.054384] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-30T18:51:17.160688] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T18:51:17.321885] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T18:51:17.854403] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-30T18:51:18.549086] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T18:51:18.654376] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-30T18:51:19.420560] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T18:51:19.454340] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-30T18:51:20.132608] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T18:51:20.254348] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-30T18:51:20.582961] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T18:51:21.054369] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-30T18:51:21.854348] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-30T18:51:21.950101] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T18:51:22.500723] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T18:51:22.654374] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-30T18:51:23.454362] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-30T18:51:23.668108] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T18:51:24.074411] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T18:51:24.254399] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-30T18:51:25.054383] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-30T18:51:25.247054] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T18:51:25.590598] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T18:51:25.854366] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-30T18:51:26.565335] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T18:51:26.654383] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-30T18:51:27.381601] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:51:27.454385] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-30T18:51:28.032688] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T18:51:28.254398] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-30T18:51:29.062821] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-30T18:51:29.089242] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T18:51:29.224116] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T18:51:29.854403] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-30T18:51:30.654335] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-30T18:51:30.908408] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T18:51:30.920424] [INFO ] [REMOTE ] FSK: Full fetch complete (71467 records). [2025-09-30T18:51:30.920759] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-30T18:51:31.362513] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-30T18:51:31.362622] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-30T18:51:31.363698] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-30T18:51:31.363802] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-30T18:51:31.365426] [DEBUG] [LOCAL ] FSK: Trimmed 71467 records to 49397 (keeping 200 days of data) [2025-09-30T18:51:31.459852] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-30T18:51:31.719060] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T18:51:31.745560] [DEBUG] [LOCAL ] FSK: Primary data saved (49397 records). [2025-09-30T18:51:31.745716] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-30T18:51:31.745821] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 41.1s. Estimated remaining: 3h 10m 56s. Rate: 7.8 symbols/min [2025-09-30T18:51:31.952764] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:51:31.963305] [DEBUG] [LOCAL ] FT: Loaded 6436 existing records from primary storage. [2025-09-30T18:51:31.963542] [INFO ] [MAIN ] FT: Loaded 6436 existing records. [2025-09-30T18:51:32.172911] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:51:32.173314] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-30T18:51:32.173434] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-30T18:51:32.173819] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-30T18:51:32.174008] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-30T18:51:32.259470] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-30T18:51:32.516697] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T18:51:32.705070] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:51:32.728848] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-30T18:51:33.054414] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-30T18:51:33.736941] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-30T18:51:33.854337] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-30T18:51:34.060462] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T18:51:34.654403] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-30T18:51:35.160412] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T18:51:35.454361] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-30T18:51:36.078752] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T18:51:36.254408] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-30T18:51:36.873392] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T18:51:37.054361] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-30T18:51:37.213086] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T18:51:37.854390] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-30T18:51:38.654320] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-30T18:51:38.931491] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T18:51:38.942952] [INFO ] [REMOTE ] FSLY: Full fetch complete (74886 records). [2025-09-30T18:51:38.943119] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-30T18:51:39.402309] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-30T18:51:39.402483] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-30T18:51:39.403721] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-30T18:51:39.403943] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-30T18:51:39.425271] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T18:51:39.431598] [DEBUG] [LOCAL ] FSLY: Trimmed 74886 records to 51207 (keeping 200 days of data) [2025-09-30T18:51:39.431481] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T18:51:39.439226] [INFO ] [REMOTE ] FSS: Full fetch complete (48345 records). [2025-09-30T18:51:39.439323] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-30T18:51:39.461221] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-30T18:51:40.072051] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-30T18:51:40.072159] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-30T18:51:40.073721] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-30T18:51:40.074073] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-30T18:51:40.084543] [DEBUG] [LOCAL ] FSS: Trimmed 48345 records to 34149 (keeping 200 days of data) [2025-09-30T18:51:40.263200] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-30T18:51:40.302259] [DEBUG] [LOCAL ] FSLY: Primary data saved (51207 records). [2025-09-30T18:51:40.302716] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-30T18:51:40.302824] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSLY took 33.2s. Estimated remaining: 3h 10m 49s. Rate: 7.8 symbols/min [2025-09-30T18:51:40.568968] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:51:40.605638] [DEBUG] [LOCAL ] FTHY: Loaded 11823 existing records from primary storage. [2025-09-30T18:51:40.607276] [INFO ] [MAIN ] FTHY: Loaded 11823 existing records. [2025-09-30T18:51:40.715588] [DEBUG] [LOCAL ] FSS: Primary data saved (34149 records). [2025-09-30T18:51:40.728504] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-30T18:51:40.729274] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FSS took 25.6s. Estimated remaining: 3h 10m 29s. Rate: 7.8 symbols/min [2025-09-30T18:51:40.911228] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-30T18:51:40.924100] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:51:40.960335] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-30T18:51:40.974432] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-30T18:51:40.975185] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-30T18:51:40.985759] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-30T18:51:41.076398] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-30T18:51:41.129536] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:51:41.499228] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:51:41.560042] [DEBUG] [LOCAL ] FTI: Loaded 53297 existing records from primary storage. [2025-09-30T18:51:41.561031] [INFO ] [MAIN ] FTI: Loaded 53297 existing records. [2025-09-30T18:51:41.562994] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-30T18:51:41.772048] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:51:41.772555] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-30T18:51:41.772620] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-30T18:51:41.773403] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-30T18:51:41.773466] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-30T18:51:41.859516] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-30T18:51:42.122889] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T18:51:42.190248] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:51:42.654357] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-30T18:51:43.454331] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-30T18:51:43.779876] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T18:51:44.254372] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-30T18:51:44.399662] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T18:51:44.411955] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T18:51:45.054379] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-30T18:51:45.854398] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-30T18:51:46.080102] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T18:51:46.110116] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T18:51:46.556491] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-30T18:51:46.654365] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-30T18:51:47.411202] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T18:51:47.454338] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-30T18:51:48.167538] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-30T18:51:48.254357] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-30T18:51:49.054377] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-30T18:51:49.645609] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T18:51:49.854404] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-30T18:51:49.983092] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T18:51:50.654391] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-30T18:51:51.405025] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-30T18:51:51.454353] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-30T18:51:51.635685] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T18:51:51.649946] [INFO ] [REMOTE ] FSM: Full fetch complete (76737 records). [2025-09-30T18:51:51.650135] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-30T18:51:52.088297] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-30T18:51:52.088498] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-30T18:51:52.090151] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-30T18:51:52.090221] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-30T18:51:52.092283] [DEBUG] [LOCAL ] FSM: Trimmed 76737 records to 53286 (keeping 200 days of data) [2025-09-30T18:51:52.276991] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-30T18:51:52.326309] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T18:51:52.459330] [DEBUG] [LOCAL ] FSM: Primary data saved (53286 records). [2025-09-30T18:51:52.459576] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-30T18:51:52.459735] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FSM took 39.0s. Estimated remaining: 3h 10m 29s. Rate: 7.8 symbols/min [2025-09-30T18:51:53.054371] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-30T18:51:53.854714] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-30T18:51:53.916489] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T18:51:53.938250] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T18:51:53.941173] [INFO ] [REMOTE ] FT: Full fetch complete (9126 records). [2025-09-30T18:51:53.941307] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-30T18:51:54.469821] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-30T18:51:54.469992] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-30T18:51:54.470300] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-30T18:51:54.470342] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-30T18:51:54.471038] [DEBUG] [LOCAL ] FT: Trimmed 9126 records to 6495 (keeping 200 days of data) [2025-09-30T18:51:54.516481] [DEBUG] [LOCAL ] FT: Primary data saved (6495 records). [2025-09-30T18:51:54.516638] [INFO ] [MAIN ] FT: Full history saved. [2025-09-30T18:51:54.516775] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FT took 22.8s. Estimated remaining: 3h 10m 12s. Rate: 7.8 symbols/min [2025-09-30T18:51:54.654356] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-30T18:51:54.836137] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T18:51:55.454371] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-30T18:51:56.115899] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T18:51:56.255614] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-30T18:51:56.257343] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T18:51:57.054405] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-30T18:51:57.640283] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-30T18:51:57.854399] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-30T18:51:58.024703] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T18:51:58.654342] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-30T18:51:58.736758] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T18:51:59.454403] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-30T18:52:00.238461] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T18:52:00.254312] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-30T18:52:00.349874] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T18:52:00.969575] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-30T18:52:00.972615] [INFO ] [REMOTE ] FTHY: Full fetch complete (17530 records). [2025-09-30T18:52:00.972721] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-30T18:52:01.069596] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-30T18:52:01.379495] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-30T18:52:01.379592] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-30T18:52:01.380016] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-30T18:52:01.380079] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-30T18:52:01.380897] [DEBUG] [LOCAL ] FTHY: Trimmed 17530 records to 11914 (keeping 200 days of data) [2025-09-30T18:52:01.459787] [DEBUG] [LOCAL ] FTHY: Primary data saved (11914 records). [2025-09-30T18:52:01.459971] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-30T18:52:01.460077] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTHY took 21.2s. Estimated remaining: 3h 10m 3s. Rate: 7.9 symbols/min [2025-09-30T18:52:02.838040] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T18:52:02.849554] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-30T18:52:04.625247] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T18:52:04.637231] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-30T18:52:06.374556] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T18:52:06.386172] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-30T18:52:08.376552] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T18:52:08.388580] [INFO ] [REMOTE ] FTI: Full fetch complete (77128 records). [2025-09-30T18:52:08.388783] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-30T18:52:08.839371] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-30T18:52:08.839463] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-30T18:52:08.840503] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-30T18:52:08.840573] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-30T18:52:08.842381] [DEBUG] [LOCAL ] FTI: Trimmed 77128 records to 53297 (keeping 200 days of data) [2025-09-30T18:52:09.212322] [DEBUG] [LOCAL ] FTI: Primary data saved (53297 records). [2025-09-30T18:52:09.212475] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-30T18:52:09.213216] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 28.5s. Estimated remaining: 3h 9m 55s. Rate: 7.9 symbols/min [2025-09-30T18:52:10.007767] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:10.057458] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:10.116166] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:10.115319] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:10.123737] [DEBUG] [LOCAL ] FTWO: Loaded 1795 existing records from primary storage. [2025-09-30T18:52:10.124213] [INFO ] [MAIN ] FTWO: Loaded 1795 existing records. [2025-09-30T18:52:10.377783] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:10.392302] [DEBUG] [LOCAL ] FTK: Loaded 32226 existing records from primary storage. [2025-09-30T18:52:10.401171] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-30T18:52:10.402955] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-30T18:52:10.403166] [INFO ] [MAIN ] FTK: Loaded 32226 existing records. [2025-09-30T18:52:10.404166] [DEBUG] [LOCAL ] FTV: Loaded 52922 existing records from primary storage. [2025-09-30T18:52:10.404216] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-30T18:52:10.416000] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-30T18:52:10.421398] [INFO ] [MAIN ] FTV: Loaded 52922 existing records. [2025-09-30T18:52:10.628635] [DEBUG] [LOCAL ] FTS: Loaded 42097 existing records from primary storage. [2025-09-30T18:52:10.686310] [INFO ] [MAIN ] FTS: Loaded 42097 existing records. [2025-09-30T18:52:11.111618] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:11.241469] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-30T18:52:11.242622] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-30T18:52:11.247385] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:11.326479] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-30T18:52:11.354769] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-30T18:52:11.382679] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-30T18:52:11.457776] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-30T18:52:11.461394] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:11.499522] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-30T18:52:11.505189] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-30T18:52:11.499803] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-30T18:52:11.600831] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-30T18:52:11.615221] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:11.687939] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-30T18:52:11.688302] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-30T18:52:11.688474] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-30T18:52:12.566622] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T18:52:12.596324] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-30T18:52:12.627243] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:12.672217] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:12.678954] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-30T18:52:12.686008] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-30T18:52:12.766680] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:12.767265] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-30T18:52:13.241884] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T18:52:13.243634] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-30T18:52:13.749724] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-30T18:52:13.751436] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-30T18:52:13.767162] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T18:52:13.773129] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-30T18:52:14.188485] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-30T18:52:14.189790] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-30T18:52:14.219479] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T18:52:14.228335] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-30T18:52:14.453913] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T18:52:14.465164] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-30T18:52:14.470323] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-30T18:52:14.471817] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-30T18:52:14.866888] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T18:52:14.868229] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-30T18:52:14.887798] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T18:52:14.898390] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-30T18:52:15.370740] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-30T18:52:15.395406] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T18:52:15.454411] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-30T18:52:15.789747] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:52:15.977209] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T18:52:15.991443] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:52:16.254410] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-30T18:52:17.054412] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-30T18:52:17.727205] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T18:52:17.854333] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-30T18:52:18.022566] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T18:52:18.654383] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-30T18:52:19.290399] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T18:52:19.454382] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-30T18:52:20.254388] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-30T18:52:20.332863] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T18:52:20.545059] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T18:52:21.054361] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-30T18:52:21.560598] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-30T18:52:21.863823] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-30T18:52:21.869830] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T18:52:22.410328] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-30T18:52:22.411404] [INFO ] [REMOTE ] FTWO: Full fetch complete (3449 records). [2025-09-30T18:52:22.411477] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-30T18:52:22.663720] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-30T18:52:22.790661] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-30T18:52:22.790752] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-30T18:52:22.790883] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-30T18:52:22.790926] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-30T18:52:22.791281] [DEBUG] [LOCAL ] FTWO: Trimmed 3449 records to 1807 (keeping 200 days of data) [2025-09-30T18:52:22.804521] [DEBUG] [LOCAL ] FTWO: Primary data saved (1807 records). [2025-09-30T18:52:22.804606] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-30T18:52:22.804708] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 13.6s. Estimated remaining: 3h 9m 58s. Rate: 7.8 symbols/min [2025-09-30T18:52:22.981394] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:23.035451] [DEBUG] [LOCAL ] FUBO: Loaded 53695 existing records from primary storage. [2025-09-30T18:52:23.035901] [INFO ] [MAIN ] FUBO: Loaded 53695 existing records. [2025-09-30T18:52:23.229994] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:23.230301] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-30T18:52:23.230356] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-30T18:52:23.230743] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-30T18:52:23.230802] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-30T18:52:23.464148] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-30T18:52:23.619994] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:23.917416] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T18:52:24.254400] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-30T18:52:25.054366] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-30T18:52:25.278204] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T18:52:25.854336] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-30T18:52:26.036476] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-30T18:52:26.654356] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-30T18:52:26.741562] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T18:52:27.360724] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T18:52:27.454364] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-30T18:52:28.254373] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-30T18:52:28.894823] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T18:52:29.054420] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-30T18:52:29.092827] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-30T18:52:29.854341] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-30T18:52:29.969449] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T18:52:30.580919] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T18:52:30.654359] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-30T18:52:30.956601] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T18:52:31.454377] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-30T18:52:32.254324] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-30T18:52:32.445169] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T18:52:33.054358] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-30T18:52:33.327549] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T18:52:33.575135] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T18:52:33.854360] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-30T18:52:34.654339] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-30T18:52:34.783561] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T18:52:35.454364] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-30T18:52:36.062994] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-30T18:52:36.132441] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T18:52:36.254363] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-30T18:52:36.621013] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T18:52:36.628237] [INFO ] [REMOTE ] FTK: Full fetch complete (42845 records). [2025-09-30T18:52:36.628356] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-30T18:52:37.027000] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-30T18:52:37.027102] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-30T18:52:37.027833] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-30T18:52:37.027899] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-30T18:52:37.028991] [DEBUG] [LOCAL ] FTK: Trimmed 42845 records to 32180 (keeping 200 days of data) [2025-09-30T18:52:37.079026] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-30T18:52:37.225089] [DEBUG] [LOCAL ] FTK: Primary data saved (32180 records). [2025-09-30T18:52:37.225227] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-30T18:52:37.225309] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTK took 28.0s. Estimated remaining: 3h 10m 2s. Rate: 7.8 symbols/min [2025-09-30T18:52:37.411078] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:37.444629] [DEBUG] [LOCAL ] FUL: Loaded 33014 existing records from primary storage. [2025-09-30T18:52:37.444984] [INFO ] [MAIN ] FUL: Loaded 33014 existing records. [2025-09-30T18:52:37.648672] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:37.649005] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-30T18:52:37.649059] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-30T18:52:37.649329] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-30T18:52:37.649389] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-30T18:52:37.866784] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-30T18:52:38.092446] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:38.193231] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T18:52:38.654394] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-30T18:52:38.780167] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T18:52:38.789407] [INFO ] [REMOTE ] FTS: Full fetch complete (60173 records). [2025-09-30T18:52:38.789532] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-30T18:52:39.220046] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-30T18:52:39.220139] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-30T18:52:39.221074] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-30T18:52:39.221141] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-30T18:52:39.223635] [DEBUG] [LOCAL ] FTS: Trimmed 60173 records to 42106 (keeping 200 days of data) [2025-09-30T18:52:39.454479] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-30T18:52:39.512670] [DEBUG] [LOCAL ] FTS: Primary data saved (42106 records). [2025-09-30T18:52:39.512847] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-30T18:52:39.512953] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTS took 30.3s. Estimated remaining: 3h 9m 45s. Rate: 7.8 symbols/min [2025-09-30T18:52:39.713005] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:39.767340] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-30T18:52:39.791964] [DEBUG] [LOCAL ] FUN: Loaded 51585 existing records from primary storage. [2025-09-30T18:52:39.792456] [INFO ] [MAIN ] FUN: Loaded 51585 existing records. [2025-09-30T18:52:40.010017] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:40.010295] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-30T18:52:40.010369] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-30T18:52:40.010915] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-30T18:52:40.010999] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-30T18:52:40.229283] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-30T18:52:40.266473] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-30T18:52:40.470745] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:41.054363] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-30T18:52:41.293224] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T18:52:41.351742] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T18:52:41.854376] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-30T18:52:42.566504] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T18:52:42.654368] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-30T18:52:43.382308] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T18:52:43.394500] [INFO ] [REMOTE ] FTV: Full fetch complete (76296 records). [2025-09-30T18:52:43.394782] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-30T18:52:43.465311] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-30T18:52:43.829904] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-30T18:52:43.829989] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-30T18:52:43.830991] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-30T18:52:43.831061] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-30T18:52:43.832704] [DEBUG] [LOCAL ] FTV: Trimmed 76296 records to 52927 (keeping 200 days of data) [2025-09-30T18:52:44.189470] [DEBUG] [LOCAL ] FTV: Primary data saved (52927 records). [2025-09-30T18:52:44.189682] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-30T18:52:44.189816] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTV took 35.0s. Estimated remaining: 3h 9m 32s. Rate: 7.8 symbols/min [2025-09-30T18:52:44.259412] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-30T18:52:44.385332] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:52:44.406041] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T18:52:44.432291] [DEBUG] [LOCAL ] FVR: Loaded 21881 existing records from primary storage. [2025-09-30T18:52:44.432548] [INFO ] [MAIN ] FVR: Loaded 21881 existing records. [2025-09-30T18:52:44.647415] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:52:44.647622] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-30T18:52:44.647707] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-30T18:52:44.648072] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-30T18:52:44.648170] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-30T18:52:45.078174] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-30T18:52:45.085408] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:52:45.096336] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-30T18:52:45.550379] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T18:52:45.854348] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-30T18:52:46.543909] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T18:52:46.654400] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-30T18:52:46.931390] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T18:52:47.454372] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-30T18:52:48.254355] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-30T18:52:48.455751] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T18:52:48.736581] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-30T18:52:49.054361] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-30T18:52:49.398069] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T18:52:49.854374] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-30T18:52:49.986617] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T18:52:50.654355] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-30T18:52:51.454222] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T18:52:51.454427] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-30T18:52:52.254368] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-30T18:52:52.957338] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:52:53.008768] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T18:52:53.056602] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-30T18:52:53.063129] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-30T18:52:53.854333] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-30T18:52:54.085370] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T18:52:54.654358] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-30T18:52:55.454361] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-30T18:52:55.777344] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T18:52:55.910532] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:52:56.254375] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-30T18:52:56.654854] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T18:52:57.037099] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T18:52:57.054310] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-30T18:52:57.854360] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-30T18:52:58.654389] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-30T18:52:58.719846] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T18:52:59.014749] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T18:52:59.454367] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-30T18:53:00.254379] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-30T18:53:01.054341] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-30T18:53:01.226152] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-30T18:53:01.238535] [INFO ] [REMOTE ] FUBO: Full fetch complete (77764 records). [2025-09-30T18:53:01.238703] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-30T18:53:01.384383] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T18:53:01.698485] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-30T18:53:01.723376] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-30T18:53:01.733792] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-30T18:53:01.734951] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-30T18:53:01.735364] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-30T18:53:01.737885] [DEBUG] [LOCAL ] FUBO: Trimmed 77764 records to 53697 (keeping 200 days of data) [2025-09-30T18:53:01.854690] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-30T18:53:02.095822] [DEBUG] [LOCAL ] FUBO: Primary data saved (53697 records). [2025-09-30T18:53:02.096511] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-30T18:53:02.099290] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUBO took 39.3s. Estimated remaining: 3h 9m 42s. Rate: 7.8 symbols/min [2025-09-30T18:53:02.097084] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T18:53:02.291534] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:02.339544] [DEBUG] [LOCAL ] FVRR: Loaded 40008 existing records from primary storage. [2025-09-30T18:53:02.339955] [INFO ] [MAIN ] FVRR: Loaded 40008 existing records. [2025-09-30T18:53:02.538023] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:02.538310] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-30T18:53:02.538360] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-30T18:53:02.538887] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-30T18:53:02.538948] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-30T18:53:02.659491] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-30T18:53:02.929027] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:03.454817] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-30T18:53:03.614315] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T18:53:03.777738] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T18:53:04.254413] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-30T18:53:05.054380] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-30T18:53:05.103830] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T18:53:05.341198] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T18:53:05.345706] [INFO ] [REMOTE ] FVR: Full fetch complete (30267 records). [2025-09-30T18:53:05.345826] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-30T18:53:05.759165] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-30T18:53:05.759254] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-30T18:53:05.759891] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-30T18:53:05.759958] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-30T18:53:05.760975] [DEBUG] [LOCAL ] FVR: Trimmed 30267 records to 21794 (keeping 200 days of data) [2025-09-30T18:53:05.858154] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-30T18:53:05.903283] [DEBUG] [LOCAL ] FVR: Primary data saved (21794 records). [2025-09-30T18:53:05.903423] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-30T18:53:05.903506] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FVR took 21.7s. Estimated remaining: 3h 9m 28s. Rate: 7.8 symbols/min [2025-09-30T18:53:06.091152] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:06.094313] [DEBUG] [LOCAL ] FXED: Loaded 1240 existing records from primary storage. [2025-09-30T18:53:06.094489] [INFO ] [MAIN ] FXED: Loaded 1240 existing records. [2025-09-30T18:53:06.318394] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:06.318889] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-30T18:53:06.318958] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-30T18:53:06.319197] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-30T18:53:06.319257] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-30T18:53:06.655761] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-30T18:53:06.739147] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:06.776098] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T18:53:07.455718] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:53:07.454691] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-30T18:53:07.811059] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-30T18:53:07.997595] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T18:53:08.254428] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-30T18:53:09.054407] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-30T18:53:09.624335] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T18:53:09.854379] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-30T18:53:10.131348] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-30T18:53:10.554843] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T18:53:10.564544] [INFO ] [REMOTE ] FUL: Full fetch complete (47446 records). [2025-09-30T18:53:10.564759] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-30T18:53:10.659482] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-30T18:53:10.997828] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-30T18:53:10.997932] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-30T18:53:10.998737] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-30T18:53:10.998804] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-30T18:53:11.002059] [DEBUG] [LOCAL ] FUL: Trimmed 47446 records to 33034 (keeping 200 days of data) [2025-09-30T18:53:11.074464] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-30T18:53:11.223085] [DEBUG] [LOCAL ] FUL: Primary data saved (33034 records). [2025-09-30T18:53:11.223244] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-30T18:53:11.223414] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FUL took 34.0s. Estimated remaining: 3h 9m 16s. Rate: 7.8 symbols/min [2025-09-30T18:53:11.405996] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:11.452636] [DEBUG] [LOCAL ] G: Loaded 49797 existing records from primary storage. [2025-09-30T18:53:11.452987] [INFO ] [MAIN ] G: Loaded 49797 existing records. [2025-09-30T18:53:11.463744] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-30T18:53:11.646839] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:11.647050] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-30T18:53:11.647099] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-30T18:53:11.647462] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-30T18:53:11.647521] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-30T18:53:12.034451] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:12.254435] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-30T18:53:12.602376] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T18:53:12.855133] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:53:13.054372] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-30T18:53:13.854447] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-30T18:53:14.275613] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T18:53:14.654377] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-30T18:53:15.069756] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T18:53:15.454367] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-30T18:53:16.197804] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T18:53:16.254331] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-30T18:53:16.842111] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T18:53:16.879287] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T18:53:17.054386] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-30T18:53:17.854403] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-30T18:53:18.643010] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T18:53:18.654262] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-30T18:53:18.949595] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T18:53:19.454409] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-30T18:53:20.254359] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-30T18:53:20.422971] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:53:20.434361] [INFO ] [REMOTE ] FUN: Full fetch complete (72811 records). [2025-09-30T18:53:20.434582] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-30T18:53:20.852661] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-30T18:53:20.852765] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-30T18:53:20.853814] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-30T18:53:20.853885] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-30T18:53:20.855442] [DEBUG] [LOCAL ] FUN: Trimmed 72811 records to 51596 (keeping 200 days of data) [2025-09-30T18:53:21.063837] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-30T18:53:21.173978] [DEBUG] [LOCAL ] FUN: Primary data saved (51596 records). [2025-09-30T18:53:21.174120] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-30T18:53:21.174312] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FUN took 41.7s. Estimated remaining: 3h 9m 12s. Rate: 7.8 symbols/min [2025-09-30T18:53:21.357744] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:21.387562] [DEBUG] [LOCAL ] GAB: Loaded 28038 existing records from primary storage. [2025-09-30T18:53:21.387918] [INFO ] [MAIN ] GAB: Loaded 28038 existing records. [2025-09-30T18:53:21.439870] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-30T18:53:21.674547] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:21.677860] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-30T18:53:21.678096] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-30T18:53:21.679415] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T18:53:21.679459] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-30T18:53:21.682388] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-30T18:53:21.860078] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-30T18:53:22.105051] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:22.171495] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-30T18:53:22.654416] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-30T18:53:23.090766] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-30T18:53:23.162256] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (3.71 seconds). [2025-09-30T18:53:23.454361] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-30T18:53:23.745201] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-30T18:53:24.254396] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-30T18:53:25.054343] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-30T18:53:25.256491] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T18:53:25.854379] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-30T18:53:26.217559] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-30T18:53:26.390523] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-30T18:53:26.391484] [INFO ] [REMOTE ] FXED: Full fetch complete (1793 records). [2025-09-30T18:53:26.391558] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-30T18:53:26.662364] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-30T18:53:26.826055] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-30T18:53:26.826140] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-30T18:53:26.826241] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-30T18:53:26.826282] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-30T18:53:26.826681] [DEBUG] [LOCAL ] FXED: Trimmed 1793 records to 1236 (keeping 200 days of data) [2025-09-30T18:53:26.836481] [DEBUG] [LOCAL ] FXED: Primary data saved (1236 records). [2025-09-30T18:53:26.836564] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-30T18:53:26.836684] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FXED took 20.9s. Estimated remaining: 3h 9m 1s. Rate: 7.8 symbols/min [2025-09-30T18:53:27.022333] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:27.032088] [DEBUG] [LOCAL ] GAM: Loaded 4065 existing records from primary storage. [2025-09-30T18:53:27.032299] [INFO ] [MAIN ] GAM: Loaded 4065 existing records. [2025-09-30T18:53:27.228349] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:27.228674] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-30T18:53:27.228796] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-30T18:53:27.229020] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-30T18:53:27.229083] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-30T18:53:27.460251] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-30T18:53:27.654428] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:27.940711] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-30T18:53:28.254391] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-30T18:53:29.051170] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T18:53:29.059704] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-30T18:53:29.346041] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T18:53:29.854329] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-30T18:53:30.193249] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T18:53:30.654325] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-30T18:53:31.454324] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-30T18:53:31.504036] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T18:53:31.527472] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-30T18:53:32.254330] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-30T18:53:32.925631] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T18:53:33.054318] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-30T18:53:33.650566] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T18:53:33.854375] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-30T18:53:34.336216] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T18:53:34.654413] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-30T18:53:35.454395] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-30T18:53:35.620313] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-30T18:53:35.633490] [INFO ] [REMOTE ] G: Full fetch complete (71607 records). [2025-09-30T18:53:35.633662] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-30T18:53:36.067722] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-30T18:53:36.067916] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-30T18:53:36.080263] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-30T18:53:36.097537] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-30T18:53:36.100033] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T18:53:36.110569] [DEBUG] [LOCAL ] G: Trimmed 71607 records to 49805 (keeping 200 days of data) [2025-09-30T18:53:36.301228] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-30T18:53:36.442058] [DEBUG] [LOCAL ] G: Primary data saved (49805 records). [2025-09-30T18:53:36.442202] [INFO ] [MAIN ] G: Full history saved. [2025-09-30T18:53:36.442290] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. G took 25.2s. Estimated remaining: 3h 8m 57s. Rate: 7.8 symbols/min [2025-09-30T18:53:36.632538] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:36.691677] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-30T18:53:36.692041] [INFO ] [MAIN ] GAP: Loaded 53655 existing records. [2025-09-30T18:53:36.848572] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T18:53:36.915412] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:36.915713] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-30T18:53:36.915776] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-30T18:53:36.916235] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-30T18:53:36.916295] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-30T18:53:37.067427] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-30T18:53:37.313073] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:37.685794] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-30T18:53:37.854360] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-30T18:53:38.624258] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T18:53:38.654399] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-30T18:53:39.322849] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-30T18:53:39.454329] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-30T18:53:39.694245] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-30T18:53:39.703308] [INFO ] [REMOTE ] FVRR: Full fetch complete (58851 records). [2025-09-30T18:53:39.703459] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-30T18:53:40.116137] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-30T18:53:40.116245] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-30T18:53:40.117108] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-30T18:53:40.117186] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-30T18:53:40.118527] [DEBUG] [LOCAL ] FVRR: Trimmed 58851 records to 40051 (keeping 200 days of data) [2025-09-30T18:53:40.291955] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-30T18:53:40.371712] [DEBUG] [LOCAL ] FVRR: Primary data saved (40051 records). [2025-09-30T18:53:40.371846] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-30T18:53:40.372556] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. FVRR took 38.3s. Estimated remaining: 3h 8m 43s. Rate: 7.8 symbols/min [2025-09-30T18:53:40.553337] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:40.576617] [DEBUG] [LOCAL ] GATX: Loaded 18170 existing records from primary storage. [2025-09-30T18:53:40.576896] [INFO ] [MAIN ] GATX: Loaded 18170 existing records. [2025-09-30T18:53:40.768153] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:40.768423] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-30T18:53:40.768471] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-30T18:53:40.768875] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-30T18:53:40.768935] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-30T18:53:41.064853] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-30T18:53:41.180953] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:41.213153] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T18:53:41.481376] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T18:53:41.543351] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-30T18:53:41.854365] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-30T18:53:42.654366] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-30T18:53:42.861287] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T18:53:43.454381] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-30T18:53:43.880917] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T18:53:44.254363] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-30T18:53:45.054356] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-30T18:53:45.314681] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T18:53:45.544548] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T18:53:45.854330] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-30T18:53:46.156028] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-30T18:53:46.654379] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-30T18:53:46.932496] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T18:53:47.454336] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-30T18:53:47.597275] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T18:53:48.254364] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-30T18:53:48.957924] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T18:53:49.054355] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-30T18:53:49.632884] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T18:53:49.633074] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-30T18:53:49.643421] [INFO ] [REMOTE ] GAB: Full fetch complete (39791 records). [2025-09-30T18:53:49.643606] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-30T18:53:49.859480] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-30T18:53:50.046561] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-30T18:53:50.046663] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-30T18:53:50.047397] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-30T18:53:50.047453] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-30T18:53:50.048560] [DEBUG] [LOCAL ] GAB: Trimmed 39791 records to 28043 (keeping 200 days of data) [2025-09-30T18:53:50.211908] [DEBUG] [LOCAL ] GAB: Primary data saved (28043 records). [2025-09-30T18:53:50.212107] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-30T18:53:50.212206] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAB took 29.0s. Estimated remaining: 3h 8m 39s. Rate: 7.8 symbols/min [2025-09-30T18:53:50.405714] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:50.421742] [DEBUG] [LOCAL ] GBAB: Loaded 13065 existing records from primary storage. [2025-09-30T18:53:50.421983] [INFO ] [MAIN ] GBAB: Loaded 13065 existing records. [2025-09-30T18:53:50.616769] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:50.617034] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-30T18:53:50.617091] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-30T18:53:50.617404] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-30T18:53:50.617464] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-30T18:53:50.661524] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-30T18:53:50.992466] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:51.287925] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T18:53:51.454368] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-30T18:53:51.872441] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-30T18:53:52.254354] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-30T18:53:52.464256] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T18:53:52.599584] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-30T18:53:53.054352] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-30T18:53:53.854323] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-30T18:53:54.010847] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T18:53:54.654371] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-30T18:53:54.956979] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T18:53:55.265083] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T18:53:55.454386] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-30T18:53:56.254415] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-30T18:53:56.353796] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T18:53:56.355918] [INFO ] [REMOTE ] GAM: Full fetch complete (6780 records). [2025-09-30T18:53:56.356050] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-30T18:53:56.975980] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-30T18:53:56.976065] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-30T18:53:56.976266] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-30T18:53:56.976312] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-30T18:53:56.976863] [DEBUG] [LOCAL ] GAM: Trimmed 6780 records to 4066 (keeping 200 days of data) [2025-09-30T18:53:57.005454] [DEBUG] [LOCAL ] GAM: Primary data saved (4066 records). [2025-09-30T18:53:57.005617] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-30T18:53:57.005761] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. GAM took 30.2s. Estimated remaining: 3h 8m 30s. Rate: 7.8 symbols/min [2025-09-30T18:53:57.061389] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-30T18:53:57.242729] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:53:57.303082] [DEBUG] [LOCAL ] GBCI: Loaded 40061 existing records from primary storage. [2025-09-30T18:53:57.303434] [INFO ] [MAIN ] GBCI: Loaded 40061 existing records. [2025-09-30T18:53:57.495298] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:53:57.495581] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-30T18:53:57.495631] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-30T18:53:57.496112] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-30T18:53:57.496185] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-30T18:53:57.859558] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-30T18:53:57.929074] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:53:58.149437] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T18:53:58.329034] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T18:53:58.654395] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-30T18:53:58.861899] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T18:53:59.454362] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-30T18:54:00.254345] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-30T18:54:00.747837] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-30T18:54:00.761822] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:54:00.904908] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-30T18:54:01.054381] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-30T18:54:01.854404] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-30T18:54:02.654362] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-30T18:54:02.800130] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T18:54:03.095105] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-30T18:54:03.454722] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-30T18:54:03.457055] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T18:54:04.254375] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-30T18:54:05.054362] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-30T18:54:05.184194] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-30T18:54:05.363049] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T18:54:05.854368] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-30T18:54:05.984592] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T18:54:06.654387] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-30T18:54:07.172317] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T18:54:07.421458] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T18:54:07.454382] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-30T18:54:08.254348] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-30T18:54:08.641343] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T18:54:08.646444] [INFO ] [REMOTE ] GATX: Full fetch complete (25306 records). [2025-09-30T18:54:08.646555] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-30T18:54:09.056005] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-30T18:54:09.070107] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-30T18:54:09.071549] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-30T18:54:09.072198] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-30T18:54:09.072280] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-30T18:54:09.073345] [DEBUG] [LOCAL ] GATX: Trimmed 25306 records to 18178 (keeping 200 days of data) [2025-09-30T18:54:09.202102] [DEBUG] [LOCAL ] GATX: Primary data saved (18178 records). [2025-09-30T18:54:09.202253] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-30T18:54:09.202337] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GATX took 28.8s. Estimated remaining: 3h 8m 30s. Rate: 7.8 symbols/min [2025-09-30T18:54:09.399472] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:09.399785] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-30T18:54:09.406798] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-30T18:54:09.413014] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-30T18:54:09.412458] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-30T18:54:09.418541] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-30T18:54:09.418718] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-30T18:54:09.418794] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-30T18:54:09.860616] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-30T18:54:09.866552] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:10.654416] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-30T18:54:10.701567] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T18:54:11.130711] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-30T18:54:11.454370] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-30T18:54:11.801501] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-30T18:54:12.254396] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-30T18:54:12.413940] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-30T18:54:13.054366] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-30T18:54:13.701518] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T18:54:13.854329] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-30T18:54:14.015335] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T18:54:14.654368] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-30T18:54:15.447166] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T18:54:15.454313] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-30T18:54:15.672346] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T18:54:15.684435] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-09-30T18:54:15.684598] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-30T18:54:16.120914] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-30T18:54:16.121029] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-30T18:54:16.122076] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-30T18:54:16.122177] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-30T18:54:16.123800] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 53655 (keeping 200 days of data) [2025-09-30T18:54:16.223385] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-30T18:54:16.230845] [INFO ] [REMOTE ] GBAB: Full fetch complete (19890 records). [2025-09-30T18:54:16.231806] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-30T18:54:16.261934] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-30T18:54:16.784443] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-30T18:54:16.784848] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-30T18:54:16.785931] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-30T18:54:16.786252] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-30T18:54:16.789533] [DEBUG] [LOCAL ] GBAB: Trimmed 19890 records to 13066 (keeping 200 days of data) [2025-09-30T18:54:16.948884] [DEBUG] [LOCAL ] GBAB: Primary data saved (13066 records). [2025-09-30T18:54:16.967356] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-30T18:54:16.968676] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GBAB took 26.8s. Estimated remaining: 3h 8m 22s. Rate: 7.8 symbols/min [2025-09-30T18:54:17.059774] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-30T18:54:17.182498] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:17.215358] [DEBUG] [LOCAL ] GAP: Primary data saved (53655 records). [2025-09-30T18:54:17.215671] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-30T18:54:17.215812] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GAP took 40.8s. Estimated remaining: 3h 8m 2s. Rate: 7.8 symbols/min [2025-09-30T18:54:17.345506] [DEBUG] [LOCAL ] GBTG: Loaded 40026 existing records from primary storage. [2025-09-30T18:54:17.367120] [INFO ] [MAIN ] GBTG: Loaded 40026 existing records. [2025-09-30T18:54:17.369830] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-30T18:54:17.528046] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:17.646575] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:54:17.647018] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-30T18:54:17.647076] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-30T18:54:17.647604] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-30T18:54:17.647790] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-30T18:54:17.836568] [DEBUG] [LOCAL ] GBX: Loaded 29132 existing records from primary storage. [2025-09-30T18:54:17.854947] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-30T18:54:17.872914] [INFO ] [MAIN ] GBX: Loaded 29132 existing records. [2025-09-30T18:54:18.327605] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-30T18:54:18.327430] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:18.334864] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:54:18.338939] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T18:54:18.347788] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-30T18:54:18.348033] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-30T18:54:18.348841] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-30T18:54:18.348903] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-30T18:54:18.655728] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-30T18:54:18.738631] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:19.106414] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-30T18:54:19.454375] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-30T18:54:20.254350] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-30T18:54:20.626059] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T18:54:21.054384] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-30T18:54:21.421148] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T18:54:21.854401] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-30T18:54:22.240991] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-30T18:54:22.636215] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T18:54:22.654352] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-30T18:54:23.454380] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-30T18:54:23.725388] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-30T18:54:23.907444] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T18:54:24.254420] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-30T18:54:25.054314] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-30T18:54:25.290517] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-30T18:54:25.520399] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T18:54:25.854354] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-30T18:54:26.654375] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-30T18:54:26.987798] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T18:54:27.454390] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-30T18:54:27.882925] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-30T18:54:28.109356] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T18:54:28.254413] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-30T18:54:29.054366] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-30T18:54:29.573771] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T18:54:29.854369] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-30T18:54:30.502636] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:54:30.654364] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-30T18:54:31.084675] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-30T18:54:31.085579] [INFO ] [REMOTE ] GBLI: Full fetch complete (1319 records). [2025-09-30T18:54:31.085676] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-30T18:54:31.305249] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-30T18:54:31.307095] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T18:54:31.305922] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-30T18:54:31.313803] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-30T18:54:31.314175] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-30T18:54:31.314243] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-30T18:54:31.314281] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-30T18:54:31.314321] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-30T18:54:31.314385] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBLI took 22.1s. Estimated remaining: 3h 8m 5s. Rate: 7.8 symbols/min [2025-09-30T18:54:31.459468] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-30T18:54:31.505473] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:31.546227] [DEBUG] [LOCAL ] GCI: Loaded 44152 existing records from primary storage. [2025-09-30T18:54:31.546533] [INFO ] [MAIN ] GCI: Loaded 44152 existing records. [2025-09-30T18:54:31.731696] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:54:31.731932] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-30T18:54:31.731981] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-30T18:54:31.732236] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-30T18:54:31.732298] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-30T18:54:32.113785] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:32.254353] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-30T18:54:32.840454] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T18:54:33.054397] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-30T18:54:33.650614] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T18:54:33.854369] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-30T18:54:34.654326] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-30T18:54:34.757118] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T18:54:35.332867] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T18:54:35.454397] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-30T18:54:36.214314] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T18:54:36.254354] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-30T18:54:36.978765] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:54:37.054397] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-30T18:54:37.406251] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T18:54:37.854381] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-30T18:54:38.182967] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T18:54:38.654427] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-30T18:54:39.089013] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T18:54:39.454335] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-30T18:54:39.699071] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T18:54:40.254377] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-30T18:54:40.683872] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T18:54:41.054362] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-30T18:54:41.638041] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T18:54:41.854389] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-30T18:54:42.532346] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T18:54:42.654377] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-30T18:54:43.091722] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T18:54:43.454368] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-30T18:54:44.219181] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T18:54:44.228431] [INFO ] [REMOTE ] GBCI: Full fetch complete (58126 records). [2025-09-30T18:54:44.228581] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-30T18:54:44.263092] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-30T18:54:44.658241] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-30T18:54:44.658378] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-30T18:54:44.664591] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-30T18:54:44.664715] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-30T18:54:44.676878] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T18:54:44.684301] [DEBUG] [LOCAL ] GBCI: Trimmed 58126 records to 40042 (keeping 200 days of data) [2025-09-30T18:54:44.944450] [DEBUG] [LOCAL ] GBCI: Primary data saved (40042 records). [2025-09-30T18:54:44.944589] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-30T18:54:44.944698] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBCI took 47.9s. Estimated remaining: 3h 8m 8s. Rate: 7.8 symbols/min [2025-09-30T18:54:45.059513] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-30T18:54:45.137634] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:45.163936] [DEBUG] [LOCAL ] GCO: Loaded 24869 existing records from primary storage. [2025-09-30T18:54:45.164212] [INFO ] [MAIN ] GCO: Loaded 24869 existing records. [2025-09-30T18:54:45.392495] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:54:45.392779] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-30T18:54:45.392834] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-30T18:54:45.393244] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-30T18:54:45.393311] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-30T18:54:45.778964] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:45.811400] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T18:54:45.854344] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-30T18:54:46.619181] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T18:54:46.654307] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-30T18:54:46.789238] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T18:54:46.794610] [INFO ] [REMOTE ] GBX: Full fetch complete (42786 records). [2025-09-30T18:54:46.794735] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-30T18:54:47.216377] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-30T18:54:47.216486] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-30T18:54:47.217325] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-30T18:54:47.217394] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-30T18:54:47.218508] [DEBUG] [LOCAL ] GBX: Trimmed 42786 records to 29176 (keeping 200 days of data) [2025-09-30T18:54:47.410050] [DEBUG] [LOCAL ] GBX: Primary data saved (29176 records). [2025-09-30T18:54:47.410194] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-30T18:54:47.410279] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBX took 30.2s. Estimated remaining: 3h 7m 51s. Rate: 7.8 symbols/min [2025-09-30T18:54:47.459690] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-30T18:54:47.608989] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:47.632368] [DEBUG] [LOCAL ] GCTS: Loaded 19896 existing records from primary storage. [2025-09-30T18:54:47.632703] [INFO ] [MAIN ] GCTS: Loaded 19896 existing records. [2025-09-30T18:54:47.832439] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:54:47.832832] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-30T18:54:47.832898] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-30T18:54:47.833376] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-30T18:54:47.833443] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-30T18:54:47.943169] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T18:54:48.259737] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-30T18:54:48.305029] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:48.734803] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T18:54:49.054377] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-30T18:54:49.817258] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T18:54:49.826499] [INFO ] [REMOTE ] GBTG: Full fetch complete (56654 records). [2025-09-30T18:54:49.826637] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-30T18:54:49.865129] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-30T18:54:50.258192] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-30T18:54:50.258314] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-30T18:54:50.259180] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-30T18:54:50.259246] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-30T18:54:50.276356] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T18:54:50.281399] [DEBUG] [LOCAL ] GBTG: Trimmed 56654 records to 40050 (keeping 200 days of data) [2025-09-30T18:54:50.515749] [DEBUG] [LOCAL ] GBTG: Primary data saved (40050 records). [2025-09-30T18:54:50.515877] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-30T18:54:50.515956] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GBTG took 33.5s. Estimated remaining: 3h 7m 36s. Rate: 7.8 symbols/min [2025-09-30T18:54:50.660853] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-30T18:54:50.696631] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:54:50.707487] [DEBUG] [LOCAL ] GCV: Loaded 7301 existing records from primary storage. [2025-09-30T18:54:50.707883] [INFO ] [MAIN ] GCV: Loaded 7301 existing records. [2025-09-30T18:54:50.899813] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:54:50.900025] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-30T18:54:50.900072] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-30T18:54:50.900275] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-30T18:54:50.900333] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-30T18:54:51.282110] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:54:51.454425] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-30T18:54:51.506568] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T18:54:51.714843] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T18:54:51.963304] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-30T18:54:52.254400] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-30T18:54:53.058366] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-30T18:54:53.060383] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-30T18:54:53.854392] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-30T18:54:54.449903] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T18:54:54.654372] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-30T18:54:55.236420] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T18:54:55.454384] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-30T18:54:55.492755] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T18:54:56.254345] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-30T18:54:56.324239] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T18:54:57.054364] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-30T18:54:57.555833] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-30T18:54:57.624667] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T18:54:57.854379] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-30T18:54:58.654427] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-30T18:54:59.410001] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T18:54:59.454324] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-30T18:54:59.581319] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T18:55:00.254356] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-30T18:55:01.054334] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-30T18:55:01.129282] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-30T18:55:01.278379] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T18:55:01.684400] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-30T18:55:01.854352] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-30T18:55:02.654342] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-30T18:55:02.881247] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T18:55:03.454384] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-30T18:55:03.788824] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T18:55:04.254386] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-30T18:55:05.054341] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-30T18:55:05.201431] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T18:55:05.210906] [INFO ] [REMOTE ] GCI: Full fetch complete (63157 records). [2025-09-30T18:55:05.211071] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-30T18:55:05.646336] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T18:55:05.693943] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-30T18:55:05.694160] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-30T18:55:05.695252] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-30T18:55:05.695752] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-30T18:55:05.697763] [DEBUG] [LOCAL ] GCI: Trimmed 63157 records to 44090 (keeping 200 days of data) [2025-09-30T18:55:05.790525] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T18:55:05.874293] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-30T18:55:05.972627] [DEBUG] [LOCAL ] GCI: Primary data saved (44090 records). [2025-09-30T18:55:05.972818] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-30T18:55:05.973701] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCI took 34.7s. Estimated remaining: 3h 7m 41s. Rate: 7.8 symbols/min [2025-09-30T18:55:06.162624] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:06.211083] [DEBUG] [LOCAL ] GD: Loaded 47179 existing records from primary storage. [2025-09-30T18:55:06.211435] [INFO ] [MAIN ] GD: Loaded 47179 existing records. [2025-09-30T18:55:06.395219] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:06.395478] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-30T18:55:06.395539] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-30T18:55:06.395949] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-30T18:55:06.396017] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-30T18:55:06.659552] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-30T18:55:06.790382] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:06.912674] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T18:55:07.454378] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-30T18:55:07.747671] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T18:55:08.254401] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-30T18:55:09.059492] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-30T18:55:09.075130] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T18:55:09.502028] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-30T18:55:09.564568] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-30T18:55:09.854362] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-30T18:55:10.654364] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-30T18:55:10.987086] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T18:55:10.992207] [INFO ] [REMOTE ] GCO: Full fetch complete (35526 records). [2025-09-30T18:55:10.992307] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-30T18:55:11.401360] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-30T18:55:11.401438] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-30T18:55:11.402100] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-30T18:55:11.402165] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-30T18:55:11.403089] [DEBUG] [LOCAL ] GCO: Trimmed 35526 records to 24721 (keeping 200 days of data) [2025-09-30T18:55:11.455328] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-30T18:55:11.569412] [DEBUG] [LOCAL ] GCO: Primary data saved (24721 records). [2025-09-30T18:55:11.569685] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-30T18:55:11.569847] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCO took 26.6s. Estimated remaining: 3h 7m 30s. Rate: 7.8 symbols/min [2025-09-30T18:55:11.767968] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:11.824811] [DEBUG] [LOCAL ] GDDY: Loaded 49651 existing records from primary storage. [2025-09-30T18:55:11.825385] [INFO ] [MAIN ] GDDY: Loaded 49651 existing records. [2025-09-30T18:55:11.977558] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T18:55:12.047328] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:12.047615] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-30T18:55:12.047701] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-30T18:55:12.048174] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-30T18:55:12.048234] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-30T18:55:12.259557] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-30T18:55:12.431714] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:13.035030] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T18:55:13.054350] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-30T18:55:13.317853] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T18:55:13.494102] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T18:55:13.854397] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-30T18:55:14.654380] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-30T18:55:15.214704] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T18:55:15.454375] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-30T18:55:16.254350] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-30T18:55:16.322408] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T18:55:16.325167] [INFO ] [REMOTE ] GCV: Full fetch complete (9325 records). [2025-09-30T18:55:16.325262] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-30T18:55:16.696792] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-30T18:55:16.799963] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-30T18:55:16.800055] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-30T18:55:16.800300] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-30T18:55:16.800340] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-30T18:55:16.800878] [DEBUG] [LOCAL ] GCV: Trimmed 9325 records to 7318 (keeping 200 days of data) [2025-09-30T18:55:16.846795] [DEBUG] [LOCAL ] GCV: Primary data saved (7318 records). [2025-09-30T18:55:16.846944] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-30T18:55:16.847034] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCV took 26.3s. Estimated remaining: 3h 7m 19s. Rate: 7.8 symbols/min [2025-09-30T18:55:17.038732] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:17.046020] [DEBUG] [LOCAL ] GDIV: Loaded 3642 existing records from primary storage. [2025-09-30T18:55:17.046327] [INFO ] [MAIN ] GDIV: Loaded 3642 existing records. [2025-09-30T18:55:17.059879] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-30T18:55:17.257447] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:17.257765] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-30T18:55:17.257819] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-30T18:55:17.258043] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-30T18:55:17.258128] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-30T18:55:17.589422] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T18:55:17.682344] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:17.854394] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-30T18:55:18.220771] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-30T18:55:18.646300] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:55:18.657236] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-30T18:55:19.454419] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-30T18:55:20.109351] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-30T18:55:20.254344] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-30T18:55:20.444951] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-30T18:55:21.054386] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-30T18:55:21.854356] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-30T18:55:22.075754] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T18:55:22.538275] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T18:55:22.654380] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-30T18:55:23.084075] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T18:55:23.091486] [INFO ] [REMOTE ] GCTS: Full fetch complete (26879 records). [2025-09-30T18:55:23.091687] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-30T18:55:23.459484] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-30T18:55:23.521180] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-30T18:55:23.521284] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-30T18:55:23.521964] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-30T18:55:23.522043] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-30T18:55:23.523128] [DEBUG] [LOCAL ] GCTS: Trimmed 26879 records to 19897 (keeping 200 days of data) [2025-09-30T18:55:23.663039] [DEBUG] [LOCAL ] GCTS: Primary data saved (19897 records). [2025-09-30T18:55:23.663207] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-30T18:55:23.663298] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GCTS took 36.3s. Estimated remaining: 3h 7m 10s. Rate: 7.8 symbols/min [2025-09-30T18:55:23.867280] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:23.867506] [DEBUG] [LOCAL ] GDL: No existing data file found in primary storage. [2025-09-30T18:55:23.867563] [WARN ] [MAIN ] GDL: No existing data found, performing full refresh instead. [2025-09-30T18:55:23.867731] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-30T18:55:23.867799] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-30T18:55:23.867858] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-30T18:55:23.867897] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-30T18:55:24.174256] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T18:55:24.258831] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-30T18:55:24.304031] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:24.373681] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T18:55:25.054369] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-30T18:55:25.635004] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-30T18:55:25.854380] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-30T18:55:26.078913] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T18:55:26.411951] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T18:55:26.654448] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-30T18:55:27.239262] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-30T18:55:27.454409] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-30T18:55:28.254397] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-30T18:55:29.054386] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-30T18:55:29.214955] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T18:55:29.466006] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-30T18:55:29.630301] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T18:55:29.854424] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-30T18:55:30.226704] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-30T18:55:30.654398] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-30T18:55:31.454442] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-30T18:55:31.939477] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T18:55:32.254389] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-30T18:55:32.300285] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T18:55:32.553388] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-30T18:55:33.054372] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-30T18:55:33.854364] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-30T18:55:34.465912] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T18:55:34.654373] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-30T18:55:34.787801] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T18:55:35.111919] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T18:55:35.454369] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-30T18:55:36.254374] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-30T18:55:36.805408] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-30T18:55:37.054378] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-30T18:55:37.100229] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T18:55:37.537930] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-30T18:55:37.854340] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-30T18:55:38.422840] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-30T18:55:38.424179] [INFO ] [REMOTE ] GDIV: Full fetch complete (5476 records). [2025-09-30T18:55:38.424254] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-30T18:55:38.664436] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-30T18:55:38.846795] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-30T18:55:38.846886] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-30T18:55:38.847069] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-30T18:55:38.847161] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-30T18:55:38.847985] [DEBUG] [LOCAL ] GDIV: Trimmed 5476 records to 3635 (keeping 200 days of data) [2025-09-30T18:55:38.871846] [DEBUG] [LOCAL ] GDIV: Primary data saved (3635 records). [2025-09-30T18:55:38.871948] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-30T18:55:38.872097] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GDIV took 22.0s. Estimated remaining: 3h 7m 14s. Rate: 7.8 symbols/min [2025-09-30T18:55:39.055060] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:39.066144] [DEBUG] [LOCAL ] GDO: Loaded 5949 existing records from primary storage. [2025-09-30T18:55:39.066382] [INFO ] [MAIN ] GDO: Loaded 5949 existing records. [2025-09-30T18:55:39.281424] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:39.281803] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-30T18:55:39.281880] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-30T18:55:39.282142] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-30T18:55:39.282229] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-30T18:55:39.459512] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-30T18:55:39.690388] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:40.019075] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T18:55:40.254368] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-30T18:55:40.639061] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T18:55:41.054531] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-30T18:55:41.854331] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-30T18:55:42.045678] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T18:55:42.055863] [INFO ] [REMOTE ] GD: Full fetch complete (70415 records). [2025-09-30T18:55:42.056043] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-30T18:55:42.351889] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T18:55:42.555759] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-30T18:55:42.555887] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-30T18:55:42.556923] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-30T18:55:42.557027] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-30T18:55:42.559453] [DEBUG] [LOCAL ] GD: Trimmed 70415 records to 47170 (keeping 200 days of data) [2025-09-30T18:55:42.657288] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-30T18:55:42.689740] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T18:55:42.915689] [DEBUG] [LOCAL ] GD: Primary data saved (47170 records). [2025-09-30T18:55:42.915842] [INFO ] [MAIN ] GD: Full history saved. [2025-09-30T18:55:42.917155] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GD took 36.9s. Estimated remaining: 3h 7m 1s. Rate: 7.8 symbols/min [2025-09-30T18:55:43.102454] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:43.145522] [DEBUG] [LOCAL ] GDOT: Loaded 38421 existing records from primary storage. [2025-09-30T18:55:43.145894] [INFO ] [MAIN ] GDOT: Loaded 38421 existing records. [2025-09-30T18:55:43.332437] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:43.332687] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-30T18:55:43.332747] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-30T18:55:43.333129] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-30T18:55:43.333190] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-30T18:55:43.457295] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-30T18:55:43.737709] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:43.739074] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T18:55:43.980394] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T18:55:44.254365] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-30T18:55:44.939542] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T18:55:45.054410] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-30T18:55:45.854355] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-30T18:55:46.326945] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T18:55:46.373767] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T18:55:46.654392] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-30T18:55:47.454394] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-30T18:55:47.868263] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T18:55:48.254390] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-30T18:55:49.054335] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-30T18:55:49.261039] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T18:55:49.383156] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T18:55:49.431195] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T18:55:49.854435] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-30T18:55:50.654372] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-30T18:55:51.181011] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-30T18:55:51.187817] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T18:55:51.454370] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-30T18:55:52.254363] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-30T18:55:52.832434] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T18:55:53.054339] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-30T18:55:53.157218] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T18:55:53.452732] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-30T18:55:53.854374] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-30T18:55:54.503252] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T18:55:54.504569] [INFO ] [REMOTE ] GDL: Full fetch complete (3645 records). [2025-09-30T18:55:54.504660] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-30T18:55:54.671464] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-30T18:55:54.931569] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-09-30T18:55:54.931714] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-09-30T18:55:54.931876] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-09-30T18:55:54.931941] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-09-30T18:55:54.932340] [DEBUG] [LOCAL ] GDL: Trimmed 3645 records to 2563 (keeping 200 days of data) [2025-09-30T18:55:54.948734] [DEBUG] [LOCAL ] GDL: Primary data saved (2563 records). [2025-09-30T18:55:54.948852] [INFO ] [MAIN ] GDL: Full history saved. [2025-09-30T18:55:54.948927] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDL took 31.3s. Estimated remaining: 3h 7m 0s. Rate: 7.8 symbols/min [2025-09-30T18:55:55.154193] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:55.185317] [DEBUG] [LOCAL ] GDV: Loaded 19569 existing records from primary storage. [2025-09-30T18:55:55.185610] [INFO ] [MAIN ] GDV: Loaded 19569 existing records. [2025-09-30T18:55:55.424158] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:55.424433] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-30T18:55:55.424503] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-30T18:55:55.424769] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-30T18:55:55.424872] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-30T18:55:55.467163] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-30T18:55:55.867569] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:56.193319] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T18:55:56.204823] [INFO ] [REMOTE ] GDDY: Full fetch complete (71325 records). [2025-09-30T18:55:56.204995] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-30T18:55:56.265233] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-30T18:55:56.641708] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-30T18:55:56.641851] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-30T18:55:56.642895] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-30T18:55:56.643016] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-30T18:55:56.644711] [DEBUG] [LOCAL ] GDDY: Trimmed 71325 records to 49657 (keeping 200 days of data) [2025-09-30T18:55:56.934610] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T18:55:57.019585] [DEBUG] [LOCAL ] GDDY: Primary data saved (49657 records). [2025-09-30T18:55:57.019829] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-30T18:55:57.020214] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDDY took 45.5s. Estimated remaining: 3h 6m 44s. Rate: 7.8 symbols/min [2025-09-30T18:55:57.059451] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-30T18:55:57.222950] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:55:57.284423] [DEBUG] [LOCAL ] GE: Loaded 53713 existing records from primary storage. [2025-09-30T18:55:57.284800] [INFO ] [MAIN ] GE: Loaded 53713 existing records. [2025-09-30T18:55:57.479875] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:55:57.480156] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-30T18:55:57.480210] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-30T18:55:57.480842] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-30T18:55:57.480905] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-30T18:55:57.699920] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T18:55:57.869204] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-30T18:55:57.921484] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:55:58.546851] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T18:55:58.654361] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-30T18:55:58.672619] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T18:55:59.245010] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T18:55:59.454397] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-30T18:55:59.948127] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-30T18:56:00.254400] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-30T18:56:01.054388] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-30T18:56:01.152466] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T18:56:01.671816] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-30T18:56:01.854372] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-30T18:56:02.654392] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-30T18:56:03.454397] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-30T18:56:03.670218] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T18:56:04.027156] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-30T18:56:04.254385] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-30T18:56:04.561190] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T18:56:05.054336] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-30T18:56:05.175870] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T18:56:05.764696] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T18:56:05.854402] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-30T18:56:06.654359] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-30T18:56:07.454340] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-30T18:56:07.696551] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-30T18:56:07.845679] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-30T18:56:08.254390] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-30T18:56:08.624841] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T18:56:08.958466] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-30T18:56:08.961547] [INFO ] [REMOTE ] GDO: Full fetch complete (9278 records). [2025-09-30T18:56:08.961725] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-30T18:56:09.059586] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-30T18:56:09.380460] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-30T18:56:09.380586] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-30T18:56:09.380989] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-30T18:56:09.381088] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-30T18:56:09.381800] [DEBUG] [LOCAL ] GDO: Trimmed 9278 records to 5980 (keeping 200 days of data) [2025-09-30T18:56:09.432595] [DEBUG] [LOCAL ] GDO: Primary data saved (5980 records). [2025-09-30T18:56:09.432799] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-30T18:56:09.432959] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDO took 30.6s. Estimated remaining: 3h 6m 44s. Rate: 7.8 symbols/min [2025-09-30T18:56:09.636856] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:09.664924] [DEBUG] [LOCAL ] GEF: Loaded 20543 existing records from primary storage. [2025-09-30T18:56:09.665218] [INFO ] [MAIN ] GEF: Loaded 20543 existing records. [2025-09-30T18:56:09.854698] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-30T18:56:09.858905] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:09.861092] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-30T18:56:09.861153] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-30T18:56:09.861426] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-30T18:56:09.861500] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-30T18:56:10.260019] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:10.588825] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T18:56:10.654398] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-30T18:56:10.959568] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T18:56:11.454412] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-30T18:56:12.254334] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-30T18:56:12.552178] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T18:56:12.585886] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-30T18:56:13.054326] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-30T18:56:13.379302] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T18:56:13.854364] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-30T18:56:14.610447] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T18:56:14.620051] [INFO ] [REMOTE ] GDOT: Full fetch complete (52950 records). [2025-09-30T18:56:14.620211] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-30T18:56:14.659557] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-30T18:56:15.060282] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-30T18:56:15.060375] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-30T18:56:15.061264] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-30T18:56:15.061356] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-30T18:56:15.062718] [DEBUG] [LOCAL ] GDOT: Trimmed 52950 records to 38364 (keeping 200 days of data) [2025-09-30T18:56:15.310216] [DEBUG] [LOCAL ] GDOT: Primary data saved (38364 records). [2025-09-30T18:56:15.310365] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-30T18:56:15.311298] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDOT took 32.4s. Estimated remaining: 3h 6m 33s. Rate: 7.8 symbols/min [2025-09-30T18:56:15.459455] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-30T18:56:15.515808] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:15.567671] [DEBUG] [LOCAL ] GEL: Loaded 33432 existing records from primary storage. [2025-09-30T18:56:15.567975] [INFO ] [MAIN ] GEL: Loaded 33432 existing records. [2025-09-30T18:56:15.782895] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:15.794312] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T18:56:15.793872] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-30T18:56:15.799636] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-30T18:56:15.800753] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-30T18:56:15.800835] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-30T18:56:15.993314] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-30T18:56:16.268342] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-30T18:56:16.275629] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:16.534159] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-30T18:56:17.054367] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-30T18:56:17.268826] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T18:56:17.274430] [INFO ] [REMOTE ] GDV: Full fetch complete (28604 records). [2025-09-30T18:56:17.274570] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-30T18:56:17.696925] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-30T18:56:17.697009] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-30T18:56:17.697610] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-30T18:56:17.697681] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-30T18:56:17.698512] [DEBUG] [LOCAL ] GDV: Trimmed 28604 records to 19538 (keeping 200 days of data) [2025-09-30T18:56:17.833780] [DEBUG] [LOCAL ] GDV: Primary data saved (19538 records). [2025-09-30T18:56:17.833964] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-30T18:56:17.834104] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GDV took 22.9s. Estimated remaining: 3h 6m 17s. Rate: 7.8 symbols/min [2025-09-30T18:56:17.859510] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-30T18:56:18.037602] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:18.101864] [DEBUG] [LOCAL ] GENI: Loaded 52916 existing records from primary storage. [2025-09-30T18:56:18.102221] [INFO ] [MAIN ] GENI: Loaded 52916 existing records. [2025-09-30T18:56:18.310417] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:18.321367] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-30T18:56:18.322181] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-30T18:56:18.322081] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T18:56:18.327703] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-30T18:56:18.328462] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-30T18:56:18.659507] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-30T18:56:18.719072] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:19.454383] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-30T18:56:19.963457] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-30T18:56:20.070479] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T18:56:20.254394] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-30T18:56:20.978519] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-30T18:56:21.054395] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-30T18:56:21.555493] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T18:56:21.854407] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-30T18:56:22.654349] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-30T18:56:22.844546] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T18:56:23.056852] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-30T18:56:23.454357] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-30T18:56:24.171844] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T18:56:24.254393] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-30T18:56:25.054409] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-30T18:56:25.445400] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-30T18:56:25.855814] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-30T18:56:25.858909] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:56:26.465054] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T18:56:26.546722] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-30T18:56:26.654402] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-30T18:56:27.454395] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-30T18:56:27.737855] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T18:56:28.254366] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-30T18:56:29.029916] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:56:29.054307] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-30T18:56:29.190568] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T18:56:29.854361] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-30T18:56:30.654400] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-30T18:56:30.830045] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T18:56:31.211047] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T18:56:31.454363] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-30T18:56:31.743083] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T18:56:32.254348] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-30T18:56:32.803629] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T18:56:33.054375] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-30T18:56:33.854330] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-30T18:56:33.908289] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T18:56:33.978352] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T18:56:34.654364] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-30T18:56:34.979103] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-30T18:56:34.984987] [INFO ] [REMOTE ] GEL: Full fetch complete (48583 records). [2025-09-30T18:56:34.985094] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-30T18:56:35.397330] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-30T18:56:35.397413] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-30T18:56:35.398152] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-30T18:56:35.398217] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-30T18:56:35.399278] [DEBUG] [LOCAL ] GEL: Trimmed 48583 records to 33317 (keeping 200 days of data) [2025-09-30T18:56:35.455252] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-30T18:56:35.612012] [DEBUG] [LOCAL ] GEL: Primary data saved (33317 records). [2025-09-30T18:56:35.612158] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-30T18:56:35.612995] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GEL took 20.3s. Estimated remaining: 3h 6m 26s. Rate: 7.8 symbols/min [2025-09-30T18:56:35.804423] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:35.861798] [DEBUG] [LOCAL ] GEO: Loaded 51992 existing records from primary storage. [2025-09-30T18:56:35.862144] [INFO ] [MAIN ] GEO: Loaded 51992 existing records. [2025-09-30T18:56:36.057092] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:36.057346] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-30T18:56:36.057400] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-30T18:56:36.058252] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-30T18:56:36.058314] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-30T18:56:36.260564] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-30T18:56:36.490879] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:36.942840] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-30T18:56:37.054341] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-30T18:56:37.284155] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T18:56:37.480303] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T18:56:37.854367] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-30T18:56:38.654358] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-30T18:56:39.024344] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T18:56:39.298540] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-30T18:56:39.454364] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-30T18:56:40.254327] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-30T18:56:40.442181] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T18:56:40.549359] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-30T18:56:41.054366] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-30T18:56:41.854357] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-30T18:56:42.531136] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-30T18:56:42.550220] [INFO ] [REMOTE ] GE: Full fetch complete (77780 records). [2025-09-30T18:56:42.550389] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-30T18:56:42.660605] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-30T18:56:43.006790] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-30T18:56:43.006970] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-30T18:56:43.008040] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-30T18:56:43.008150] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-30T18:56:43.010299] [DEBUG] [LOCAL ] GE: Trimmed 77780 records to 53713 (keeping 200 days of data) [2025-09-30T18:56:43.135947] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-30T18:56:43.325802] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T18:56:43.450488] [DEBUG] [LOCAL ] GE: Primary data saved (53713 records). [2025-09-30T18:56:43.450627] [INFO ] [MAIN ] GE: Full history saved. [2025-09-30T18:56:43.450850] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GE took 46.4s. Estimated remaining: 3h 6m 18s. Rate: 7.8 symbols/min [2025-09-30T18:56:43.463116] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-30T18:56:43.637812] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:43.653436] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-30T18:56:43.659242] [INFO ] [REMOTE ] GEF: Full fetch complete (29355 records). [2025-09-30T18:56:43.659402] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-30T18:56:43.985947] [DEBUG] [LOCAL ] GES: Loaded 39554 existing records from primary storage. [2025-09-30T18:56:44.004236] [INFO ] [MAIN ] GES: Loaded 39554 existing records. [2025-09-30T18:56:44.272246] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-30T18:56:44.322903] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-30T18:56:44.326349] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:44.327325] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-30T18:56:44.327485] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-30T18:56:44.328175] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-30T18:56:44.328514] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-30T18:56:44.328454] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-30T18:56:44.329394] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-30T18:56:44.329459] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-30T18:56:44.341158] [DEBUG] [LOCAL ] GEF: Trimmed 29355 records to 20508 (keeping 200 days of data) [2025-09-30T18:56:44.836161] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:44.867194] [DEBUG] [LOCAL ] GEF: Primary data saved (20508 records). [2025-09-30T18:56:44.867356] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-30T18:56:44.867591] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GEF took 35.4s. Estimated remaining: 3h 6m 1s. Rate: 7.8 symbols/min [2025-09-30T18:56:45.057320] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:45.057538] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-30T18:56:45.095483] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T18:56:45.144289] [DEBUG] [LOCAL ] GETY: Loaded 35719 existing records from primary storage. [2025-09-30T18:56:45.144634] [INFO ] [MAIN ] GETY: Loaded 35719 existing records. [2025-09-30T18:56:45.329933] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:45.330161] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-30T18:56:45.330210] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-30T18:56:45.331319] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-30T18:56:45.331382] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-30T18:56:45.731824] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:45.854324] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-30T18:56:46.132455] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-30T18:56:46.342636] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T18:56:46.654403] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-30T18:56:47.205919] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T18:56:47.454352] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-30T18:56:48.026679] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T18:56:48.254362] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-30T18:56:49.054386] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-30T18:56:49.339038] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T18:56:49.350412] [INFO ] [REMOTE ] GENI: Full fetch complete (75466 records). [2025-09-30T18:56:49.350552] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-30T18:56:49.775834] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-30T18:56:49.775987] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-30T18:56:49.776927] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-30T18:56:49.777088] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-30T18:56:49.793474] [DEBUG] [LOCAL ] GENI: Trimmed 75466 records to 52925 (keeping 200 days of data) [2025-09-30T18:56:49.805258] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T18:56:49.861445] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-30T18:56:50.137840] [DEBUG] [LOCAL ] GENI: Primary data saved (52925 records). [2025-09-30T18:56:50.137997] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-30T18:56:50.138086] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GENI took 32.3s. Estimated remaining: 3h 5m 49s. Rate: 7.8 symbols/min [2025-09-30T18:56:50.334714] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:56:50.403260] [DEBUG] [LOCAL ] GEV: Loaded 53076 existing records from primary storage. [2025-09-30T18:56:50.403729] [INFO ] [MAIN ] GEV: Loaded 53076 existing records. [2025-09-30T18:56:50.661999] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-30T18:56:50.672639] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:56:50.674409] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-30T18:56:50.674534] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-30T18:56:50.677438] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-30T18:56:50.677633] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-30T18:56:51.213382] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-30T18:56:51.305579] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:56:51.342895] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T18:56:51.454415] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-30T18:56:52.157586] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T18:56:52.254390] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-30T18:56:53.054381] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-30T18:56:53.662861] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-30T18:56:53.706346] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T18:56:53.854382] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-30T18:56:54.584512] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T18:56:54.654387] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-30T18:56:55.454411] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-30T18:56:56.106747] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-30T18:56:56.248176] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T18:56:56.256963] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-30T18:56:56.901968] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:56:57.054387] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-30T18:56:57.854347] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-30T18:56:58.054743] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T18:56:58.556019] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T18:56:58.654365] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-30T18:56:59.454371] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-30T18:56:59.499349] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T18:56:59.995413] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T18:57:00.254361] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-30T18:57:00.980250] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:57:01.054341] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-30T18:57:01.629360] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T18:57:01.854404] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-30T18:57:01.978898] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T18:57:02.654397] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-30T18:57:03.283353] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T18:57:03.454372] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-30T18:57:03.970549] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T18:57:04.254361] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-30T18:57:05.054332] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-30T18:57:05.125081] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T18:57:05.561602] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T18:57:05.854372] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-30T18:57:06.482494] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T18:57:06.654372] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-30T18:57:07.249750] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T18:57:07.454392] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-30T18:57:08.073599] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T18:57:08.081687] [INFO ] [REMOTE ] GES: Full fetch complete (59579 records). [2025-09-30T18:57:08.081861] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-30T18:57:08.259622] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-30T18:57:08.539293] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-30T18:57:08.539403] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-30T18:57:08.540272] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-30T18:57:08.540390] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-30T18:57:08.541776] [DEBUG] [LOCAL ] GES: Trimmed 59579 records to 39447 (keeping 200 days of data) [2025-09-30T18:57:08.789835] [DEBUG] [LOCAL ] GES: Primary data saved (39447 records). [2025-09-30T18:57:08.789983] [INFO ] [MAIN ] GES: Full history saved. [2025-09-30T18:57:08.790105] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GES took 25.3s. Estimated remaining: 3h 5m 59s. Rate: 7.8 symbols/min [2025-09-30T18:57:08.972333] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:08.978487] [DEBUG] [LOCAL ] GF: Loaded 3023 existing records from primary storage. [2025-09-30T18:57:08.978696] [INFO ] [MAIN ] GF: Loaded 3023 existing records. [2025-09-30T18:57:09.059623] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-30T18:57:09.174664] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:09.175011] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-30T18:57:09.175078] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-30T18:57:09.175413] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-30T18:57:09.175474] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-30T18:57:09.574234] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:09.786461] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-30T18:57:09.856560] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-30T18:57:09.859804] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T18:57:10.102590] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-30T18:57:10.110011] [INFO ] [REMOTE ] GETY: Full fetch complete (55526 records). [2025-09-30T18:57:10.110145] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-30T18:57:10.517806] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-30T18:57:10.517912] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-30T18:57:10.518828] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-30T18:57:10.518898] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-30T18:57:10.520387] [DEBUG] [LOCAL ] GETY: Trimmed 55526 records to 35567 (keeping 200 days of data) [2025-09-30T18:57:10.670686] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-30T18:57:10.728186] [DEBUG] [LOCAL ] GETY: Primary data saved (35567 records). [2025-09-30T18:57:10.728342] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-30T18:57:10.728434] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GETY took 25.9s. Estimated remaining: 3h 5m 42s. Rate: 7.8 symbols/min [2025-09-30T18:57:11.454409] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-30T18:57:12.109204] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T18:57:12.234576] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-30T18:57:12.254311] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-30T18:57:12.447133] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T18:57:13.054381] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-30T18:57:13.854411] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-30T18:57:14.196605] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-30T18:57:14.331987] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-30T18:57:14.654356] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-30T18:57:14.940262] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T18:57:14.950919] [INFO ] [REMOTE ] GEO: Full fetch complete (75431 records). [2025-09-30T18:57:14.951064] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-30T18:57:15.306201] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-30T18:57:15.391434] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-30T18:57:15.391600] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-30T18:57:15.392765] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-30T18:57:15.392838] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-30T18:57:15.397703] [DEBUG] [LOCAL ] GEO: Trimmed 75431 records to 51949 (keeping 200 days of data) [2025-09-30T18:57:15.462856] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-30T18:57:15.727177] [DEBUG] [LOCAL ] GEO: Primary data saved (51949 records). [2025-09-30T18:57:15.727313] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-30T18:57:15.727397] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GEO took 40.1s. Estimated remaining: 3h 5m 30s. Rate: 7.8 symbols/min [2025-09-30T18:57:16.254382] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-30T18:57:17.223287] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T18:57:17.225501] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-30T18:57:17.757748] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-30T18:57:17.796037] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-30T18:57:17.854328] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-30T18:57:18.254222] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-30T18:57:18.654373] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-30T18:57:19.177113] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T18:57:19.454547] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-30T18:57:19.902519] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T18:57:20.254348] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-30T18:57:20.720622] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T18:57:21.054405] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-30T18:57:21.721036] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T18:57:21.722324] [INFO ] [REMOTE ] GF: Full fetch complete (5225 records). [2025-09-30T18:57:21.722500] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-30T18:57:21.859802] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-30T18:57:22.125879] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-30T18:57:22.125970] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-30T18:57:22.126181] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-30T18:57:22.126297] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-30T18:57:22.126799] [DEBUG] [LOCAL ] GF: Trimmed 5225 records to 2999 (keeping 200 days of data) [2025-09-30T18:57:22.146330] [DEBUG] [LOCAL ] GF: Primary data saved (2999 records). [2025-09-30T18:57:22.146420] [INFO ] [MAIN ] GF: Full history saved. [2025-09-30T18:57:22.146574] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GF took 13.4s. Estimated remaining: 3h 5m 21s. Rate: 7.8 symbols/min [2025-09-30T18:57:24.144960] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-30T18:57:24.158328] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-30T18:57:26.571583] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-30T18:57:26.582997] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-30T18:57:29.010856] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-30T18:57:29.025119] [INFO ] [REMOTE ] GEV: Full fetch complete (76926 records). [2025-09-30T18:57:29.025289] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-30T18:57:29.477231] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-30T18:57:29.477338] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-30T18:57:29.478402] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-30T18:57:29.478473] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-30T18:57:29.482034] [DEBUG] [LOCAL ] GEV: Trimmed 76926 records to 53059 (keeping 200 days of data) [2025-09-30T18:57:29.895411] [DEBUG] [LOCAL ] GEV: Primary data saved (53059 records). [2025-09-30T18:57:29.895552] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-30T18:57:29.895682] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 39.8s. Estimated remaining: 3h 5m 13s. Rate: 7.8 symbols/min [2025-09-30T18:57:30.524264] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:30.576076] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:30.668299] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:30.701132] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:30.710953] [DEBUG] [LOCAL ] GFR: Loaded 8377 existing records from primary storage. [2025-09-30T18:57:30.711313] [INFO ] [MAIN ] GFR: Loaded 8377 existing records. [2025-09-30T18:57:30.933011] [DEBUG] [LOCAL ] GFF: Loaded 30447 existing records from primary storage. [2025-09-30T18:57:30.957326] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:30.983536] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-30T18:57:30.983680] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-30T18:57:30.983332] [INFO ] [MAIN ] GFF: Loaded 30447 existing records. [2025-09-30T18:57:30.996053] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-30T18:57:31.024252] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-30T18:57:31.169776] [DEBUG] [LOCAL ] GFI: Loaded 53108 existing records from primary storage. [2025-09-30T18:57:31.226457] [INFO ] [MAIN ] GFI: Loaded 53108 existing records. [2025-09-30T18:57:31.243113] [DEBUG] [LOCAL ] GFL: Loaded 47965 existing records from primary storage. [2025-09-30T18:57:31.285467] [INFO ] [MAIN ] GFL: Loaded 47965 existing records. [2025-09-30T18:57:31.391060] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:31.502294] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-30T18:57:31.502457] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-30T18:57:31.651830] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-30T18:57:31.689987] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-30T18:57:31.959028] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:32.078246] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-30T18:57:32.133680] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:32.133821] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-30T18:57:32.172027] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-30T18:57:32.187686] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-30T18:57:32.236791] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-30T18:57:32.259128] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:32.265337] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-30T18:57:32.264427] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-30T18:57:32.252479] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-30T18:57:32.275510] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-30T18:57:32.831204] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:32.861368] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-30T18:57:33.267533] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:33.261171] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T18:57:33.277535] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-30T18:57:33.298832] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-30T18:57:33.363152] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:33.363525] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-30T18:57:33.821286] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T18:57:33.823950] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-30T18:57:34.251695] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T18:57:34.258034] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-30T18:57:34.297234] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T18:57:34.299837] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-30T18:57:34.797125] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T18:57:34.806046] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-30T18:57:35.036316] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-30T18:57:35.039717] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-30T18:57:35.179417] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T18:57:35.190182] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-30T18:57:35.255280] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T18:57:35.261663] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-30T18:57:35.650044] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T18:57:35.653842] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-30T18:57:36.043480] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T18:57:36.054754] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-30T18:57:36.302685] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-30T18:57:36.316170] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-30T18:57:36.316849] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-30T18:57:36.320708] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-30T18:57:36.712496] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-30T18:57:37.054353] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-30T18:57:37.127433] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-30T18:57:37.332581] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-30T18:57:37.655249] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T18:57:37.663332] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-30T18:57:37.854361] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-30T18:57:38.654361] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-30T18:57:39.079952] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T18:57:39.454352] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-30T18:57:40.026984] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-30T18:57:40.254356] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-30T18:57:40.369231] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T18:57:40.775444] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T18:57:40.777590] [INFO ] [REMOTE ] GFR: Full fetch complete (12616 records). [2025-09-30T18:57:40.777703] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-30T18:57:41.059492] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-30T18:57:41.162418] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-30T18:57:41.162511] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-30T18:57:41.162889] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-30T18:57:41.162999] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-30T18:57:41.163635] [DEBUG] [LOCAL ] GFR: Trimmed 12616 records to 8366 (keeping 200 days of data) [2025-09-30T18:57:41.210873] [DEBUG] [LOCAL ] GFR: Primary data saved (8366 records). [2025-09-30T18:57:41.211012] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-30T18:57:41.211113] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 11.3s. Estimated remaining: 3h 5m 11s. Rate: 7.8 symbols/min [2025-09-30T18:57:41.390038] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:41.438278] [DEBUG] [LOCAL ] GGB: Loaded 51072 existing records from primary storage. [2025-09-30T18:57:41.438629] [INFO ] [MAIN ] GGB: Loaded 51072 existing records. [2025-09-30T18:57:41.660678] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:41.661196] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-30T18:57:41.661287] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-30T18:57:41.663469] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-30T18:57:41.663549] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-30T18:57:41.856669] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-30T18:57:42.052979] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:42.614717] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T18:57:42.654433] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-30T18:57:43.237486] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T18:57:43.454433] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-30T18:57:44.254418] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-30T18:57:44.317859] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T18:57:45.054355] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-30T18:57:45.199128] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T18:57:45.514369] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T18:57:45.854383] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-30T18:57:46.508536] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T18:57:46.654369] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-30T18:57:47.454331] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-30T18:57:47.917793] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T18:57:48.033473] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-30T18:57:48.254399] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-30T18:57:48.834512] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T18:57:49.054429] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-30T18:57:49.854386] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-30T18:57:50.021245] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-30T18:57:50.133800] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T18:57:50.654395] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-30T18:57:51.454386] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-30T18:57:51.497607] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T18:57:51.976058] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T18:57:52.254396] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-30T18:57:53.054334] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-30T18:57:53.377244] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T18:57:53.494009] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T18:57:53.854410] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-30T18:57:54.149039] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T18:57:54.654371] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-30T18:57:55.139492] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T18:57:55.145351] [INFO ] [REMOTE ] GFF: Full fetch complete (44093 records). [2025-09-30T18:57:55.145483] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-30T18:57:55.459455] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-30T18:57:55.544885] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-30T18:57:55.544983] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-30T18:57:55.545907] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-30T18:57:55.545993] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-30T18:57:55.547474] [DEBUG] [LOCAL ] GFF: Trimmed 44093 records to 30408 (keeping 200 days of data) [2025-09-30T18:57:55.745526] [DEBUG] [LOCAL ] GFF: Primary data saved (30408 records). [2025-09-30T18:57:55.745686] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-30T18:57:55.745803] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 25.8s. Estimated remaining: 3h 5m 14s. Rate: 7.8 symbols/min [2025-09-30T18:57:55.935865] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:57:55.968992] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T18:57:56.017241] [DEBUG] [LOCAL ] GGG: Loaded 40907 existing records from primary storage. [2025-09-30T18:57:56.017589] [INFO ] [MAIN ] GGG: Loaded 40907 existing records. [2025-09-30T18:57:56.206475] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:57:56.206771] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-30T18:57:56.206823] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-30T18:57:56.208126] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-30T18:57:56.208208] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-30T18:57:56.259492] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-30T18:57:56.592392] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:57:57.054354] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-30T18:57:57.238178] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T18:57:57.508667] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T18:57:57.854373] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-30T18:57:58.496475] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-30T18:57:58.654380] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-30T18:57:59.454402] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-30T18:57:59.538368] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T18:58:00.254331] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-30T18:58:00.292707] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T18:58:01.051778] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T18:58:01.060081] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-30T18:58:01.657722] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T18:58:01.854366] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-30T18:58:02.252525] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T18:58:02.654380] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-30T18:58:03.454379] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-30T18:58:04.100382] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-30T18:58:04.116430] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T18:58:04.254379] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-30T18:58:04.980196] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T18:58:05.054430] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-30T18:58:05.854408] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-30T18:58:06.509918] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T18:58:06.538947] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-30T18:58:06.551998] [INFO ] [REMOTE ] GFI: Full fetch complete (76383 records). [2025-09-30T18:58:06.552158] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-30T18:58:06.663426] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-30T18:58:07.000891] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-30T18:58:07.000982] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-30T18:58:07.002011] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-30T18:58:07.002082] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-30T18:58:07.003725] [DEBUG] [LOCAL ] GFI: Trimmed 76383 records to 53102 (keeping 200 days of data) [2025-09-30T18:58:07.387223] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T18:58:07.402495] [INFO ] [REMOTE ] GFL: Full fetch complete (68991 records). [2025-09-30T18:58:07.403325] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-30T18:58:07.454835] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-30T18:58:07.694523] [DEBUG] [LOCAL ] GFI: Primary data saved (53102 records). [2025-09-30T18:58:07.730636] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-30T18:58:07.759561] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFI took 37.8s. Estimated remaining: 3h 5m 14s. Rate: 7.8 symbols/min [2025-09-30T18:58:08.040278] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-30T18:58:08.076928] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-30T18:58:08.109474] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:08.109920] [DEBUG] [LOCAL ] GGT: No existing data file found in primary storage. [2025-09-30T18:58:08.111002] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-30T18:58:08.110058] [WARN ] [MAIN ] GGT: No existing data found, performing full refresh instead. [2025-09-30T18:58:08.111104] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-30T18:58:08.111445] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-30T18:58:08.111505] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-30T18:58:08.111555] [DEBUG] [LOCAL ] GGT: No primary data file found to delete. [2025-09-30T18:58:08.111590] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-30T18:58:08.217574] [DEBUG] [LOCAL ] GFL: Trimmed 68991 records to 47943 (keeping 200 days of data) [2025-09-30T18:58:08.631948] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:08.633954] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-30T18:58:08.679669] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T18:58:08.711466] [INFO ] [REMOTE ] GGB: Full fetch complete (74046 records). [2025-09-30T18:58:08.715339] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-30T18:58:08.903114] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T18:58:09.057572] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-30T18:58:09.328708] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-30T18:58:09.329210] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-30T18:58:09.330736] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-30T18:58:09.330828] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-30T18:58:09.334991] [DEBUG] [LOCAL ] GGB: Trimmed 74046 records to 51085 (keeping 200 days of data) [2025-09-30T18:58:09.492377] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-30T18:58:09.620666] [DEBUG] [LOCAL ] GFL: Primary data saved (47943 records). [2025-09-30T18:58:09.621216] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-30T18:58:09.621706] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFL took 39.7s. Estimated remaining: 3h 4m 57s. Rate: 7.8 symbols/min [2025-09-30T18:58:09.825337] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:09.833053] [DEBUG] [LOCAL ] GGZ: Loaded 2412 existing records from primary storage. [2025-09-30T18:58:09.833816] [INFO ] [MAIN ] GGZ: Loaded 2412 existing records. [2025-09-30T18:58:09.859787] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-30T18:58:10.051743] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:10.051979] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-30T18:58:10.052028] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-30T18:58:10.052347] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-30T18:58:10.052426] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-30T18:58:10.524721] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:10.539346] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T18:58:10.563526] [DEBUG] [LOCAL ] GGB: Primary data saved (51085 records). [2025-09-30T18:58:10.572207] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-30T18:58:10.573429] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T18:58:10.573613] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGB took 29.4s. Estimated remaining: 3h 4m 39s. Rate: 7.8 symbols/min [2025-09-30T18:58:10.660606] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-30T18:58:10.812731] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:10.817702] [DEBUG] [LOCAL ] GHC: Loaded 2660 existing records from primary storage. [2025-09-30T18:58:10.817960] [INFO ] [MAIN ] GHC: Loaded 2660 existing records. [2025-09-30T18:58:11.012118] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:11.012325] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-30T18:58:11.012373] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-30T18:58:11.012691] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-30T18:58:11.012752] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-30T18:58:11.459914] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-30T18:58:11.459810] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:11.475601] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T18:58:12.254372] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-30T18:58:12.671998] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-30T18:58:12.876977] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T18:58:13.054422] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-30T18:58:13.718027] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T18:58:13.854397] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-30T18:58:14.413999] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T18:58:14.654390] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-30T18:58:15.454367] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-30T18:58:15.459184] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-30T18:58:16.044388] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T18:58:16.254407] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-30T18:58:17.054339] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-30T18:58:17.063209] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T18:58:17.593902] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T18:58:17.854359] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-30T18:58:18.654413] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-30T18:58:19.001815] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T18:58:19.069609] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T18:58:19.454367] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-30T18:58:20.022102] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T18:58:20.254399] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-30T18:58:21.054353] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-30T18:58:21.227379] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T18:58:21.401217] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-30T18:58:21.854365] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-30T18:58:22.654401] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-30T18:58:23.393330] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T18:58:23.454363] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-30T18:58:23.637269] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T18:58:24.254402] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-30T18:58:24.658187] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T18:58:24.794578] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-30T18:58:25.054374] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-30T18:58:25.476425] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-30T18:58:25.854417] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-30T18:58:26.654365] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-30T18:58:27.281062] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T18:58:27.283472] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T18:58:27.294315] [INFO ] [REMOTE ] GGG: Full fetch complete (59289 records). [2025-09-30T18:58:27.294426] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-30T18:58:27.459447] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-30T18:58:27.792707] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-30T18:58:27.792797] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-30T18:58:27.793574] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-30T18:58:27.793637] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-30T18:58:27.796485] [DEBUG] [LOCAL ] GGG: Trimmed 59289 records to 40945 (keeping 200 days of data) [2025-09-30T18:58:28.060598] [DEBUG] [LOCAL ] GGG: Primary data saved (40945 records). [2025-09-30T18:58:28.060763] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-30T18:58:28.060855] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGG took 32.3s. Estimated remaining: 3h 4m 46s. Rate: 7.8 symbols/min [2025-09-30T18:58:28.248196] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:28.253447] [DEBUG] [LOCAL ] GHG: Loaded 3192 existing records from primary storage. [2025-09-30T18:58:28.253742] [INFO ] [MAIN ] GHG: Loaded 3192 existing records. [2025-09-30T18:58:28.259638] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-30T18:58:28.396548] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T18:58:28.474907] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:28.475148] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-30T18:58:28.475201] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-30T18:58:28.475456] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-30T18:58:28.475520] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-30T18:58:28.895930] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:28.909799] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T18:58:29.054378] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-30T18:58:29.854344] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-30T18:58:30.071311] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-30T18:58:30.075147] [INFO ] [REMOTE ] GGT: Full fetch complete (18749 records). [2025-09-30T18:58:30.075227] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-30T18:58:30.416445] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T18:58:30.479345] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-30T18:58:30.479429] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-30T18:58:30.479959] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-30T18:58:30.480023] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-30T18:58:30.480676] [DEBUG] [LOCAL ] GGT: Trimmed 18749 records to 14105 (keeping 200 days of data) [2025-09-30T18:58:30.574175] [DEBUG] [LOCAL ] GGT: Primary data saved (14105 records). [2025-09-30T18:58:30.574313] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-30T18:58:30.574389] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGT took 22.8s. Estimated remaining: 3h 4m 31s. Rate: 7.8 symbols/min [2025-09-30T18:58:30.661711] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-30T18:58:30.766517] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:30.779311] [DEBUG] [LOCAL ] GHI: Loaded 6929 existing records from primary storage. [2025-09-30T18:58:30.779557] [INFO ] [MAIN ] GHI: Loaded 6929 existing records. [2025-09-30T18:58:30.980074] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:30.980312] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-30T18:58:30.980362] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-30T18:58:30.980639] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-30T18:58:30.980757] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-30T18:58:31.295014] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-30T18:58:31.379994] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:31.454314] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-30T18:58:32.254349] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-30T18:58:32.394315] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T18:58:32.682036] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-30T18:58:33.054339] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-30T18:58:33.516337] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-30T18:58:33.854365] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-30T18:58:34.275502] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-30T18:58:34.654360] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-30T18:58:35.230573] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T18:58:35.232232] [INFO ] [REMOTE ] GGZ: Full fetch complete (4161 records). [2025-09-30T18:58:35.232334] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-30T18:58:35.462765] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-30T18:58:35.787444] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-30T18:58:35.787569] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-30T18:58:35.787879] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-30T18:58:35.787963] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-30T18:58:35.788841] [DEBUG] [LOCAL ] GGZ: Trimmed 4161 records to 2407 (keeping 200 days of data) [2025-09-30T18:58:35.817470] [DEBUG] [LOCAL ] GGZ: Primary data saved (2407 records). [2025-09-30T18:58:35.817692] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-30T18:58:35.817839] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGZ took 26.2s. Estimated remaining: 3h 4m 19s. Rate: 7.8 symbols/min [2025-09-30T18:58:35.979590] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-30T18:58:36.083909] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:36.092528] [DEBUG] [LOCAL ] GHLD: Loaded 4162 existing records from primary storage. [2025-09-30T18:58:36.092812] [INFO ] [MAIN ] GHLD: Loaded 4162 existing records. [2025-09-30T18:58:36.259620] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-30T18:58:36.342380] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:36.342687] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-30T18:58:36.342749] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-30T18:58:36.343087] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-30T18:58:36.343150] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-30T18:58:36.736695] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:36.919424] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T18:58:37.054367] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-30T18:58:37.404028] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-30T18:58:37.854350] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-30T18:58:38.525795] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-30T18:58:38.654364] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-30T18:58:39.379388] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T18:58:39.454362] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-30T18:58:40.149229] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-30T18:58:40.254326] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-30T18:58:40.933117] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-30T18:58:41.054401] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-30T18:58:41.366917] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-30T18:58:41.854362] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-30T18:58:42.615658] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T18:58:42.654345] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-30T18:58:43.406414] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-30T18:58:43.454366] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-30T18:58:43.943101] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-30T18:58:44.254390] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-30T18:58:45.054379] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-30T18:58:45.080589] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-30T18:58:45.520002] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T18:58:45.854399] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-30T18:58:46.297740] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-30T18:58:46.654365] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-30T18:58:47.177865] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-30T18:58:47.179146] [INFO ] [REMOTE ] GHC: Full fetch complete (3303 records). [2025-09-30T18:58:47.179225] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-30T18:58:47.459537] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-30T18:58:47.575600] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-30T18:58:47.575718] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-30T18:58:47.575875] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-30T18:58:47.575947] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-30T18:58:47.576478] [DEBUG] [LOCAL ] GHC: Trimmed 3303 records to 2667 (keeping 200 days of data) [2025-09-30T18:58:47.594766] [DEBUG] [LOCAL ] GHC: Primary data saved (2667 records). [2025-09-30T18:58:47.594853] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-30T18:58:47.594933] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHC took 37.0s. Estimated remaining: 3h 4m 18s. Rate: 7.8 symbols/min [2025-09-30T18:58:47.783558] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:47.798161] [DEBUG] [LOCAL ] GHM: Loaded 13966 existing records from primary storage. [2025-09-30T18:58:47.798406] [INFO ] [MAIN ] GHM: Loaded 13966 existing records. [2025-09-30T18:58:47.881694] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T18:58:48.004927] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:48.005166] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-30T18:58:48.005216] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-30T18:58:48.005837] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-30T18:58:48.005899] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-30T18:58:48.264090] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-30T18:58:48.393129] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:48.940013] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T18:58:49.054392] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-30T18:58:49.854385] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-30T18:58:50.052243] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T18:58:50.510964] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T18:58:50.654373] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-30T18:58:51.228840] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T18:58:51.454396] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-30T18:58:52.251761] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T18:58:52.253986] [INFO ] [REMOTE ] GHI: Full fetch complete (11717 records). [2025-09-30T18:58:52.254064] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-30T18:58:52.259515] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-30T18:58:52.657712] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-30T18:58:52.657804] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-30T18:58:52.658135] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-30T18:58:52.658198] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-30T18:58:52.658688] [DEBUG] [LOCAL ] GHI: Trimmed 11717 records to 7001 (keeping 200 days of data) [2025-09-30T18:58:52.710369] [DEBUG] [LOCAL ] GHI: Primary data saved (7001 records). [2025-09-30T18:58:52.710543] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-30T18:58:52.710668] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHI took 22.1s. Estimated remaining: 3h 4m 6s. Rate: 7.8 symbols/min [2025-09-30T18:58:52.827397] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T18:58:52.904259] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:58:52.926240] [DEBUG] [LOCAL ] GHY: Loaded 20963 existing records from primary storage. [2025-09-30T18:58:52.926503] [INFO ] [MAIN ] GHY: Loaded 20963 existing records. [2025-09-30T18:58:53.059481] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-30T18:58:53.123908] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:58:53.124151] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-30T18:58:53.124206] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-30T18:58:53.124950] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-30T18:58:53.125013] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-30T18:58:53.502519] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:58:53.854373] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-30T18:58:53.957502] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-30T18:58:54.654385] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-30T18:58:54.826366] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T18:58:55.110372] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T18:58:55.454387] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-30T18:58:56.254345] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-30T18:58:56.512832] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T18:58:57.054369] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-30T18:58:57.489407] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T18:58:57.547400] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T18:58:57.854382] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-30T18:58:58.654323] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-30T18:58:58.888747] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T18:58:58.956779] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-30T18:58:59.454371] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-30T18:59:00.254793] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-30T18:59:00.255550] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T18:59:00.859695] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T18:59:01.054370] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-30T18:59:01.760932] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T18:59:01.854398] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-30T18:59:02.379688] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-30T18:59:02.654405] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-30T18:59:03.409250] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T18:59:03.454388] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-30T18:59:04.194425] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T18:59:04.254393] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-30T18:59:04.742971] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-30T18:59:05.054364] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-30T18:59:05.781694] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-30T18:59:05.854351] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-30T18:59:06.447211] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T18:59:06.654376] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-30T18:59:07.332865] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T18:59:07.334275] [INFO ] [REMOTE ] GHG: Full fetch complete (4016 records). [2025-09-30T18:59:07.334382] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-30T18:59:07.459447] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-30T18:59:07.724738] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-30T18:59:07.724821] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-30T18:59:07.724948] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-30T18:59:07.724986] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-30T18:59:07.725347] [DEBUG] [LOCAL ] GHG: Trimmed 4016 records to 3182 (keeping 200 days of data) [2025-09-30T18:59:07.744064] [DEBUG] [LOCAL ] GHG: Primary data saved (3182 records). [2025-09-30T18:59:07.744175] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-30T18:59:07.744256] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHG took 39.7s. Estimated remaining: 3h 4m 10s. Rate: 7.8 symbols/min [2025-09-30T18:59:07.929454] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:07.965148] [DEBUG] [LOCAL ] GIB: Loaded 32054 existing records from primary storage. [2025-09-30T18:59:07.965450] [INFO ] [MAIN ] GIB: Loaded 32054 existing records. [2025-09-30T18:59:08.153423] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:08.153633] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-30T18:59:08.153739] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-30T18:59:08.154404] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-30T18:59:08.154466] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-30T18:59:08.259103] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-30T18:59:08.496707] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T18:59:08.568941] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:08.879537] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-30T18:59:09.054370] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-30T18:59:09.854350] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-30T18:59:10.158986] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T18:59:10.477477] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-30T18:59:10.654359] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-30T18:59:11.454324] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-30T18:59:11.502708] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T18:59:12.254374] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-30T18:59:12.701712] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T18:59:13.054374] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-30T18:59:13.216897] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T18:59:13.734832] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T18:59:13.736373] [INFO ] [REMOTE ] GHLD: Full fetch complete (4753 records). [2025-09-30T18:59:13.736442] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-30T18:59:13.859460] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-30T18:59:14.134462] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-30T18:59:14.134546] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-30T18:59:14.134725] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-30T18:59:14.134788] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-30T18:59:14.135243] [DEBUG] [LOCAL ] GHLD: Trimmed 4753 records to 4166 (keeping 200 days of data) [2025-09-30T18:59:14.162592] [DEBUG] [LOCAL ] GHLD: Primary data saved (4166 records). [2025-09-30T18:59:14.162759] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-30T18:59:14.162850] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHLD took 38.3s. Estimated remaining: 3h 4m 0s. Rate: 7.8 symbols/min [2025-09-30T18:59:14.343017] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:14.359260] [DEBUG] [LOCAL ] GIC: Loaded 13539 existing records from primary storage. [2025-09-30T18:59:14.359526] [INFO ] [MAIN ] GIC: Loaded 13539 existing records. [2025-09-30T18:59:14.551149] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:14.551366] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-30T18:59:14.551417] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-30T18:59:14.551612] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-30T18:59:14.551715] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-30T18:59:14.663392] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-30T18:59:14.971919] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:15.067997] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T18:59:15.454400] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-30T18:59:15.932230] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T18:59:16.242451] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T18:59:16.254323] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-30T18:59:17.054394] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-30T18:59:17.570169] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T18:59:17.799142] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T18:59:17.854383] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-30T18:59:18.654341] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-30T18:59:18.891359] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T18:59:19.411553] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-30T18:59:19.418141] [INFO ] [REMOTE ] GHY: Full fetch complete (32176 records). [2025-09-30T18:59:19.418331] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-30T18:59:19.459531] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-30T18:59:19.846809] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-30T18:59:19.846928] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-30T18:59:19.847617] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-30T18:59:19.847706] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-30T18:59:19.848563] [DEBUG] [LOCAL ] GHY: Trimmed 32176 records to 20887 (keeping 200 days of data) [2025-09-30T18:59:19.986396] [DEBUG] [LOCAL ] GHY: Primary data saved (20887 records). [2025-09-30T18:59:19.986583] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-30T18:59:19.986712] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHY took 27.3s. Estimated remaining: 3h 3m 50s. Rate: 7.8 symbols/min [2025-09-30T18:59:20.168923] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:20.214018] [DEBUG] [LOCAL ] GIL: Loaded 43252 existing records from primary storage. [2025-09-30T18:59:20.214324] [INFO ] [MAIN ] GIL: Loaded 43252 existing records. [2025-09-30T18:59:20.259479] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-30T18:59:20.402089] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:20.402437] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-30T18:59:20.402587] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-30T18:59:20.403564] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-30T18:59:20.403626] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-30T18:59:20.547785] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T18:59:20.798476] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:21.054381] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-30T18:59:21.565951] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T18:59:21.854400] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-30T18:59:21.957607] [DEBUG] [REMOTE ] GIC: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-30T18:59:21.957964] [WARN ] [REMOTE ] GIC: No data returned for month 2025-03 [2025-09-30T18:59:21.958086] [FATAL] [REMOTE ] GIC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T18:59:21.958218] [FATAL] [MAIN ] GIC: Failed to fetch primary data. [2025-09-30T18:59:21.958284] [WARN ] [MAIN ] GIC: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T18:59:21.958354] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-30T18:59:21.958431] [DEBUG] [LOCAL ] GIC: No primary data file found to delete. [2025-09-30T18:59:21.958487] [INFO ] [LOCAL ] GIC: Starting deletion of derivative data. [2025-09-30T18:59:21.958894] [DEBUG] [LOCAL ] GIC: Deleted derivative data file. [2025-09-30T18:59:21.958984] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GIC took 7.8s. Estimated remaining: 3h 3m 33s. Rate: 7.8 symbols/min [2025-09-30T18:59:22.151184] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:22.192723] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T18:59:22.196887] [INFO ] [REMOTE ] GHM: Full fetch complete (21710 records). [2025-09-30T18:59:22.197031] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-30T18:59:22.335196] [DEBUG] [LOCAL ] GIS: Loaded 53673 existing records from primary storage. [2025-09-30T18:59:22.376392] [INFO ] [MAIN ] GIS: Loaded 53673 existing records. [2025-09-30T18:59:22.659477] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-30T18:59:22.777669] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:22.793261] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-30T18:59:22.808213] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-30T18:59:22.821581] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-30T18:59:22.836846] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-30T18:59:22.916512] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-30T18:59:22.933351] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-30T18:59:22.945753] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-30T18:59:22.945856] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-30T18:59:22.971906] [DEBUG] [LOCAL ] GHM: Trimmed 21710 records to 14041 (keeping 200 days of data) [2025-09-30T18:59:23.326707] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:23.344945] [DEBUG] [LOCAL ] GHM: Primary data saved (14041 records). [2025-09-30T18:59:23.345100] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-30T18:59:23.345193] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GHM took 35.8s. Estimated remaining: 3h 3m 16s. Rate: 7.8 symbols/min [2025-09-30T18:59:23.459391] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-30T18:59:23.567157] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:23.604768] [DEBUG] [LOCAL ] GKOS: Loaded 42728 existing records from primary storage. [2025-09-30T18:59:23.605090] [INFO ] [MAIN ] GKOS: Loaded 42728 existing records. [2025-09-30T18:59:23.792775] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:23.792991] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-30T18:59:23.793039] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-30T18:59:23.794186] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-30T18:59:23.794252] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-30T18:59:24.179778] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:24.254327] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-30T18:59:24.289479] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T18:59:25.054440] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-30T18:59:25.094358] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T18:59:25.195152] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T18:59:25.854363] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-30T18:59:26.654357] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-30T18:59:26.887437] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T18:59:27.190478] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T18:59:27.454329] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-30T18:59:28.030442] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T18:59:28.255768] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-30T18:59:28.780499] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T18:59:29.054433] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-30T18:59:29.854386] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-30T18:59:30.023639] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T18:59:30.161629] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T18:59:30.654331] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-30T18:59:30.816138] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T18:59:31.454361] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-30T18:59:31.944491] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T18:59:32.254359] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-30T18:59:33.059459] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-30T18:59:33.084008] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T18:59:33.830297] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T18:59:33.854344] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-30T18:59:33.977355] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T18:59:34.654383] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-30T18:59:35.454371] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-30T18:59:35.676478] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T18:59:36.047458] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T18:59:36.254352] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-30T18:59:36.424709] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T18:59:37.054360] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-30T18:59:37.662418] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T18:59:37.854357] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-30T18:59:38.587022] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T18:59:38.594624] [INFO ] [REMOTE ] GIB: Full fetch complete (45554 records). [2025-09-30T18:59:38.594787] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-30T18:59:38.664198] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-30T18:59:39.010939] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-30T18:59:39.011079] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-30T18:59:39.012022] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-30T18:59:39.012101] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-30T18:59:39.013331] [DEBUG] [LOCAL ] GIB: Trimmed 45554 records to 32041 (keeping 200 days of data) [2025-09-30T18:59:39.223294] [DEBUG] [LOCAL ] GIB: Primary data saved (32041 records). [2025-09-30T18:59:39.223671] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-30T18:59:39.223828] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIB took 31.5s. Estimated remaining: 3h 3m 21s. Rate: 7.8 symbols/min [2025-09-30T18:59:39.421437] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:39.455212] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-30T18:59:39.463572] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-30T18:59:39.507805] [DEBUG] [LOCAL ] GL: Loaded 37753 existing records from primary storage. [2025-09-30T18:59:39.508257] [INFO ] [MAIN ] GL: Loaded 37753 existing records. [2025-09-30T18:59:39.704391] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:39.704685] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-30T18:59:39.704758] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-30T18:59:39.705746] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-30T18:59:39.705832] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-30T18:59:40.133192] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:40.254341] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-30T18:59:40.320591] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T18:59:40.814414] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T18:59:41.054377] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-30T18:59:41.854366] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-30T18:59:42.185461] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-30T18:59:42.497442] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T18:59:42.654376] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-30T18:59:43.386694] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T18:59:43.454395] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-30T18:59:44.217725] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T18:59:44.254323] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-30T18:59:44.622046] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-30T18:59:45.054387] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-30T18:59:45.685769] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T18:59:45.854373] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-30T18:59:46.564072] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T18:59:46.654373] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-30T18:59:47.006237] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T18:59:47.454369] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-30T18:59:47.848466] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T18:59:48.254373] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-30T18:59:49.054406] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-30T18:59:49.369597] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-30T18:59:49.766933] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T18:59:49.854372] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-30T18:59:50.249043] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T18:59:50.258133] [INFO ] [REMOTE ] GKOS: Full fetch complete (59929 records). [2025-09-30T18:59:50.258271] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-30T18:59:50.660825] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-30T18:59:50.684029] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-30T18:59:50.684108] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-30T18:59:50.685013] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-30T18:59:50.685090] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-30T18:59:50.686614] [DEBUG] [LOCAL ] GKOS: Trimmed 59929 records to 42680 (keeping 200 days of data) [2025-09-30T18:59:50.960719] [DEBUG] [LOCAL ] GKOS: Primary data saved (42680 records). [2025-09-30T18:59:50.960945] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-30T18:59:50.961115] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GKOS took 27.6s. Estimated remaining: 3h 3m 20s. Rate: 7.8 symbols/min [2025-09-30T18:59:51.146325] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:51.197907] [DEBUG] [LOCAL ] GLOB: Loaded 47508 existing records from primary storage. [2025-09-30T18:59:51.198386] [INFO ] [MAIN ] GLOB: Loaded 47508 existing records. [2025-09-30T18:59:51.401072] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:51.401445] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-30T18:59:51.401732] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-30T18:59:51.409603] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-30T18:59:51.422660] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-30T18:59:51.430021] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T18:59:51.459578] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-30T18:59:51.828207] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:52.254327] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-30T18:59:52.624932] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T18:59:52.724065] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T18:59:53.054362] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-30T18:59:53.620830] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T18:59:53.854372] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-30T18:59:54.654352] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-30T18:59:55.165085] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-30T18:59:55.176763] [INFO ] [REMOTE ] GIS: Full fetch complete (77651 records). [2025-09-30T18:59:55.176936] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-30T18:59:55.454432] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-30T18:59:55.609837] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-30T18:59:55.609981] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-30T18:59:55.611228] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-30T18:59:55.611315] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-30T18:59:55.644011] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T18:59:55.653942] [DEBUG] [LOCAL ] GIS: Trimmed 77651 records to 53672 (keeping 200 days of data) [2025-09-30T18:59:55.655622] [INFO ] [REMOTE ] GIL: Full fetch complete (61456 records). [2025-09-30T18:59:55.655814] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-30T18:59:56.206328] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-30T18:59:56.209573] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-30T18:59:56.215545] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-30T18:59:56.216785] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-30T18:59:56.275069] [DEBUG] [LOCAL ] GIL: Trimmed 61456 records to 43330 (keeping 200 days of data) [2025-09-30T18:59:56.413776] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T18:59:56.450789] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-30T18:59:56.703550] [DEBUG] [LOCAL ] GIS: Primary data saved (53672 records). [2025-09-30T18:59:56.704534] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-30T18:59:56.704935] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GIS took 34.7s. Estimated remaining: 3h 3m 9s. Rate: 7.8 symbols/min [2025-09-30T18:59:56.894271] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:56.908065] [DEBUG] [LOCAL ] GLP: Loaded 9348 existing records from primary storage. [2025-09-30T18:59:56.908710] [INFO ] [MAIN ] GLP: Loaded 9348 existing records. [2025-09-30T18:59:57.132788] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:57.134095] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-30T18:59:57.137060] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-30T18:59:57.139042] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-30T18:59:57.139859] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-30T18:59:57.163868] [DEBUG] [LOCAL ] GIL: Primary data saved (43330 records). [2025-09-30T18:59:57.175000] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-30T18:59:57.175968] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GIL took 37.2s. Estimated remaining: 3h 2m 50s. Rate: 7.8 symbols/min [2025-09-30T18:59:57.422581] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T18:59:57.568983] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-30T18:59:57.552232] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T18:59:57.719103] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T18:59:57.829335] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:57.866418] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-30T18:59:57.869684] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-30T18:59:57.870087] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-09-30T18:59:58.051266] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T18:59:58.051497] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-30T18:59:58.051544] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-30T18:59:58.052714] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-30T18:59:58.052787] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-30T18:59:58.441886] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T18:59:58.654327] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-30T18:59:58.665560] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T18:59:59.225077] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T18:59:59.454361] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-30T19:00:00.254354] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-30T19:00:00.344873] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:00:00.627390] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T19:00:01.054392] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-30T19:00:01.623458] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T19:00:01.854419] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-30T19:00:02.182198] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T19:00:02.442619] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T19:00:02.654401] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-30T19:00:03.454426] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-30T19:00:04.254379] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-30T19:00:04.348256] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T19:00:05.054386] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-30T19:00:05.071713] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T19:00:05.427826] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-30T19:00:05.854367] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-30T19:00:06.441807] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T19:00:06.654365] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-30T19:00:07.438292] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T19:00:07.454316] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-30T19:00:07.643317] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T19:00:08.192424] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T19:00:08.254382] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-30T19:00:09.054421] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-30T19:00:09.782185] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T19:00:09.854386] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-30T19:00:10.654379] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-30T19:00:10.681937] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T19:00:10.952420] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T19:00:11.454374] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-30T19:00:12.168089] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T19:00:12.254335] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-30T19:00:12.520313] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T19:00:13.054339] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-30T19:00:13.124823] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-30T19:00:13.854392] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-30T19:00:14.654360] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-30T19:00:14.833569] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T19:00:15.454424] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-30T19:00:15.512431] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:00:15.631537] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T19:00:15.634821] [INFO ] [REMOTE ] GLP: Full fetch complete (14331 records). [2025-09-30T19:00:15.634925] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-30T19:00:16.034666] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-30T19:00:16.034800] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-30T19:00:16.035259] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-30T19:00:16.035333] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-30T19:00:16.036009] [DEBUG] [LOCAL ] GLP: Trimmed 14331 records to 9370 (keeping 200 days of data) [2025-09-30T19:00:16.095754] [DEBUG] [LOCAL ] GLP: Primary data saved (9370 records). [2025-09-30T19:00:16.095934] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-30T19:00:16.096075] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GLP took 19.4s. Estimated remaining: 3h 2m 60s. Rate: 7.8 symbols/min [2025-09-30T19:00:16.283377] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-30T19:00:16.287068] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:00:16.345771] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-30T19:00:16.346142] [INFO ] [MAIN ] GM: Loaded 53728 existing records. [2025-09-30T19:00:16.550937] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:00:16.551206] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-30T19:00:16.551269] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-30T19:00:16.552939] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-30T19:00:16.553003] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-30T19:00:16.948598] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:00:17.054372] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-30T19:00:17.400694] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-30T19:00:17.727132] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T19:00:17.854369] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-30T19:00:18.654317] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-30T19:00:18.997111] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-30T19:00:19.454381] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-30T19:00:19.756142] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T19:00:20.264158] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-30T19:00:20.270137] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T19:00:21.054399] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-30T19:00:21.654552] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-30T19:00:21.731692] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T19:00:21.854357] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-30T19:00:22.654375] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-30T19:00:23.061322] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-30T19:00:23.072452] [INFO ] [REMOTE ] GLOB: Full fetch complete (63952 records). [2025-09-30T19:00:23.072668] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-30T19:00:23.459601] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-30T19:00:23.545983] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-30T19:00:23.546067] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-30T19:00:23.546873] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-30T19:00:23.546938] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-30T19:00:23.548341] [DEBUG] [LOCAL ] GLOB: Trimmed 63952 records to 47516 (keeping 200 days of data) [2025-09-30T19:00:23.856713] [DEBUG] [LOCAL ] GLOB: Primary data saved (47516 records). [2025-09-30T19:00:23.856853] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-30T19:00:23.856939] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLOB took 32.9s. Estimated remaining: 3h 2m 52s. Rate: 7.8 symbols/min [2025-09-30T19:00:24.052040] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:00:24.109183] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-30T19:00:24.159345] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T19:00:24.181621] [INFO ] [REMOTE ] GL: Full fetch complete (55395 records). [2025-09-30T19:00:24.181863] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-30T19:00:24.257037] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-30T19:00:24.331030] [DEBUG] [LOCAL ] GME: Loaded 53762 existing records from primary storage. [2025-09-30T19:00:24.342967] [INFO ] [MAIN ] GME: Loaded 53762 existing records. [2025-09-30T19:00:24.822816] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:00:24.838722] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-30T19:00:24.852337] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-30T19:00:24.863596] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-30T19:00:24.874786] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-30T19:00:24.988836] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-30T19:00:25.030821] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-30T19:00:25.035493] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-30T19:00:25.036105] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-30T19:00:25.140851] [DEBUG] [LOCAL ] GL: Trimmed 55395 records to 37779 (keeping 200 days of data) [2025-09-30T19:00:25.460394] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:00:25.462290] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-30T19:00:25.657610] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-30T19:00:25.688489] [DEBUG] [LOCAL ] GL: Primary data saved (37779 records). [2025-09-30T19:00:25.688754] [INFO ] [MAIN ] GL: Full history saved. [2025-09-30T19:00:25.688897] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GL took 46.5s. Estimated remaining: 3h 2m 36s. Rate: 7.8 symbols/min [2025-09-30T19:00:25.859601] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-30T19:00:25.880889] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:00:25.938173] [DEBUG] [LOCAL ] GMED: Loaded 48347 existing records from primary storage. [2025-09-30T19:00:25.938676] [INFO ] [MAIN ] GMED: Loaded 48347 existing records. [2025-09-30T19:00:26.137723] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:00:26.138008] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-30T19:00:26.138069] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-30T19:00:26.139281] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-30T19:00:26.139353] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-30T19:00:26.538863] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:00:26.574360] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-30T19:00:26.654362] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-30T19:00:27.454455] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-30T19:00:27.688218] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T19:00:28.026122] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T19:00:28.136535] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-09-30T19:00:28.254399] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-30T19:00:29.054407] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-30T19:00:29.246479] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T19:00:29.854363] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-30T19:00:30.615181] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T19:00:30.654353] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-30T19:00:30.754825] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-30T19:00:31.454428] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-30T19:00:32.093025] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-30T19:00:32.104854] [INFO ] [REMOTE ] GLW: Full fetch complete (77617 records). [2025-09-30T19:00:32.105018] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-30T19:00:32.263677] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-30T19:00:32.567968] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-30T19:00:32.568292] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-30T19:00:32.570063] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-30T19:00:32.570215] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-30T19:00:32.572812] [DEBUG] [LOCAL ] GLW: Trimmed 77617 records to 53635 (keeping 200 days of data) [2025-09-30T19:00:32.699940] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-30T19:00:32.868315] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T19:00:32.998761] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-09-30T19:00:32.998930] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-30T19:00:32.999729] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GLW took 35.8s. Estimated remaining: 3h 2m 28s. Rate: 7.8 symbols/min [2025-09-30T19:00:33.059545] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-30T19:00:33.192427] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:00:33.230516] [DEBUG] [LOCAL ] GMRE: Loaded 37551 existing records from primary storage. [2025-09-30T19:00:33.230830] [INFO ] [MAIN ] GMRE: Loaded 37551 existing records. [2025-09-30T19:00:33.417181] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:00:33.417475] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-30T19:00:33.417550] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-30T19:00:33.417955] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-30T19:00:33.418035] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-30T19:00:33.801719] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:00:33.854302] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-30T19:00:34.401297] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-30T19:00:34.654369] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-30T19:00:34.690447] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T19:00:34.807514] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T19:00:35.454358] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-30T19:00:36.254386] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-30T19:00:36.425175] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T19:00:36.781621] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T19:00:37.054356] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-30T19:00:37.735087] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T19:00:37.854440] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-30T19:00:38.654420] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-30T19:00:39.052226] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T19:00:39.104610] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T19:00:39.454357] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-30T19:00:39.924309] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T19:00:40.254408] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-30T19:00:40.922166] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T19:00:41.054404] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-30T19:00:41.854365] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-30T19:00:42.293081] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T19:00:42.654390] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-30T19:00:43.229991] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-30T19:00:43.311926] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T19:00:43.454370] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-30T19:00:43.534283] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T19:00:44.254391] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-30T19:00:45.054381] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-30T19:00:45.854364] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-30T19:00:45.944545] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T19:00:46.033132] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-30T19:00:46.147054] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T19:00:46.654388] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-30T19:00:47.454360] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-30T19:00:48.259525] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-30T19:00:48.281025] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-30T19:00:48.294856] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-09-30T19:00:48.295022] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-30T19:00:48.739211] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-30T19:00:48.739308] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-30T19:00:48.740315] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-30T19:00:48.740388] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-30T19:00:48.742088] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53728 (keeping 200 days of data) [2025-09-30T19:00:49.093571] [DEBUG] [LOCAL ] GM: Primary data saved (53728 records). [2025-09-30T19:00:49.093748] [INFO ] [MAIN ] GM: Full history saved. [2025-09-30T19:00:49.093853] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GM took 33.0s. Estimated remaining: 3h 2m 33s. Rate: 7.8 symbols/min [2025-09-30T19:00:49.290725] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:00:49.327318] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-30T19:00:49.383205] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-30T19:00:49.386285] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T19:00:49.405031] [DEBUG] [LOCAL ] GNE: Loaded 17740 existing records from primary storage. [2025-09-30T19:00:49.405874] [INFO ] [REMOTE ] GMED: Full fetch complete (69539 records). [2025-09-30T19:00:49.406024] [INFO ] [MAIN ] GNE: Loaded 17740 existing records. [2025-09-30T19:00:49.406179] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-30T19:00:49.532862] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T19:00:49.793947] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:00:49.820742] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-30T19:00:49.832157] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-30T19:00:49.867821] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-30T19:00:49.873238] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-30T19:00:49.873158] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-30T19:00:50.274348] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-30T19:00:50.284265] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-30T19:00:50.293496] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-30T19:00:50.304260] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-30T19:00:50.422413] [DEBUG] [LOCAL ] GMED: Trimmed 69539 records to 48335 (keeping 200 days of data) [2025-09-30T19:00:50.599926] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:00:50.686214] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-30T19:00:50.815083] [DEBUG] [LOCAL ] GMED: Primary data saved (48335 records). [2025-09-30T19:00:50.815237] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-30T19:00:50.815330] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GMED took 25.1s. Estimated remaining: 3h 2m 16s. Rate: 7.8 symbols/min [2025-09-30T19:00:51.020057] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:00:51.061663] [DEBUG] [LOCAL ] GNK: Loaded 40282 existing records from primary storage. [2025-09-30T19:00:51.061996] [INFO ] [MAIN ] GNK: Loaded 40282 existing records. [2025-09-30T19:00:51.265084] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:00:51.265383] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-30T19:00:51.265440] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-30T19:00:51.265905] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-30T19:00:51.265968] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-30T19:00:51.623880] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T19:00:51.667369] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-30T19:00:51.717861] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:00:51.746504] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T19:00:51.971092] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-30T19:00:52.254401] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-30T19:00:52.295958] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-30T19:00:53.054367] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-30T19:00:53.854343] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-30T19:00:54.654356] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-30T19:00:54.716374] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:00:54.914785] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-30T19:00:55.277173] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:00:55.293639] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T19:00:55.454378] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-30T19:00:56.254386] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-30T19:00:56.296230] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-30T19:00:57.054369] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-30T19:00:57.528514] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T19:00:57.854398] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-30T19:00:58.654435] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-30T19:00:58.978476] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T19:00:59.334299] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T19:00:59.440702] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T19:00:59.454384] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-30T19:01:00.254450] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-30T19:01:00.458690] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T19:01:01.054397] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-30T19:01:01.619406] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T19:01:01.854368] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-30T19:01:02.654350] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-30T19:01:02.891735] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T19:01:03.078838] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-30T19:01:03.086769] [INFO ] [REMOTE ] GMRE: Full fetch complete (53491 records). [2025-09-30T19:01:03.086912] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-30T19:01:03.459465] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-30T19:01:03.537795] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-30T19:01:03.537888] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-30T19:01:03.538834] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-30T19:01:03.538904] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-30T19:01:03.540297] [DEBUG] [LOCAL ] GMRE: Trimmed 53491 records to 37497 (keeping 200 days of data) [2025-09-30T19:01:03.780570] [DEBUG] [LOCAL ] GMRE: Primary data saved (37497 records). [2025-09-30T19:01:03.781170] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-30T19:01:03.781776] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GMRE took 30.8s. Estimated remaining: 3h 2m 16s. Rate: 7.8 symbols/min [2025-09-30T19:01:03.965979] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:04.010308] [DEBUG] [LOCAL ] GNL: Loaded 46945 existing records from primary storage. [2025-09-30T19:01:04.010618] [INFO ] [MAIN ] GNL: Loaded 46945 existing records. [2025-09-30T19:01:04.209035] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:04.209406] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-30T19:01:04.209481] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-30T19:01:04.209912] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-30T19:01:04.209975] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-30T19:01:04.254860] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-30T19:01:04.553018] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T19:01:04.680202] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:05.054409] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-30T19:01:05.638905] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T19:01:05.854343] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-30T19:01:06.273508] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-30T19:01:06.291884] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-09-30T19:01:06.292092] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-30T19:01:06.657491] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-30T19:01:06.680754] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T19:01:06.807535] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-30T19:01:06.807678] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-30T19:01:06.808907] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-30T19:01:06.808980] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-30T19:01:06.810950] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53762 (keeping 200 days of data) [2025-09-30T19:01:07.047106] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T19:01:07.173518] [DEBUG] [LOCAL ] GME: Primary data saved (53762 records). [2025-09-30T19:01:07.173696] [INFO ] [MAIN ] GME: Full history saved. [2025-09-30T19:01:07.173796] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GME took 43.3s. Estimated remaining: 3h 2m 2s. Rate: 7.8 symbols/min [2025-09-30T19:01:07.365798] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:07.412055] [DEBUG] [LOCAL ] GNRC: Loaded 45182 existing records from primary storage. [2025-09-30T19:01:07.412413] [INFO ] [MAIN ] GNRC: Loaded 45182 existing records. [2025-09-30T19:01:07.459742] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-30T19:01:07.633031] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:07.633260] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-30T19:01:07.633312] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-30T19:01:07.633578] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-30T19:01:07.633678] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-30T19:01:08.096765] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:08.254377] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-30T19:01:08.328261] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T19:01:08.650089] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T19:01:08.654932] [INFO ] [REMOTE ] GNE: Full fetch complete (22379 records). [2025-09-30T19:01:08.655289] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-30T19:01:09.058819] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-30T19:01:09.096013] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-30T19:01:09.096099] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-30T19:01:09.096685] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-30T19:01:09.096752] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-30T19:01:09.097451] [DEBUG] [LOCAL ] GNE: Trimmed 22379 records to 17787 (keeping 200 days of data) [2025-09-30T19:01:09.215859] [DEBUG] [LOCAL ] GNE: Primary data saved (17787 records). [2025-09-30T19:01:09.216023] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-30T19:01:09.216162] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNE took 20.1s. Estimated remaining: 3h 1m 46s. Rate: 7.8 symbols/min [2025-09-30T19:01:09.411109] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:09.438931] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T19:01:09.455704] [DEBUG] [LOCAL ] GNT: Loaded 8083 existing records from primary storage. [2025-09-30T19:01:09.455965] [INFO ] [MAIN ] GNT: Loaded 8083 existing records. [2025-09-30T19:01:09.652509] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:09.652820] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-30T19:01:09.652882] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-30T19:01:09.653125] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-30T19:01:09.653187] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-30T19:01:09.864959] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-30T19:01:10.037510] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:10.654319] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-30T19:01:10.772347] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T19:01:11.335961] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-30T19:01:11.428354] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T19:01:11.454369] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-30T19:01:12.090439] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T19:01:12.254397] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-30T19:01:12.675797] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-30T19:01:13.054391] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-30T19:01:13.854354] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-30T19:01:14.573234] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T19:01:14.654368] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-30T19:01:15.089015] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T19:01:15.454373] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-30T19:01:16.072089] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T19:01:16.143271] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T19:01:16.254371] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-30T19:01:17.020229] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T19:01:17.054387] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-30T19:01:17.854395] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-30T19:01:18.593166] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:01:18.654379] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-30T19:01:19.282091] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:01:19.454365] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-30T19:01:20.254374] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-30T19:01:20.294232] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T19:01:20.325053] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T19:01:21.054396] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-30T19:01:21.603423] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T19:01:21.854413] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-30T19:01:21.891958] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T19:01:22.654372] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-30T19:01:23.304767] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T19:01:23.454381] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-30T19:01:24.210851] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T19:01:24.245274] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T19:01:24.254495] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-30T19:01:24.900007] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T19:01:25.054364] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-30T19:01:25.854351] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-30T19:01:26.659332] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-30T19:01:26.664876] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T19:01:27.234485] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T19:01:27.454367] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-30T19:01:28.203810] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-30T19:01:28.254355] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-30T19:01:29.054354] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-30T19:01:29.091497] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:01:29.788794] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T19:01:29.797436] [INFO ] [REMOTE ] GNK: Full fetch complete (57057 records). [2025-09-30T19:01:29.797617] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-30T19:01:29.862074] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-30T19:01:30.021417] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T19:01:30.095542] [INFO ] [REMOTE ] GNT: Full fetch complete (10740 records). [2025-09-30T19:01:30.132248] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-30T19:01:30.426568] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-30T19:01:30.457201] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-30T19:01:30.480615] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-30T19:01:30.507622] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-30T19:01:30.640386] [DEBUG] [LOCAL ] GNK: Trimmed 57057 records to 40237 (keeping 200 days of data) [2025-09-30T19:01:30.754782] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-30T19:01:31.021808] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-30T19:01:31.022947] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-30T19:01:31.023489] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-30T19:01:31.023592] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-30T19:01:31.027249] [DEBUG] [LOCAL ] GNT: Trimmed 10740 records to 8082 (keeping 200 days of data) [2025-09-30T19:01:31.197396] [DEBUG] [LOCAL ] GNT: Primary data saved (8082 records). [2025-09-30T19:01:31.208069] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-30T19:01:31.243333] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNT took 22.0s. Estimated remaining: 3h 1m 60s. Rate: 7.8 symbols/min [2025-09-30T19:01:31.523404] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:31.561104] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T19:01:31.579214] [DEBUG] [LOCAL ] GNTY: Loaded 7288 existing records from primary storage. [2025-09-30T19:01:31.580020] [INFO ] [MAIN ] GNTY: Loaded 7288 existing records. [2025-09-30T19:01:31.580376] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-30T19:01:31.779931] [DEBUG] [LOCAL ] GNK: Primary data saved (40237 records). [2025-09-30T19:01:31.813421] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-30T19:01:31.822296] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNK took 41.0s. Estimated remaining: 3h 1m 42s. Rate: 7.8 symbols/min [2025-09-30T19:01:31.846119] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:31.890138] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-30T19:01:31.936903] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-30T19:01:31.968254] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-30T19:01:31.980624] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-30T19:01:32.141995] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:32.530239] [DEBUG] [LOCAL ] GNW: Loaded 51334 existing records from primary storage. [2025-09-30T19:01:32.559721] [INFO ] [MAIN ] GNW: Loaded 51334 existing records. [2025-09-30T19:01:32.566528] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:32.579516] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-30T19:01:32.593369] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T19:01:32.791177] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:32.791443] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-30T19:01:32.791496] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-30T19:01:32.791897] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-30T19:01:32.791961] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-30T19:01:33.059439] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-30T19:01:33.234967] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:33.267695] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:01:33.381759] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-30T19:01:33.854359] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-30T19:01:34.657976] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-30T19:01:34.666229] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T19:01:35.454353] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-30T19:01:35.526546] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T19:01:35.563228] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:01:36.254397] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-30T19:01:37.054402] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-30T19:01:37.100360] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:01:37.109618] [INFO ] [REMOTE ] GNL: Full fetch complete (68295 records). [2025-09-30T19:01:37.109810] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-30T19:01:37.533178] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-30T19:01:37.533280] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-30T19:01:37.534350] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-30T19:01:37.534420] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-30T19:01:37.536087] [DEBUG] [LOCAL ] GNL: Trimmed 68295 records to 46875 (keeping 200 days of data) [2025-09-30T19:01:37.793773] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T19:01:37.860686] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-30T19:01:37.876437] [DEBUG] [LOCAL ] GNL: Primary data saved (46875 records). [2025-09-30T19:01:37.876600] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-30T19:01:37.877833] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNL took 34.1s. Estimated remaining: 3h 1m 32s. Rate: 7.8 symbols/min [2025-09-30T19:01:38.061437] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:38.125634] [DEBUG] [LOCAL ] GOF: Loaded 42678 existing records from primary storage. [2025-09-30T19:01:38.126071] [INFO ] [MAIN ] GOF: Loaded 42678 existing records. [2025-09-30T19:01:38.321091] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:38.321346] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-30T19:01:38.321397] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-30T19:01:38.321759] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-30T19:01:38.321841] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-30T19:01:38.657194] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-30T19:01:38.741691] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:38.857377] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T19:01:38.868181] [INFO ] [REMOTE ] GNRC: Full fetch complete (65313 records). [2025-09-30T19:01:38.868386] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-30T19:01:39.325295] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-30T19:01:39.325468] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-30T19:01:39.326582] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-30T19:01:39.326894] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-30T19:01:39.329098] [DEBUG] [LOCAL ] GNRC: Trimmed 65313 records to 45193 (keeping 200 days of data) [2025-09-30T19:01:39.449339] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T19:01:39.451038] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T19:01:39.466318] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-30T19:01:39.671533] [DEBUG] [LOCAL ] GNRC: Primary data saved (45193 records). [2025-09-30T19:01:39.671742] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-30T19:01:39.671901] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNRC took 32.5s. Estimated remaining: 3h 1m 15s. Rate: 7.8 symbols/min [2025-09-30T19:01:39.853209] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:39.887638] [DEBUG] [LOCAL ] GOLF: Loaded 31352 existing records from primary storage. [2025-09-30T19:01:39.887935] [INFO ] [MAIN ] GOLF: Loaded 31352 existing records. [2025-09-30T19:01:40.081421] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:40.081742] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-30T19:01:40.081804] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-30T19:01:40.082870] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-30T19:01:40.082933] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-30T19:01:40.257114] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-30T19:01:40.477096] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:41.002448] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T19:01:41.054393] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-30T19:01:41.126161] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:01:41.750435] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-30T19:01:41.854401] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-30T19:01:42.654418] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-30T19:01:43.282903] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T19:01:43.454347] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-30T19:01:43.774275] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T19:01:44.051560] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T19:01:44.254348] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-30T19:01:44.864419] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T19:01:45.054415] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-30T19:01:45.854376] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-30T19:01:46.596925] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:01:46.654344] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-30T19:01:47.311883] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T19:01:47.454359] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-30T19:01:48.124381] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T19:01:48.254370] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-30T19:01:48.947158] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T19:01:49.054404] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-30T19:01:49.505457] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T19:01:49.847305] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T19:01:49.854300] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-30T19:01:50.634783] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T19:01:50.654371] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-30T19:01:51.454422] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-30T19:01:52.098946] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T19:01:52.101798] [INFO ] [REMOTE ] GNTY: Full fetch complete (10417 records). [2025-09-30T19:01:52.101884] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-30T19:01:52.241564] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T19:01:52.258705] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-30T19:01:52.537339] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-30T19:01:52.537419] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-30T19:01:52.537705] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-30T19:01:52.537767] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-30T19:01:52.538745] [DEBUG] [LOCAL ] GNTY: Trimmed 10417 records to 7330 (keeping 200 days of data) [2025-09-30T19:01:52.585065] [DEBUG] [LOCAL ] GNTY: Primary data saved (7330 records). [2025-09-30T19:01:52.585244] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-30T19:01:52.585342] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNTY took 21.3s. Estimated remaining: 3h 1m 15s. Rate: 7.8 symbols/min [2025-09-30T19:01:52.773237] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:01:52.828428] [DEBUG] [LOCAL ] GOOS: Loaded 45160 existing records from primary storage. [2025-09-30T19:01:52.828819] [INFO ] [MAIN ] GOOS: Loaded 45160 existing records. [2025-09-30T19:01:53.031381] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:01:53.031759] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-30T19:01:53.031857] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-30T19:01:53.032211] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-30T19:01:53.032300] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-30T19:01:53.065450] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-30T19:01:53.425443] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:01:53.736956] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T19:01:53.854404] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-30T19:01:54.654346] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-30T19:01:54.792511] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T19:01:54.967443] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T19:01:55.454409] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-30T19:01:56.254360] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-30T19:01:56.350027] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T19:01:56.415725] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T19:01:57.054353] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-30T19:01:57.598623] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:01:57.854369] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-30T19:01:58.305863] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T19:01:58.654398] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-30T19:01:59.192225] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T19:01:59.454371] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-30T19:02:00.135775] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T19:02:00.254439] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-30T19:02:01.054333] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-30T19:02:01.151727] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T19:02:01.854397] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-30T19:02:02.191321] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-30T19:02:02.654350] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-30T19:02:02.838998] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T19:02:03.144812] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T19:02:03.454371] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-30T19:02:04.254401] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-30T19:02:04.463467] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T19:02:04.473197] [INFO ] [REMOTE ] GOF: Full fetch complete (62170 records). [2025-09-30T19:02:04.473464] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-30T19:02:04.917123] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-30T19:02:04.917387] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-30T19:02:04.918427] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-30T19:02:04.918617] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-30T19:02:04.952607] [DEBUG] [LOCAL ] GOF: Trimmed 62170 records to 42604 (keeping 200 days of data) [2025-09-30T19:02:04.952463] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T19:02:05.063809] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-30T19:02:05.263477] [DEBUG] [LOCAL ] GOF: Primary data saved (42604 records). [2025-09-30T19:02:05.263622] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-30T19:02:05.264382] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOF took 27.4s. Estimated remaining: 3h 1m 15s. Rate: 7.8 symbols/min [2025-09-30T19:02:05.454150] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:05.501571] [DEBUG] [LOCAL ] GOTU: Loaded 38697 existing records from primary storage. [2025-09-30T19:02:05.501961] [INFO ] [MAIN ] GOTU: Loaded 38697 existing records. [2025-09-30T19:02:05.725268] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:05.725724] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-30T19:02:05.725795] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-30T19:02:05.726106] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-30T19:02:05.726167] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-30T19:02:05.871700] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-30T19:02:06.207932] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:06.210994] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-30T19:02:06.372186] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T19:02:06.654361] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-30T19:02:06.961666] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T19:02:07.454374] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-30T19:02:08.254372] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-30T19:02:08.401839] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T19:02:08.413569] [INFO ] [REMOTE ] GNW: Full fetch complete (73510 records). [2025-09-30T19:02:08.413960] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-30T19:02:08.860437] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-30T19:02:08.860638] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-30T19:02:08.862145] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-30T19:02:08.862300] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-30T19:02:08.865940] [DEBUG] [LOCAL ] GNW: Trimmed 73510 records to 51327 (keeping 200 days of data) [2025-09-30T19:02:09.078886] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-30T19:02:09.119771] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T19:02:09.235919] [DEBUG] [LOCAL ] GNW: Primary data saved (51327 records). [2025-09-30T19:02:09.236076] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-30T19:02:09.236204] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GNW took 37.4s. Estimated remaining: 3h 1m 2s. Rate: 7.8 symbols/min [2025-09-30T19:02:09.439333] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:09.487107] [DEBUG] [LOCAL ] GPC: Loaded 46447 existing records from primary storage. [2025-09-30T19:02:09.487460] [INFO ] [MAIN ] GPC: Loaded 46447 existing records. [2025-09-30T19:02:09.684484] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:09.684983] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-30T19:02:09.685078] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-30T19:02:09.685343] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-30T19:02:09.685413] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-30T19:02:09.862865] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-30T19:02:10.107417] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T19:02:10.163954] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:10.365429] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T19:02:10.654377] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-30T19:02:11.430042] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T19:02:11.454322] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-30T19:02:12.002213] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T19:02:12.254443] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-30T19:02:13.054382] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-30T19:02:13.112917] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:02:13.854396] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-30T19:02:13.953320] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T19:02:14.239405] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T19:02:14.654401] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-30T19:02:14.769287] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T19:02:15.454391] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-30T19:02:16.254400] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-30T19:02:16.333939] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T19:02:16.728761] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T19:02:17.054389] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-30T19:02:17.854384] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-30T19:02:18.149556] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-30T19:02:18.227701] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T19:02:18.237085] [INFO ] [REMOTE ] GOOS: Full fetch complete (65596 records). [2025-09-30T19:02:18.237316] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-30T19:02:18.658079] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-30T19:02:18.761140] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-30T19:02:18.761237] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-30T19:02:18.762379] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-30T19:02:18.762481] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-30T19:02:18.764470] [DEBUG] [LOCAL ] GOOS: Trimmed 65596 records to 45062 (keeping 200 days of data) [2025-09-30T19:02:19.059186] [DEBUG] [LOCAL ] GOOS: Primary data saved (45062 records). [2025-09-30T19:02:19.059363] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-30T19:02:19.059681] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOOS took 26.5s. Estimated remaining: 3h 0m 57s. Rate: 7.8 symbols/min [2025-09-30T19:02:19.265766] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:19.301196] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T19:02:19.327162] [DEBUG] [LOCAL ] GPI: Loaded 14808 existing records from primary storage. [2025-09-30T19:02:19.327441] [INFO ] [MAIN ] GPI: Loaded 14808 existing records. [2025-09-30T19:02:19.459491] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-30T19:02:19.533815] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:19.534062] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-30T19:02:19.534111] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-30T19:02:19.534448] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-30T19:02:19.534507] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-30T19:02:19.975297] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:20.029844] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T19:02:20.254413] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-30T19:02:20.776101] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T19:02:21.054391] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-30T19:02:21.841015] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-30T19:02:21.854305] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-30T19:02:21.902892] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T19:02:22.589934] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T19:02:22.655921] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-30T19:02:23.454400] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-30T19:02:23.971905] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T19:02:24.254382] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-30T19:02:25.054365] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-30T19:02:25.206575] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T19:02:25.555364] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-30T19:02:25.561917] [INFO ] [REMOTE ] GOLF: Full fetch complete (45027 records). [2025-09-30T19:02:25.562051] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-30T19:02:25.859512] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-30T19:02:26.000875] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-30T19:02:26.001080] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-30T19:02:26.001950] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-30T19:02:26.002057] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-30T19:02:26.004591] [DEBUG] [LOCAL ] GOLF: Trimmed 45027 records to 31236 (keeping 200 days of data) [2025-09-30T19:02:26.151389] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T19:02:26.281537] [DEBUG] [LOCAL ] GOLF: Primary data saved (31236 records). [2025-09-30T19:02:26.281732] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-30T19:02:26.281844] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOLF took 46.6s. Estimated remaining: 3h 0m 49s. Rate: 7.8 symbols/min [2025-09-30T19:02:26.654448] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-30T19:02:27.454377] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-30T19:02:27.522006] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T19:02:27.894340] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T19:02:28.254358] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-30T19:02:28.597132] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T19:02:29.054358] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-30T19:02:29.854369] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-30T19:02:29.997692] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T19:02:30.044431] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T19:02:30.654382] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-30T19:02:31.196808] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T19:02:31.454366] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-30T19:02:32.254331] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-30T19:02:32.316231] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T19:02:32.474051] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-30T19:02:33.054395] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-30T19:02:33.370803] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T19:02:33.745240] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T19:02:33.854368] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-30T19:02:34.654378] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-30T19:02:35.454358] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-30T19:02:35.534002] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T19:02:35.545876] [INFO ] [REMOTE ] GPC: Full fetch complete (69000 records). [2025-09-30T19:02:35.546088] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-30T19:02:35.706223] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-30T19:02:36.048200] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-30T19:02:36.048296] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-30T19:02:36.049267] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-30T19:02:36.049335] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-30T19:02:36.050815] [DEBUG] [LOCAL ] GPC: Trimmed 69000 records to 46398 (keeping 200 days of data) [2025-09-30T19:02:36.259903] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-30T19:02:36.378450] [DEBUG] [LOCAL ] GPC: Primary data saved (46398 records). [2025-09-30T19:02:36.378617] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-30T19:02:36.378768] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GPC took 27.1s. Estimated remaining: 3h 0m 45s. Rate: 7.8 symbols/min [2025-09-30T19:02:36.645402] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T19:02:37.054414] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-30T19:02:37.867922] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T19:02:37.872592] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-30T19:02:38.556730] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T19:02:38.565846] [INFO ] [REMOTE ] GOTU: Full fetch complete (59372 records). [2025-09-30T19:02:38.566023] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-30T19:02:38.945632] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T19:02:38.976341] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-30T19:02:39.059286] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-30T19:02:39.059395] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-30T19:02:39.060330] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-30T19:02:39.060398] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-30T19:02:39.062136] [DEBUG] [LOCAL ] GOTU: Trimmed 59372 records to 38557 (keeping 200 days of data) [2025-09-30T19:02:39.316853] [DEBUG] [LOCAL ] GOTU: Primary data saved (38557 records). [2025-09-30T19:02:39.317005] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-30T19:02:39.317789] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GOTU took 34.1s. Estimated remaining: 3h 0m 30s. Rate: 7.8 symbols/min [2025-09-30T19:02:40.106257] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T19:02:40.110571] [INFO ] [REMOTE ] GPI: Full fetch complete (21014 records). [2025-09-30T19:02:40.110702] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-30T19:02:40.508998] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-30T19:02:40.509118] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-30T19:02:40.509578] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-30T19:02:40.509636] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-30T19:02:40.510830] [DEBUG] [LOCAL ] GPI: Trimmed 21014 records to 14682 (keeping 200 days of data) [2025-09-30T19:02:40.615784] [DEBUG] [LOCAL ] GPI: Primary data saved (14682 records). [2025-09-30T19:02:40.615946] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-30T19:02:40.616089] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPI took 21.6s. Estimated remaining: 3h 0m 13s. Rate: 7.8 symbols/min [2025-09-30T19:02:41.271212] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:41.371029] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:41.413628] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:41.418335] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:02:41.428510] [DEBUG] [LOCAL ] GPJA: Loaded 4097 existing records from primary storage. [2025-09-30T19:02:41.428952] [INFO ] [MAIN ] GPJA: Loaded 4097 existing records. [2025-09-30T19:02:41.718380] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:41.719772] [DEBUG] [LOCAL ] GPN: Loaded 52049 existing records from primary storage. [2025-09-30T19:02:41.720895] [DEBUG] [LOCAL ] GPMT: Loaded 26288 existing records from primary storage. [2025-09-30T19:02:41.719954] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-30T19:02:41.721485] [INFO ] [MAIN ] GPMT: Loaded 26288 existing records. [2025-09-30T19:02:41.733730] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-30T19:02:41.721355] [INFO ] [MAIN ] GPN: Loaded 52049 existing records. [2025-09-30T19:02:41.755941] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-30T19:02:41.813257] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-30T19:02:41.906245] [DEBUG] [LOCAL ] GPK: Loaded 52653 existing records from primary storage. [2025-09-30T19:02:41.986246] [INFO ] [MAIN ] GPK: Loaded 52653 existing records. [2025-09-30T19:02:42.340907] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:42.437762] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-30T19:02:42.513344] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:42.566755] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-30T19:02:42.561497] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-30T19:02:42.626603] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-30T19:02:42.654308] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-30T19:02:42.654119] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-30T19:02:42.773192] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-30T19:02:42.795618] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:02:42.811391] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-30T19:02:42.889491] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-30T19:02:42.906115] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-30T19:02:42.985853] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-30T19:02:43.067843] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-30T19:02:43.071380] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:43.128147] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-30T19:02:43.757141] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:43.800105] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-30T19:02:43.957205] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:43.988054] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-30T19:02:44.019224] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T19:02:44.026188] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-30T19:02:44.120934] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:02:44.121335] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-30T19:02:44.866968] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T19:02:44.870781] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-30T19:02:45.267677] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-30T19:02:45.269375] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-30T19:02:45.290000] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T19:02:45.296388] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-30T19:02:45.456313] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:02:45.543433] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:02:45.605872] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T19:02:45.854404] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-30T19:02:46.407616] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T19:02:46.654408] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-30T19:02:47.454369] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-30T19:02:47.507794] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:02:47.891104] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T19:02:48.010376] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T19:02:48.254371] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-30T19:02:49.054363] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-30T19:02:49.387855] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T19:02:49.429038] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-30T19:02:49.854358] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-30T19:02:50.654403] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-30T19:02:50.947099] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T19:02:51.074233] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T19:02:51.454402] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-30T19:02:52.254377] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-30T19:02:52.911562] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T19:02:52.991397] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:02:53.054410] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-30T19:02:53.854401] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-30T19:02:54.392271] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T19:02:54.654378] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-30T19:02:55.393528] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:02:55.454385] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-30T19:02:56.254366] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-30T19:02:56.293986] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T19:02:56.844454] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:02:57.054369] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-30T19:02:57.613422] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T19:02:57.854366] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-30T19:02:58.664411] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-30T19:02:58.686003] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T19:02:59.409600] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T19:02:59.448492] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T19:02:59.454300] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-30T19:03:00.254371] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-30T19:03:00.427564] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T19:03:00.843173] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-30T19:03:01.054400] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-30T19:03:01.854426] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-30T19:03:02.654344] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-30T19:03:02.776195] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T19:03:03.454351] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-30T19:03:03.625392] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T19:03:03.689273] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T19:03:03.693322] [INFO ] [REMOTE ] GPMT: Full fetch complete (37452 records). [2025-09-30T19:03:03.693425] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-30T19:03:04.112916] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-30T19:03:04.113041] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-30T19:03:04.113753] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-30T19:03:04.113820] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-30T19:03:04.115081] [DEBUG] [LOCAL ] GPMT: Trimmed 37452 records to 26222 (keeping 200 days of data) [2025-09-30T19:03:04.264753] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-30T19:03:04.296605] [DEBUG] [LOCAL ] GPMT: Primary data saved (26222 records). [2025-09-30T19:03:04.296783] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-30T19:03:04.296881] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPMT took 23.7s. Estimated remaining: 3h 0m 29s. Rate: 7.8 symbols/min [2025-09-30T19:03:04.495555] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:04.529019] [DEBUG] [LOCAL ] GPOR: Loaded 22983 existing records from primary storage. [2025-09-30T19:03:04.529449] [INFO ] [MAIN ] GPOR: Loaded 22983 existing records. [2025-09-30T19:03:04.752863] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:04.753127] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-30T19:03:04.753266] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-30T19:03:04.753514] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-30T19:03:04.753591] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-30T19:03:05.067195] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-30T19:03:05.072995] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T19:03:05.121052] [INFO ] [REMOTE ] GPJA: Full fetch complete (7365 records). [2025-09-30T19:03:05.132844] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-30T19:03:05.271111] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:05.632137] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-30T19:03:05.632279] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-30T19:03:05.632510] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-30T19:03:05.632555] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-30T19:03:05.633020] [DEBUG] [LOCAL ] GPJA: Trimmed 7365 records to 4219 (keeping 200 days of data) [2025-09-30T19:03:05.661553] [DEBUG] [LOCAL ] GPJA: Primary data saved (4219 records). [2025-09-30T19:03:05.661729] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-30T19:03:05.661833] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPJA took 25.0s. Estimated remaining: 3h 0m 12s. Rate: 7.8 symbols/min [2025-09-30T19:03:05.858827] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:05.858951] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-30T19:03:05.899772] [DEBUG] [LOCAL ] GPRK: Loaded 39240 existing records from primary storage. [2025-09-30T19:03:05.900082] [INFO ] [MAIN ] GPRK: Loaded 39240 existing records. [2025-09-30T19:03:06.097490] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:06.097749] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-30T19:03:06.097808] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-30T19:03:06.098033] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-30T19:03:06.098092] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-30T19:03:06.506214] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:06.654386] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-30T19:03:06.813748] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T19:03:06.876935] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-30T19:03:07.454415] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-30T19:03:07.713030] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (4.26 seconds). [2025-09-30T19:03:07.989590] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:03:08.254370] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-30T19:03:08.926891] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T19:03:09.054376] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-30T19:03:09.854355] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-30T19:03:10.014405] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T19:03:10.320997] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T19:03:10.654363] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-30T19:03:11.134571] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T19:03:11.454530] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-30T19:03:11.739858] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-30T19:03:12.254400] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-30T19:03:13.054319] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-30T19:03:13.262759] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T19:03:13.274814] [INFO ] [REMOTE ] GPK: Full fetch complete (75499 records). [2025-09-30T19:03:13.274999] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-30T19:03:13.787787] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-30T19:03:13.788030] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-30T19:03:13.789166] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-30T19:03:13.789450] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-30T19:03:13.791560] [DEBUG] [LOCAL ] GPK: Trimmed 75499 records to 52664 (keeping 200 days of data) [2025-09-30T19:03:13.868619] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-30T19:03:13.943588] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:03:14.220624] [DEBUG] [LOCAL ] GPK: Primary data saved (52664 records). [2025-09-30T19:03:14.220818] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-30T19:03:14.220913] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPK took 33.6s. Estimated remaining: 3h 0m 6s. Rate: 7.8 symbols/min [2025-09-30T19:03:14.434097] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:14.467637] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T19:03:14.498804] [DEBUG] [LOCAL ] GRBK: Loaded 26896 existing records from primary storage. [2025-09-30T19:03:14.499130] [INFO ] [MAIN ] GRBK: Loaded 26896 existing records. [2025-09-30T19:03:14.656209] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-30T19:03:14.699170] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:14.699447] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-30T19:03:14.699508] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-30T19:03:14.699773] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-30T19:03:14.699836] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-30T19:03:15.099986] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:15.118074] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T19:03:15.454457] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-30T19:03:16.254393] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-30T19:03:16.325321] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-30T19:03:17.054411] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-30T19:03:17.122126] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T19:03:17.493376] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T19:03:17.854365] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-30T19:03:18.654423] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-30T19:03:19.222726] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T19:03:19.235087] [INFO ] [REMOTE ] GPN: Full fetch complete (74854 records). [2025-09-30T19:03:19.235258] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-30T19:03:19.457040] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-30T19:03:19.657753] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T19:03:19.805555] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T19:03:19.810118] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-30T19:03:19.810237] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-30T19:03:19.811406] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-30T19:03:19.816481] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-30T19:03:19.819306] [DEBUG] [LOCAL ] GPN: Trimmed 74854 records to 52050 (keeping 200 days of data) [2025-09-30T19:03:20.206593] [DEBUG] [LOCAL ] GPN: Primary data saved (52050 records). [2025-09-30T19:03:20.206817] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-30T19:03:20.210539] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 39.6s. Estimated remaining: 2h 59m 56s. Rate: 7.8 symbols/min [2025-09-30T19:03:20.259492] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-30T19:03:20.419154] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:20.431138] [DEBUG] [LOCAL ] GRC: Loaded 8910 existing records from primary storage. [2025-09-30T19:03:20.431359] [INFO ] [MAIN ] GRC: Loaded 8910 existing records. [2025-09-30T19:03:20.640146] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:20.640430] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-30T19:03:20.640492] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-30T19:03:20.640821] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-30T19:03:20.640882] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-30T19:03:20.993072] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T19:03:21.057053] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-30T19:03:21.089060] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:21.374930] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-30T19:03:21.854401] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-30T19:03:22.234098] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T19:03:22.654402] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-30T19:03:22.853203] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T19:03:23.454356] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-30T19:03:24.130465] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-30T19:03:24.254365] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-30T19:03:24.713364] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-30T19:03:25.054352] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-30T19:03:25.691847] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T19:03:25.854345] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-30T19:03:26.110804] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-30T19:03:26.623085] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-30T19:03:26.654353] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-30T19:03:27.454326] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-30T19:03:27.920496] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T19:03:28.254395] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-30T19:03:28.531455] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T19:03:29.054369] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-30T19:03:29.401506] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T19:03:29.854366] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-30T19:03:30.211131] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T19:03:30.654367] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-30T19:03:31.196874] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T19:03:31.203352] [INFO ] [REMOTE ] GPOR: Full fetch complete (34945 records). [2025-09-30T19:03:31.203457] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-30T19:03:31.459560] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-30T19:03:31.533979] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T19:03:31.647797] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-30T19:03:31.647919] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-30T19:03:31.648982] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-30T19:03:31.649074] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-30T19:03:31.650569] [DEBUG] [LOCAL ] GPOR: Trimmed 34945 records to 23091 (keeping 200 days of data) [2025-09-30T19:03:31.806775] [DEBUG] [LOCAL ] GPOR: Primary data saved (23091 records). [2025-09-30T19:03:31.806971] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-30T19:03:31.807130] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPOR took 27.5s. Estimated remaining: 2h 59m 54s. Rate: 7.8 symbols/min [2025-09-30T19:03:31.997691] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:32.019028] [DEBUG] [LOCAL ] GRDN: Loaded 20177 existing records from primary storage. [2025-09-30T19:03:32.019290] [INFO ] [MAIN ] GRDN: Loaded 20177 existing records. [2025-09-30T19:03:32.220760] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:32.221053] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-30T19:03:32.221141] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-30T19:03:32.221452] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-30T19:03:32.221531] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-30T19:03:32.259461] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-30T19:03:32.659836] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:32.906826] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T19:03:33.054365] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-30T19:03:33.412233] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T19:03:33.854373] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-30T19:03:34.128464] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T19:03:34.623238] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T19:03:34.654363] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-30T19:03:35.444311] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T19:03:35.454315] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-30T19:03:36.188982] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T19:03:36.254422] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-30T19:03:36.801604] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T19:03:37.054416] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-30T19:03:37.854372] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-30T19:03:38.309121] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T19:03:38.380889] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-30T19:03:38.654353] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-30T19:03:39.454326] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-30T19:03:39.784804] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T19:03:40.254381] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-30T19:03:40.909774] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T19:03:41.054333] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-30T19:03:41.126198] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-30T19:03:41.854410] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-30T19:03:42.130258] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T19:03:42.139083] [INFO ] [REMOTE ] GRBK: Full fetch complete (40550 records). [2025-09-30T19:03:42.139282] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-30T19:03:42.603991] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-30T19:03:42.604173] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-30T19:03:42.604924] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-30T19:03:42.604990] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-30T19:03:42.605949] [DEBUG] [LOCAL ] GRBK: Trimmed 40550 records to 26887 (keeping 200 days of data) [2025-09-30T19:03:42.655446] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-30T19:03:42.786325] [DEBUG] [LOCAL ] GRBK: Primary data saved (26887 records). [2025-09-30T19:03:42.786480] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-30T19:03:42.786605] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GRBK took 28.6s. Estimated remaining: 2h 59m 51s. Rate: 7.8 symbols/min [2025-09-30T19:03:42.970973] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:43.017279] [DEBUG] [LOCAL ] GRMN: Loaded 41096 existing records from primary storage. [2025-09-30T19:03:43.017665] [INFO ] [MAIN ] GRMN: Loaded 41096 existing records. [2025-09-30T19:03:43.228777] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:43.229294] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-30T19:03:43.229355] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-30T19:03:43.230882] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-30T19:03:43.230949] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-30T19:03:43.458206] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-30T19:03:43.489061] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T19:03:43.563454] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T19:03:43.574467] [INFO ] [REMOTE ] GPRK: Full fetch complete (57306 records). [2025-09-30T19:03:43.579946] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-30T19:03:43.842733] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:44.114481] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-30T19:03:44.114580] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-30T19:03:44.116001] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-30T19:03:44.116096] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-30T19:03:44.117884] [DEBUG] [LOCAL ] GPRK: Trimmed 57306 records to 39299 (keeping 200 days of data) [2025-09-30T19:03:44.286231] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-30T19:03:44.359371] [DEBUG] [LOCAL ] GPRK: Primary data saved (39299 records). [2025-09-30T19:03:44.359524] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-30T19:03:44.359609] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GPRK took 38.7s. Estimated remaining: 2h 59m 34s. Rate: 7.8 symbols/min [2025-09-30T19:03:44.550679] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:44.565858] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T19:03:44.611817] [DEBUG] [LOCAL ] GRND: Loaded 49962 existing records from primary storage. [2025-09-30T19:03:44.612131] [INFO ] [MAIN ] GRND: Loaded 49962 existing records. [2025-09-30T19:03:44.800846] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:44.801123] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-30T19:03:44.801172] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-30T19:03:44.801548] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-30T19:03:44.801608] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-30T19:03:45.059562] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-30T19:03:45.209684] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:45.859469] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-30T19:03:45.872719] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:03:46.133307] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T19:03:46.625418] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T19:03:46.654320] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-30T19:03:47.435490] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-30T19:03:47.454364] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-30T19:03:48.036429] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T19:03:48.254376] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-30T19:03:49.015925] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T19:03:49.054363] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-30T19:03:49.854351] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-30T19:03:50.003619] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T19:03:50.006492] [INFO ] [REMOTE ] GRC: Full fetch complete (13068 records). [2025-09-30T19:03:50.006607] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-30T19:03:50.398461] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-30T19:03:50.398541] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-30T19:03:50.398897] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-30T19:03:50.398960] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-30T19:03:50.399447] [DEBUG] [LOCAL ] GRC: Trimmed 13068 records to 8931 (keeping 200 days of data) [2025-09-30T19:03:50.457579] [DEBUG] [LOCAL ] GRC: Primary data saved (8931 records). [2025-09-30T19:03:50.457755] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-30T19:03:50.457854] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRC took 30.2s. Estimated remaining: 2h 59m 24s. Rate: 7.8 symbols/min [2025-09-30T19:03:50.649087] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:50.654334] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-30T19:03:50.696034] [DEBUG] [LOCAL ] GRNT: Loaded 33708 existing records from primary storage. [2025-09-30T19:03:50.696348] [INFO ] [MAIN ] GRNT: Loaded 33708 existing records. [2025-09-30T19:03:50.890066] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:50.890275] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-30T19:03:50.890325] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-30T19:03:50.890632] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-30T19:03:50.890723] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-30T19:03:51.290972] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:51.304313] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-30T19:03:51.392200] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T19:03:51.454365] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-30T19:03:52.254600] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-30T19:03:53.051489] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T19:03:53.062193] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-30T19:03:53.107624] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-30T19:03:53.854382] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-30T19:03:54.403720] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:03:54.654375] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-30T19:03:55.183907] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T19:03:55.190559] [INFO ] [REMOTE ] GRDN: Full fetch complete (26193 records). [2025-09-30T19:03:55.190738] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-30T19:03:55.466415] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-30T19:03:55.603097] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-30T19:03:55.603202] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-30T19:03:55.603970] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-30T19:03:55.604057] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-30T19:03:55.604980] [DEBUG] [LOCAL ] GRDN: Trimmed 26193 records to 20313 (keeping 200 days of data) [2025-09-30T19:03:55.744746] [DEBUG] [LOCAL ] GRDN: Primary data saved (20313 records). [2025-09-30T19:03:55.744964] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-30T19:03:55.745390] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRDN took 23.9s. Estimated remaining: 2h 59m 13s. Rate: 7.8 symbols/min [2025-09-30T19:03:55.934889] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:03:55.971888] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T19:03:55.985884] [DEBUG] [LOCAL ] GROV: Loaded 9008 existing records from primary storage. [2025-09-30T19:03:55.986725] [INFO ] [MAIN ] GROV: Loaded 9008 existing records. [2025-09-30T19:03:56.194303] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:03:56.194604] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-30T19:03:56.194756] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-30T19:03:56.195004] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-30T19:03:56.195082] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-30T19:03:56.262766] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-30T19:03:56.598606] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:03:56.626725] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T19:03:57.054370] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-30T19:03:57.448118] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T19:03:57.854411] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-30T19:03:58.166103] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-30T19:03:58.654355] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-30T19:03:58.971899] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T19:03:59.454374] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-30T19:04:00.234979] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T19:04:00.254306] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-30T19:04:00.360134] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-30T19:04:01.054359] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-30T19:04:01.613873] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T19:04:01.771941] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T19:04:01.854365] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-30T19:04:02.660464] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-30T19:04:02.662222] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-30T19:04:03.454367] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-30T19:04:04.254378] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-30T19:04:04.432247] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T19:04:04.453449] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T19:04:05.054357] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-30T19:04:05.854361] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-30T19:04:05.932411] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T19:04:06.453613] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-30T19:04:06.654331] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-30T19:04:06.751719] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T19:04:07.454366] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-30T19:04:08.002258] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T19:04:08.254404] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-30T19:04:08.771279] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T19:04:09.059807] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-30T19:04:09.061978] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T19:04:09.854357] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-30T19:04:10.515795] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T19:04:10.654369] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-30T19:04:11.454339] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-30T19:04:11.616007] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T19:04:11.651726] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T19:04:12.254425] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-30T19:04:12.775323] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-30T19:04:13.001734] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T19:04:13.054397] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-30T19:04:13.854380] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-30T19:04:14.513463] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T19:04:14.534088] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-30T19:04:14.654411] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-30T19:04:15.454386] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-30T19:04:15.979181] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T19:04:16.215513] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T19:04:16.254368] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-30T19:04:17.054409] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-30T19:04:17.725549] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T19:04:17.854363] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-30T19:04:18.573998] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T19:04:18.654387] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-30T19:04:19.082159] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T19:04:19.090381] [INFO ] [REMOTE ] GRNT: Full fetch complete (48512 records). [2025-09-30T19:04:19.090631] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-30T19:04:19.459538] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-30T19:04:19.551070] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-30T19:04:19.551153] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-30T19:04:19.552027] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-30T19:04:19.552104] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-30T19:04:19.553255] [DEBUG] [LOCAL ] GRNT: Trimmed 48512 records to 33750 (keeping 200 days of data) [2025-09-30T19:04:19.781822] [DEBUG] [LOCAL ] GRNT: Primary data saved (33750 records). [2025-09-30T19:04:19.782104] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-30T19:04:19.782247] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRNT took 29.3s. Estimated remaining: 2h 59m 29s. Rate: 7.8 symbols/min [2025-09-30T19:04:20.018241] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:20.026242] [DEBUG] [LOCAL ] GRX: Loaded 4569 existing records from primary storage. [2025-09-30T19:04:20.026445] [INFO ] [MAIN ] GRX: Loaded 4569 existing records. [2025-09-30T19:04:20.239074] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:20.241443] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:04:20.241683] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-30T19:04:20.250283] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-30T19:04:20.250963] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-30T19:04:20.251031] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-30T19:04:20.262688] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-30T19:04:20.662720] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:21.054357] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-30T19:04:21.294014] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T19:04:21.306396] [INFO ] [REMOTE ] GRND: Full fetch complete (70642 records). [2025-09-30T19:04:21.306566] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-30T19:04:21.744380] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-30T19:04:21.744682] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-30T19:04:21.745821] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-30T19:04:21.746043] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-30T19:04:21.747765] [DEBUG] [LOCAL ] GRND: Trimmed 70642 records to 49918 (keeping 200 days of data) [2025-09-30T19:04:21.854685] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-30T19:04:21.857091] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T19:04:21.862263] [INFO ] [REMOTE ] GROV: Full fetch complete (14495 records). [2025-09-30T19:04:21.863088] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-30T19:04:22.232772] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T19:04:22.343129] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-30T19:04:22.343782] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-30T19:04:22.344474] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-30T19:04:22.344560] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-30T19:04:22.347134] [DEBUG] [LOCAL ] GROV: Trimmed 14495 records to 8951 (keeping 200 days of data) [2025-09-30T19:04:22.507761] [DEBUG] [LOCAL ] GROV: Primary data saved (8951 records). [2025-09-30T19:04:22.509490] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-30T19:04:22.510127] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GROV took 26.8s. Estimated remaining: 2h 59m 14s. Rate: 7.8 symbols/min [2025-09-30T19:04:22.620880] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-30T19:04:22.657990] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-30T19:04:22.732954] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:22.808535] [DEBUG] [LOCAL ] GRND: Primary data saved (49918 records). [2025-09-30T19:04:22.808742] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-30T19:04:22.808882] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRND took 38.4s. Estimated remaining: 2h 58m 56s. Rate: 7.8 symbols/min [2025-09-30T19:04:23.030143] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:23.031798] [DEBUG] [LOCAL ] GS: Loaded 51915 existing records from primary storage. [2025-09-30T19:04:23.032577] [INFO ] [MAIN ] GS: Loaded 51915 existing records. [2025-09-30T19:04:23.241824] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:23.242115] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-30T19:04:23.242168] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-30T19:04:23.242583] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-30T19:04:23.242684] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-30T19:04:23.396868] [DEBUG] [LOCAL ] GSBD: Loaded 39044 existing records from primary storage. [2025-09-30T19:04:23.425961] [INFO ] [MAIN ] GSBD: Loaded 39044 existing records. [2025-09-30T19:04:23.466060] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-30T19:04:23.568792] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-30T19:04:23.908511] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:23.923157] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-30T19:04:23.946609] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-30T19:04:23.953434] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-30T19:04:23.953522] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-30T19:04:23.953375] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:24.259548] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-30T19:04:24.344219] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:25.054357] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-30T19:04:25.093480] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T19:04:25.580875] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-30T19:04:25.854421] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-30T19:04:25.971059] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T19:04:26.654364] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-30T19:04:27.454386] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-30T19:04:27.515766] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:04:28.254399] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-30T19:04:28.843890] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-30T19:04:29.054397] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-30T19:04:29.089342] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T19:04:29.100008] [INFO ] [REMOTE ] GRMN: Full fetch complete (59925 records). [2025-09-30T19:04:29.100198] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-30T19:04:29.526589] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-30T19:04:29.526749] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-30T19:04:29.527697] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-30T19:04:29.527782] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-30T19:04:29.554079] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T19:04:29.563063] [DEBUG] [LOCAL ] GRMN: Trimmed 59925 records to 41031 (keeping 200 days of data) [2025-09-30T19:04:29.666739] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T19:04:29.854341] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-30T19:04:29.857165] [DEBUG] [LOCAL ] GRMN: Primary data saved (41031 records). [2025-09-30T19:04:29.857366] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-30T19:04:29.857484] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GRMN took 47.1s. Estimated remaining: 2h 58m 47s. Rate: 7.8 symbols/min [2025-09-30T19:04:30.040479] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:30.107829] [DEBUG] [LOCAL ] GSK: Loaded 53491 existing records from primary storage. [2025-09-30T19:04:30.108222] [INFO ] [MAIN ] GSK: Loaded 53491 existing records. [2025-09-30T19:04:30.314624] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:30.314881] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-30T19:04:30.314930] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-30T19:04:30.315464] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-30T19:04:30.315524] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-30T19:04:30.659461] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-30T19:04:30.702076] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:31.454392] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-30T19:04:31.825288] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-30T19:04:31.888760] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T19:04:32.254368] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-30T19:04:32.606696] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-30T19:04:33.066332] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-30T19:04:33.072892] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T19:04:33.735764] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-30T19:04:33.854394] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-30T19:04:34.654350] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-30T19:04:35.336028] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T19:04:35.454355] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-30T19:04:36.254359] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-30T19:04:36.816493] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-30T19:04:36.835442] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-30T19:04:37.054471] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-30T19:04:37.228460] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T19:04:37.854372] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-30T19:04:37.864040] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T19:04:38.654381] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-30T19:04:39.088512] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-30T19:04:39.454425] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-30T19:04:40.254427] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-30T19:04:40.682377] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-30T19:04:40.931321] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-30T19:04:40.964208] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T19:04:41.054350] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-30T19:04:41.854396] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-30T19:04:42.654343] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-30T19:04:42.903716] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T19:04:43.454420] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-30T19:04:44.032610] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-30T19:04:44.123513] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T19:04:44.254586] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-30T19:04:45.054408] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-30T19:04:45.266565] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T19:04:45.791330] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T19:04:45.793905] [INFO ] [REMOTE ] GRX: Full fetch complete (6580 records). [2025-09-30T19:04:45.793985] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-30T19:04:45.859672] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-30T19:04:46.217783] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-30T19:04:46.217863] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-30T19:04:46.218056] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-30T19:04:46.218097] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-30T19:04:46.218536] [DEBUG] [LOCAL ] GRX: Trimmed 6580 records to 4617 (keeping 200 days of data) [2025-09-30T19:04:46.248169] [DEBUG] [LOCAL ] GRX: Primary data saved (4617 records). [2025-09-30T19:04:46.248308] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-30T19:04:46.248438] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GRX took 26.5s. Estimated remaining: 2h 58m 52s. Rate: 7.8 symbols/min [2025-09-30T19:04:46.450203] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:46.506394] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-30T19:04:46.531798] [DEBUG] [LOCAL ] GSL: Loaded 33319 existing records from primary storage. [2025-09-30T19:04:46.532119] [INFO ] [MAIN ] GSL: Loaded 33319 existing records. [2025-09-30T19:04:46.659496] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-30T19:04:46.734619] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:46.735464] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-30T19:04:46.735568] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-30T19:04:46.736070] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-30T19:04:46.736150] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-30T19:04:47.140117] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:47.454364] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-30T19:04:47.991265] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-30T19:04:48.254384] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-30T19:04:48.586193] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T19:04:48.846610] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T19:04:49.054364] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-30T19:04:49.854359] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-30T19:04:50.312934] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-30T19:04:50.654341] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-30T19:04:51.019787] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T19:04:51.097846] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T19:04:51.106573] [INFO ] [REMOTE ] GSBD: Full fetch complete (58422 records). [2025-09-30T19:04:51.106730] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-30T19:04:51.467214] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-30T19:04:51.527895] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-30T19:04:51.527984] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-30T19:04:51.528939] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-30T19:04:51.529011] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-30T19:04:51.530349] [DEBUG] [LOCAL ] GSBD: Trimmed 58422 records to 39087 (keeping 200 days of data) [2025-09-30T19:04:51.795864] [DEBUG] [LOCAL ] GSBD: Primary data saved (39087 records). [2025-09-30T19:04:51.796032] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-30T19:04:51.796123] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GSBD took 29.0s. Estimated remaining: 2h 58m 42s. Rate: 7.8 symbols/min [2025-09-30T19:04:52.010446] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:52.062972] [DEBUG] [LOCAL ] GTES: Loaded 50587 existing records from primary storage. [2025-09-30T19:04:52.063373] [INFO ] [MAIN ] GTES: Loaded 50587 existing records. [2025-09-30T19:04:52.269024] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:52.262487] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-30T19:04:52.270553] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-30T19:04:52.270753] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-30T19:04:52.271320] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-30T19:04:52.271465] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-30T19:04:52.612226] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-30T19:04:52.765931] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:52.803953] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:04:53.054358] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-30T19:04:53.854379] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-30T19:04:54.567824] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-30T19:04:54.579523] [INFO ] [REMOTE ] GS: Full fetch complete (75708 records). [2025-09-30T19:04:54.579719] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-30T19:04:54.657372] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-30T19:04:55.002114] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-30T19:04:55.002284] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-30T19:04:55.003761] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-30T19:04:55.003948] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-30T19:04:55.007225] [DEBUG] [LOCAL ] GS: Trimmed 75708 records to 51906 (keeping 200 days of data) [2025-09-30T19:04:55.138415] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-30T19:04:55.198959] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:04:55.453238] [DEBUG] [LOCAL ] GS: Primary data saved (51906 records). [2025-09-30T19:04:55.453395] [INFO ] [MAIN ] GS: Full history saved. [2025-09-30T19:04:55.454464] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GS took 32.9s. Estimated remaining: 2h 58m 28s. Rate: 7.8 symbols/min [2025-09-30T19:04:55.454635] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-30T19:04:55.660127] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:04:55.707427] [DEBUG] [LOCAL ] GTLS: Loaded 42738 existing records from primary storage. [2025-09-30T19:04:55.707815] [INFO ] [MAIN ] GTLS: Loaded 42738 existing records. [2025-09-30T19:04:55.902482] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:04:55.902902] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-30T19:04:55.903150] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-30T19:04:55.903553] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-30T19:04:55.903613] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-30T19:04:56.191113] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T19:04:56.259480] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-30T19:04:56.325285] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:04:57.054386] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-30T19:04:57.127835] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T19:04:57.854342] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-30T19:04:58.278738] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-30T19:04:58.560183] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T19:04:58.654351] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-30T19:04:59.111363] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T19:04:59.454386] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-30T19:05:00.254381] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-30T19:05:00.994272] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-30T19:05:01.054416] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-30T19:05:01.227259] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T19:05:01.854400] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-30T19:05:02.287215] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-30T19:05:02.654361] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-30T19:05:02.866828] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T19:05:03.454342] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-30T19:05:03.863442] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-30T19:05:04.252900] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-30T19:05:04.260432] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-30T19:05:05.054378] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-30T19:05:05.181999] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T19:05:05.194364] [INFO ] [REMOTE ] GSK: Full fetch complete (77471 records). [2025-09-30T19:05:05.194516] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-30T19:05:05.660482] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-30T19:05:05.662114] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T19:05:05.662321] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-30T19:05:05.671713] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-30T19:05:05.671842] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-30T19:05:05.673635] [DEBUG] [LOCAL ] GSK: Trimmed 77471 records to 53492 (keeping 200 days of data) [2025-09-30T19:05:05.873480] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-30T19:05:06.039851] [DEBUG] [LOCAL ] GSK: Primary data saved (53492 records). [2025-09-30T19:05:06.040023] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-30T19:05:06.040113] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSK took 36.2s. Estimated remaining: 2h 58m 25s. Rate: 7.8 symbols/min [2025-09-30T19:05:06.226716] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:06.276295] [DEBUG] [LOCAL ] GTN: Loaded 45555 existing records from primary storage. [2025-09-30T19:05:06.276717] [INFO ] [MAIN ] GTN: Loaded 45555 existing records. [2025-09-30T19:05:06.543219] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:06.543723] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-30T19:05:06.543839] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-30T19:05:06.544373] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-30T19:05:06.544432] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-30T19:05:06.655996] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-30T19:05:06.956483] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T19:05:06.989125] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:07.454338] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-30T19:05:07.624908] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T19:05:08.259547] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-30T19:05:08.278623] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T19:05:08.668237] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T19:05:09.054367] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-30T19:05:09.859482] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-30T19:05:09.880236] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T19:05:10.654367] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-30T19:05:10.774568] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T19:05:11.454406] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-30T19:05:11.512956] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:05:12.254379] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-30T19:05:12.317038] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:05:12.518436] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-30T19:05:13.054411] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-30T19:05:13.860311] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-30T19:05:13.878615] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T19:05:14.286570] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T19:05:14.654379] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-30T19:05:15.439673] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T19:05:15.454322] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-30T19:05:15.914511] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T19:05:16.254375] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-30T19:05:17.054410] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-30T19:05:17.298691] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T19:05:17.312346] [INFO ] [REMOTE ] GTES: Full fetch complete (73912 records). [2025-09-30T19:05:17.312704] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-30T19:05:17.826551] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T19:05:17.863741] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-30T19:05:18.016862] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-30T19:05:18.016990] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-30T19:05:18.018614] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-30T19:05:18.018738] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-30T19:05:18.020602] [DEBUG] [LOCAL ] GTES: Trimmed 73912 records to 50537 (keeping 200 days of data) [2025-09-30T19:05:18.429405] [DEBUG] [LOCAL ] GTES: Primary data saved (50537 records). [2025-09-30T19:05:18.429804] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-30T19:05:18.430098] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GTES took 26.6s. Estimated remaining: 2h 58m 24s. Rate: 7.8 symbols/min [2025-09-30T19:05:18.645696] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:18.654451] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-30T19:05:18.693598] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:05:18.714817] [DEBUG] [LOCAL ] GTY: Loaded 30315 existing records from primary storage. [2025-09-30T19:05:18.715135] [INFO ] [MAIN ] GTY: Loaded 30315 existing records. [2025-09-30T19:05:18.908248] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:18.908504] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-30T19:05:18.908553] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-30T19:05:18.909035] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-30T19:05:18.909096] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-30T19:05:19.302328] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:19.385925] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T19:05:19.454376] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-30T19:05:20.254403] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-30T19:05:20.390018] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T19:05:20.403480] [INFO ] [REMOTE ] GTLS: Full fetch complete (61371 records). [2025-09-30T19:05:20.403762] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-30T19:05:20.860850] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-30T19:05:20.861001] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-30T19:05:20.861914] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-30T19:05:20.861982] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-30T19:05:20.863383] [DEBUG] [LOCAL ] GTLS: Trimmed 61371 records to 42730 (keeping 200 days of data) [2025-09-30T19:05:21.058732] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-30T19:05:21.139494] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T19:05:21.198470] [DEBUG] [LOCAL ] GTLS: Primary data saved (42730 records). [2025-09-30T19:05:21.198710] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-30T19:05:21.199573] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTLS took 25.7s. Estimated remaining: 2h 58m 9s. Rate: 7.8 symbols/min [2025-09-30T19:05:21.380188] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:21.397463] [DEBUG] [LOCAL ] GUG: Loaded 12025 existing records from primary storage. [2025-09-30T19:05:21.397926] [INFO ] [MAIN ] GUG: Loaded 12025 existing records. [2025-09-30T19:05:21.598758] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:21.619093] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-30T19:05:21.619813] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T19:05:21.620038] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-30T19:05:21.627683] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-30T19:05:21.627766] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-30T19:05:21.859457] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-30T19:05:22.036761] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:22.285440] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T19:05:22.654354] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-30T19:05:23.454329] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-30T19:05:23.552669] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:05:23.691507] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T19:05:24.254396] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-30T19:05:24.837459] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T19:05:25.054391] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-30T19:05:25.635773] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T19:05:25.854374] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-30T19:05:26.042170] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T19:05:26.654369] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-30T19:05:26.933097] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T19:05:27.454404] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-30T19:05:28.216206] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T19:05:28.254398] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-30T19:05:28.865754] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T19:05:29.054370] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-30T19:05:29.860219] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-30T19:05:29.880526] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T19:05:29.933596] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-30T19:05:30.654395] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-30T19:05:30.943498] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T19:05:31.454404] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-30T19:05:32.254335] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-30T19:05:32.308713] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T19:05:32.352760] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T19:05:32.363195] [INFO ] [REMOTE ] GTN: Full fetch complete (66425 records). [2025-09-30T19:05:32.363371] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-30T19:05:32.804935] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-30T19:05:32.805032] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-30T19:05:32.805988] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-30T19:05:32.806057] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-30T19:05:32.807796] [DEBUG] [LOCAL ] GTN: Trimmed 66425 records to 45533 (keeping 200 days of data) [2025-09-30T19:05:33.054600] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-30T19:05:33.102289] [DEBUG] [LOCAL ] GTN: Primary data saved (45533 records). [2025-09-30T19:05:33.102438] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-30T19:05:33.102553] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTN took 27.1s. Estimated remaining: 2h 58m 7s. Rate: 7.8 symbols/min [2025-09-30T19:05:33.291770] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:33.311522] [DEBUG] [LOCAL ] GUT: Loaded 15315 existing records from primary storage. [2025-09-30T19:05:33.311817] [INFO ] [MAIN ] GUT: Loaded 15315 existing records. [2025-09-30T19:05:33.511042] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:33.511318] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-30T19:05:33.511457] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-30T19:05:33.511864] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-30T19:05:33.511975] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-30T19:05:33.663425] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:05:33.697674] [INFO ] [REMOTE ] GSL: Full fetch complete (47981 records). [2025-09-30T19:05:33.717787] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-30T19:05:33.857592] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-30T19:05:34.107125] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-30T19:05:34.256941] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:34.426295] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-30T19:05:34.426408] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-30T19:05:34.427192] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-30T19:05:34.427261] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-30T19:05:34.428574] [DEBUG] [LOCAL ] GSL: Trimmed 47981 records to 33345 (keeping 200 days of data) [2025-09-30T19:05:34.647876] [DEBUG] [LOCAL ] GSL: Primary data saved (33345 records). [2025-09-30T19:05:34.648040] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-30T19:05:34.648178] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GSL took 48.4s. Estimated remaining: 2h 57m 51s. Rate: 7.8 symbols/min [2025-09-30T19:05:34.660168] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-30T19:05:34.839151] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:34.878113] [DEBUG] [LOCAL ] GVA: Loaded 33227 existing records from primary storage. [2025-09-30T19:05:34.878580] [INFO ] [MAIN ] GVA: Loaded 33227 existing records. [2025-09-30T19:05:35.079283] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:35.079592] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-30T19:05:35.079688] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-30T19:05:35.080501] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-30T19:05:35.080563] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-30T19:05:35.472102] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-30T19:05:35.512130] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:35.539011] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:05:35.666501] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T19:05:36.254377] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-30T19:05:36.545040] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T19:05:37.054328] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-30T19:05:37.532746] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-30T19:05:37.854378] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-30T19:05:38.136767] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T19:05:38.606897] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T19:05:38.654359] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-30T19:05:39.454397] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-30T19:05:39.543278] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-30T19:05:40.254391] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-30T19:05:40.715505] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T19:05:41.054378] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-30T19:05:41.224231] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T19:05:41.854359] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-30T19:05:42.182073] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T19:05:42.654343] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-30T19:05:42.673474] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T19:05:43.454394] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-30T19:05:44.064547] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T19:05:44.254350] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-30T19:05:44.306956] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T19:05:45.054382] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-30T19:05:45.083637] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T19:05:45.854366] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-30T19:05:46.436128] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T19:05:46.455409] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-30T19:05:46.654363] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-30T19:05:47.347987] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-30T19:05:47.352370] [INFO ] [REMOTE ] GUG: Full fetch complete (19847 records). [2025-09-30T19:05:47.352534] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-30T19:05:47.460369] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-30T19:05:47.926684] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-30T19:05:47.926789] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-30T19:05:47.927299] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-30T19:05:47.927376] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-30T19:05:47.928444] [DEBUG] [LOCAL ] GUG: Trimmed 19847 records to 12048 (keeping 200 days of data) [2025-09-30T19:05:48.009566] [DEBUG] [LOCAL ] GUG: Primary data saved (12048 records). [2025-09-30T19:05:48.009769] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-30T19:05:48.009950] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GUG took 26.8s. Estimated remaining: 2h 57m 51s. Rate: 7.8 symbols/min [2025-09-30T19:05:48.241129] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:48.255432] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-30T19:05:48.266236] [DEBUG] [LOCAL ] GWH: Loaded 15818 existing records from primary storage. [2025-09-30T19:05:48.266584] [INFO ] [MAIN ] GWH: Loaded 15818 existing records. [2025-09-30T19:05:48.463827] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:48.464224] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-30T19:05:48.464326] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-30T19:05:48.464765] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-30T19:05:48.464881] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-30T19:05:48.866366] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T19:05:48.916508] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:49.054430] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-30T19:05:49.517607] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-30T19:05:49.731385] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-30T19:05:49.854369] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-30T19:05:50.389256] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-30T19:05:50.654376] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-30T19:05:51.208075] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T19:05:51.454376] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-30T19:05:52.254408] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-30T19:05:52.973069] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-30T19:05:53.054406] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-30T19:05:53.188614] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T19:05:53.854395] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-30T19:05:54.029995] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T19:05:54.654403] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-30T19:05:55.188762] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T19:05:55.454334] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-30T19:05:55.505992] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T19:05:56.254382] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-30T19:05:56.725242] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T19:05:56.732066] [INFO ] [REMOTE ] GTY: Full fetch complete (43379 records). [2025-09-30T19:05:56.732165] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-30T19:05:57.059435] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-30T19:05:57.165715] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-30T19:05:57.165795] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-30T19:05:57.166495] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-30T19:05:57.166557] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-30T19:05:57.168244] [DEBUG] [LOCAL ] GTY: Trimmed 43379 records to 30299 (keeping 200 days of data) [2025-09-30T19:05:57.381835] [DEBUG] [LOCAL ] GTY: Primary data saved (30299 records). [2025-09-30T19:05:57.381982] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-30T19:05:57.382111] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GTY took 39.0s. Estimated remaining: 2h 57m 46s. Rate: 7.8 symbols/min [2025-09-30T19:05:57.589889] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:05:57.591540] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T19:05:57.642027] [DEBUG] [LOCAL ] GWRE: Loaded 40718 existing records from primary storage. [2025-09-30T19:05:57.642409] [INFO ] [MAIN ] GWRE: Loaded 40718 existing records. [2025-09-30T19:05:57.838474] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:05:57.838689] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-30T19:05:57.838748] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-30T19:05:57.839167] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-30T19:05:57.839236] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-30T19:05:57.861148] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-30T19:05:58.191275] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T19:05:58.268217] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:05:58.654394] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-30T19:05:59.251951] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-30T19:05:59.454376] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-30T19:06:00.245894] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:06:00.255842] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-30T19:06:00.628611] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T19:06:01.054426] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-30T19:06:01.391606] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T19:06:01.854366] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-30T19:06:02.596292] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T19:06:02.654348] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-30T19:06:02.798520] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T19:06:03.454363] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-30T19:06:04.192452] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T19:06:04.198985] [INFO ] [REMOTE ] GVA: Full fetch complete (48604 records). [2025-09-30T19:06:04.199103] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-30T19:06:04.259486] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-30T19:06:04.625088] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-30T19:06:04.625230] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-30T19:06:04.626055] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-30T19:06:04.626132] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-30T19:06:04.627293] [DEBUG] [LOCAL ] GVA: Trimmed 48604 records to 33174 (keeping 200 days of data) [2025-09-30T19:06:04.781027] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T19:06:04.904624] [DEBUG] [LOCAL ] GVA: Primary data saved (33174 records). [2025-09-30T19:06:04.904820] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-30T19:06:04.904909] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GVA took 30.3s. Estimated remaining: 2h 57m 38s. Rate: 7.8 symbols/min [2025-09-30T19:06:05.061071] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-30T19:06:05.103044] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:05.105300] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T19:06:05.129048] [DEBUG] [LOCAL ] GWW: Loaded 19542 existing records from primary storage. [2025-09-30T19:06:05.129340] [INFO ] [MAIN ] GWW: Loaded 19542 existing records. [2025-09-30T19:06:05.346235] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:05.346547] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-30T19:06:05.346670] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-30T19:06:05.346986] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-30T19:06:05.347066] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-30T19:06:05.762476] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:05.854352] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-30T19:06:06.026364] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T19:06:06.029991] [INFO ] [REMOTE ] GUT: Full fetch complete (22829 records). [2025-09-30T19:06:06.030084] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-30T19:06:06.445179] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-30T19:06:06.445270] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-30T19:06:06.445921] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-30T19:06:06.445994] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-30T19:06:06.447166] [DEBUG] [LOCAL ] GUT: Trimmed 22829 records to 15320 (keeping 200 days of data) [2025-09-30T19:06:06.537761] [DEBUG] [LOCAL ] GUT: Primary data saved (15320 records). [2025-09-30T19:06:06.537902] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-30T19:06:06.538006] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GUT took 33.4s. Estimated remaining: 2h 57m 22s. Rate: 7.8 symbols/min [2025-09-30T19:06:06.659516] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-30T19:06:06.729585] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:06.784345] [DEBUG] [LOCAL ] GXO: Loaded 47499 existing records from primary storage. [2025-09-30T19:06:06.784736] [INFO ] [MAIN ] GXO: Loaded 47499 existing records. [2025-09-30T19:06:06.983439] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:06.990905] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-30T19:06:06.991021] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-30T19:06:06.992339] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-30T19:06:06.992452] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-30T19:06:06.992269] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T19:06:07.387310] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:07.454334] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-30T19:06:08.254419] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-30T19:06:08.491638] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T19:06:09.010848] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T19:06:09.054325] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-30T19:06:09.153319] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T19:06:09.854343] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-30T19:06:10.075306] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-30T19:06:10.654415] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-30T19:06:11.431786] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:06:11.454409] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-30T19:06:12.254365] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-30T19:06:12.325746] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T19:06:12.610325] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T19:06:13.054358] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-30T19:06:13.809981] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T19:06:13.854324] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-30T19:06:14.270967] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T19:06:14.654366] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-30T19:06:15.454318] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-30T19:06:15.511596] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T19:06:15.838734] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-30T19:06:16.254360] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-30T19:06:16.760733] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T19:06:17.054365] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-30T19:06:17.391527] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T19:06:17.854346] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-30T19:06:18.146403] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T19:06:18.654410] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-30T19:06:19.417408] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T19:06:19.454407] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-30T19:06:19.859582] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T19:06:20.254355] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-30T19:06:20.375513] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T19:06:21.054389] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-30T19:06:21.851431] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T19:06:21.860713] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-30T19:06:22.395493] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T19:06:22.654397] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-30T19:06:23.054012] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T19:06:23.454431] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-30T19:06:23.649865] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T19:06:24.254409] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-30T19:06:24.619404] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T19:06:25.054555] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-30T19:06:25.506050] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:06:25.510678] [INFO ] [REMOTE ] GWH: Full fetch complete (21159 records). [2025-09-30T19:06:25.510870] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-30T19:06:25.856707] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-30T19:06:25.956091] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-30T19:06:25.956347] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-30T19:06:25.957180] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-30T19:06:25.957386] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-30T19:06:25.964167] [DEBUG] [LOCAL ] GWH: Trimmed 21159 records to 15953 (keeping 200 days of data) [2025-09-30T19:06:25.974492] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T19:06:26.024589] [INFO ] [REMOTE ] GWW: Full fetch complete (29255 records). [2025-09-30T19:06:26.047341] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-30T19:06:26.153579] [DEBUG] [LOCAL ] GWH: Primary data saved (15953 records). [2025-09-30T19:06:26.173296] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-30T19:06:26.195319] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GWH took 38.2s. Estimated remaining: 2h 57m 31s. Rate: 7.8 symbols/min [2025-09-30T19:06:26.578373] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:26.633978] [DEBUG] [LOCAL ] GYLD: Loaded 1537 existing records from primary storage. [2025-09-30T19:06:26.644602] [INFO ] [MAIN ] GYLD: Loaded 1537 existing records. [2025-09-30T19:06:26.661966] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-30T19:06:26.753240] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-30T19:06:26.753485] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-30T19:06:26.768704] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-30T19:06:26.791599] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-30T19:06:26.836750] [DEBUG] [LOCAL ] GWW: Trimmed 29255 records to 19483 (keeping 200 days of data) [2025-09-30T19:06:27.013496] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:27.046117] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-30T19:06:27.046670] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-30T19:06:27.048895] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-30T19:06:27.050497] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-30T19:06:27.482693] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:27.484263] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-30T19:06:27.491547] [DEBUG] [LOCAL ] GWW: Primary data saved (19483 records). [2025-09-30T19:06:27.491978] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-30T19:06:27.492246] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWW took 22.6s. Estimated remaining: 2h 57m 14s. Rate: 7.8 symbols/min [2025-09-30T19:06:27.704378] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T19:06:27.708689] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:27.774665] [DEBUG] [LOCAL ] H: Loaded 44703 existing records from primary storage. [2025-09-30T19:06:27.775208] [INFO ] [MAIN ] H: Loaded 44703 existing records. [2025-09-30T19:06:27.852101] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-30T19:06:27.980779] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:27.981099] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-30T19:06:27.981196] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-30T19:06:27.981894] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-30T19:06:27.981957] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-30T19:06:28.120448] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T19:06:28.263860] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-30T19:06:28.402518] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:29.054403] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-30T19:06:29.309476] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-30T19:06:29.434128] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T19:06:29.854375] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-30T19:06:30.202563] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-30T19:06:30.654380] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-30T19:06:31.454408] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-30T19:06:32.253946] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T19:06:32.263570] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-30T19:06:33.054350] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-30T19:06:33.196301] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-30T19:06:33.205850] [INFO ] [REMOTE ] GWRE: Full fetch complete (61156 records). [2025-09-30T19:06:33.206004] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-30T19:06:33.550513] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-30T19:06:33.541692] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T19:06:33.683338] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-30T19:06:33.683445] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-30T19:06:33.684281] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-30T19:06:33.684346] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-30T19:06:33.685692] [DEBUG] [LOCAL ] GWRE: Trimmed 61156 records to 40664 (keeping 200 days of data) [2025-09-30T19:06:33.861898] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-30T19:06:33.948421] [DEBUG] [LOCAL ] GWRE: Primary data saved (40664 records). [2025-09-30T19:06:33.948526] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-30T19:06:33.948672] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GWRE took 36.6s. Estimated remaining: 2h 57m 5s. Rate: 7.8 symbols/min [2025-09-30T19:06:34.128422] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:34.169709] [DEBUG] [LOCAL ] HAE: Loaded 39432 existing records from primary storage. [2025-09-30T19:06:34.170014] [INFO ] [MAIN ] HAE: Loaded 39432 existing records. [2025-09-30T19:06:34.359119] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-30T19:06:34.364833] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:34.366303] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-30T19:06:34.366352] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-30T19:06:34.366847] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-30T19:06:34.366906] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-30T19:06:34.658804] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-30T19:06:34.743841] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:35.454360] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-30T19:06:36.254375] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-30T19:06:36.323024] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T19:06:36.393491] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-30T19:06:36.679407] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-30T19:06:37.054393] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-30T19:06:37.478887] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T19:06:37.854364] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-30T19:06:38.654388] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-30T19:06:39.140169] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T19:06:39.454355] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-30T19:06:39.611241] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T19:06:39.624858] [INFO ] [REMOTE ] GXO: Full fetch complete (70037 records). [2025-09-30T19:06:39.625075] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-30T19:06:39.943999] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-30T19:06:40.054302] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-30T19:06:40.054396] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-30T19:06:40.055373] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-30T19:06:40.055443] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-30T19:06:40.056961] [DEBUG] [LOCAL ] GXO: Trimmed 70037 records to 47460 (keeping 200 days of data) [2025-09-30T19:06:40.265430] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-30T19:06:40.347560] [DEBUG] [LOCAL ] GXO: Primary data saved (47460 records). [2025-09-30T19:06:40.347727] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-30T19:06:40.347824] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GXO took 33.8s. Estimated remaining: 2h 56m 55s. Rate: 7.8 symbols/min [2025-09-30T19:06:40.529582] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:40.581956] [DEBUG] [LOCAL ] HAFN: Loaded 43393 existing records from primary storage. [2025-09-30T19:06:40.582308] [INFO ] [MAIN ] HAFN: Loaded 43393 existing records. [2025-09-30T19:06:40.804711] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:40.804959] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-30T19:06:40.805016] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-30T19:06:40.805555] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-30T19:06:40.805620] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-30T19:06:40.913754] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T19:06:40.917911] [INFO ] [REMOTE ] GYLD: Full fetch complete (2066 records). [2025-09-30T19:06:40.918005] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-30T19:06:41.061106] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-30T19:06:41.542675] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:41.613181] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-30T19:06:41.613257] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-30T19:06:41.613356] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-30T19:06:41.613403] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-30T19:06:41.613825] [DEBUG] [LOCAL ] GYLD: Trimmed 2066 records to 1541 (keeping 200 days of data) [2025-09-30T19:06:41.624164] [DEBUG] [LOCAL ] GYLD: Primary data saved (1541 records). [2025-09-30T19:06:41.624252] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-30T19:06:41.624361] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GYLD took 15.4s. Estimated remaining: 2h 56m 39s. Rate: 7.8 symbols/min [2025-09-30T19:06:41.806767] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:06:41.855105] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-30T19:06:41.877955] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-30T19:06:41.878335] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-09-30T19:06:42.065126] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:06:42.065338] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-30T19:06:42.065385] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-30T19:06:42.066189] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-30T19:06:42.066252] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-30T19:06:42.438754] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:06:42.535029] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T19:06:42.654360] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-30T19:06:43.454326] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-30T19:06:43.810724] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-30T19:06:44.154531] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T19:06:44.254380] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-30T19:06:44.931947] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T19:06:45.054335] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-30T19:06:45.854352] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-30T19:06:46.126330] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-30T19:06:46.591873] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:06:46.654365] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-30T19:06:47.454358] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-30T19:06:47.751786] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T19:06:48.046837] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:06:48.254363] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-30T19:06:49.054340] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-30T19:06:49.221192] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T19:06:49.854344] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-30T19:06:50.260321] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-30T19:06:50.654335] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-30T19:06:50.887705] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T19:06:51.226347] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T19:06:51.454410] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-30T19:06:52.117788] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T19:06:52.254344] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-30T19:06:53.054332] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-30T19:06:53.091882] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:06:53.801894] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T19:06:53.854364] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-30T19:06:54.509008] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T19:06:54.654371] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-30T19:06:55.454379] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-30T19:06:55.654284] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T19:06:56.254399] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-30T19:06:56.480701] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T19:06:56.846414] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T19:06:57.054388] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-30T19:06:57.865396] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-30T19:06:57.871241] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T19:06:58.654334] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-30T19:06:58.734034] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:06:59.301584] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:06:59.454359] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-30T19:07:00.254333] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-30T19:07:00.319118] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T19:07:00.885890] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T19:07:01.054381] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-30T19:07:01.845174] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T19:07:01.854344] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-30T19:07:02.654372] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-30T19:07:03.125561] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-30T19:07:03.257374] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T19:07:03.454423] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-30T19:07:04.254387] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-30T19:07:04.304583] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:07:04.318234] [INFO ] [REMOTE ] H: Full fetch complete (62031 records). [2025-09-30T19:07:04.318427] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-30T19:07:04.745677] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-30T19:07:04.745831] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-30T19:07:04.746698] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-30T19:07:04.746761] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-30T19:07:04.748204] [DEBUG] [LOCAL ] H: Trimmed 62031 records to 44651 (keeping 200 days of data) [2025-09-30T19:07:05.045480] [DEBUG] [LOCAL ] H: Primary data saved (44651 records). [2025-09-30T19:07:05.045665] [INFO ] [MAIN ] H: Full history saved. [2025-09-30T19:07:05.045778] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. H took 37.6s. Estimated remaining: 2h 56m 53s. Rate: 7.8 symbols/min [2025-09-30T19:07:05.072239] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-30T19:07:05.235007] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:07:05.263841] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-30T19:07:05.274347] [INFO ] [REMOTE ] HAE: Full fetch complete (58071 records). [2025-09-30T19:07:05.274521] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-30T19:07:05.613160] [DEBUG] [LOCAL ] HASI: Loaded 47129 existing records from primary storage. [2025-09-30T19:07:05.641286] [INFO ] [MAIN ] HASI: Loaded 47129 existing records. [2025-09-30T19:07:05.892165] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-30T19:07:05.917377] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-30T19:07:05.941211] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-30T19:07:05.969449] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:07:05.969914] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-30T19:07:05.970194] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-30T19:07:05.970103] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-30T19:07:05.971723] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-30T19:07:05.972011] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-30T19:07:06.012892] [DEBUG] [LOCAL ] HAE: Trimmed 58071 records to 39442 (keeping 200 days of data) [2025-09-30T19:07:06.490596] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-30T19:07:06.592896] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:07:06.577091] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-30T19:07:06.677780] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-30T19:07:06.717777] [DEBUG] [LOCAL ] HAE: Primary data saved (39442 records). [2025-09-30T19:07:06.718009] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-30T19:07:06.718202] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HAE took 32.8s. Estimated remaining: 2h 56m 37s. Rate: 7.8 symbols/min [2025-09-30T19:07:06.929096] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-30T19:07:06.932755] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:07:06.995294] [DEBUG] [LOCAL ] HAYW: Loaded 48702 existing records from primary storage. [2025-09-30T19:07:06.995670] [INFO ] [MAIN ] HAYW: Loaded 48702 existing records. [2025-09-30T19:07:07.188466] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:07:07.188784] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-30T19:07:07.188839] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-30T19:07:07.189263] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-30T19:07:07.189324] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-30T19:07:07.462981] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-30T19:07:07.597600] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:07:07.980675] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T19:07:08.254328] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-30T19:07:08.676692] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-30T19:07:09.054332] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-30T19:07:09.153536] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:07:09.547907] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T19:07:09.854367] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-30T19:07:10.594179] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-30T19:07:10.654356] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-30T19:07:11.446443] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T19:07:11.456197] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-30T19:07:12.254362] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-30T19:07:12.664283] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T19:07:12.722418] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T19:07:13.054364] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-30T19:07:13.795265] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:07:13.854359] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-30T19:07:14.654347] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-30T19:07:14.718229] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T19:07:14.727253] [INFO ] [REMOTE ] HAFN: Full fetch complete (65611 records). [2025-09-30T19:07:14.727404] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-30T19:07:15.149580] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-30T19:07:15.149705] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-30T19:07:15.150681] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-30T19:07:15.150754] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-30T19:07:15.152157] [DEBUG] [LOCAL ] HAFN: Trimmed 65611 records to 43295 (keeping 200 days of data) [2025-09-30T19:07:15.418013] [DEBUG] [LOCAL ] HAFN: Primary data saved (43295 records). [2025-09-30T19:07:15.418176] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-30T19:07:15.418278] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAFN took 35.1s. Estimated remaining: 2h 56m 31s. Rate: 7.8 symbols/min [2025-09-30T19:07:15.463247] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-30T19:07:15.620822] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:07:15.635619] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T19:07:15.652599] [DEBUG] [LOCAL ] HBB: Loaded 6697 existing records from primary storage. [2025-09-30T19:07:15.652890] [INFO ] [MAIN ] HBB: Loaded 6697 existing records. [2025-09-30T19:07:15.849578] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:07:15.849971] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-30T19:07:15.850206] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-30T19:07:15.850538] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-30T19:07:15.850598] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-30T19:07:16.251693] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:07:16.260009] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-30T19:07:16.265878] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:07:17.054394] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-30T19:07:17.562514] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-30T19:07:17.854333] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-30T19:07:17.896413] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:07:18.432513] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T19:07:18.654356] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-30T19:07:19.454329] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-30T19:07:20.039852] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-30T19:07:20.051596] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-09-30T19:07:20.051789] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-30T19:07:20.269225] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-30T19:07:20.486862] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:07:20.546187] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-30T19:07:20.546295] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-30T19:07:20.547416] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-30T19:07:20.547493] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-30T19:07:20.549417] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-09-30T19:07:20.907371] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-09-30T19:07:20.907536] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-30T19:07:20.908451] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAL took 39.3s. Estimated remaining: 2h 56m 20s. Rate: 7.8 symbols/min [2025-09-30T19:07:21.068288] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-30T19:07:21.105624] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:07:21.149606] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T19:07:21.152892] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T19:07:21.215897] [DEBUG] [LOCAL ] HBI: Loaded 52992 existing records from primary storage. [2025-09-30T19:07:21.216229] [INFO ] [MAIN ] HBI: Loaded 52992 existing records. [2025-09-30T19:07:21.406214] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:07:21.406433] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-30T19:07:21.406486] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-30T19:07:21.406868] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-30T19:07:21.406938] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-30T19:07:21.798000] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:07:21.854383] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-30T19:07:22.643264] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T19:07:22.654492] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-30T19:07:23.454366] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-30T19:07:23.536683] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T19:07:24.210805] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T19:07:24.254383] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-30T19:07:24.795592] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T19:07:25.054352] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-30T19:07:25.655468] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T19:07:25.854347] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-30T19:07:25.888004] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T19:07:26.654406] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-30T19:07:27.454367] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-30T19:07:27.508952] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:07:28.118788] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-30T19:07:28.254388] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-30T19:07:28.354994] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T19:07:28.365733] [INFO ] [REMOTE ] HAYW: Full fetch complete (70921 records). [2025-09-30T19:07:28.365868] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-30T19:07:28.778789] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-30T19:07:28.778918] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-30T19:07:28.780110] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-30T19:07:28.780189] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-30T19:07:28.781962] [DEBUG] [LOCAL ] HAYW: Trimmed 70921 records to 48728 (keeping 200 days of data) [2025-09-30T19:07:29.010680] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-30T19:07:29.054567] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-30T19:07:29.112010] [DEBUG] [LOCAL ] HAYW: Primary data saved (48728 records). [2025-09-30T19:07:29.112167] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-30T19:07:29.112257] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HAYW took 22.4s. Estimated remaining: 2h 56m 13s. Rate: 7.8 symbols/min [2025-09-30T19:07:29.298616] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:07:29.354478] [DEBUG] [LOCAL ] HBM: Loaded 52906 existing records from primary storage. [2025-09-30T19:07:29.354857] [INFO ] [MAIN ] HBM: Loaded 52906 existing records. [2025-09-30T19:07:29.548386] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:07:29.548604] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-30T19:07:29.548708] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-30T19:07:29.549204] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-30T19:07:29.549263] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-30T19:07:29.859437] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-30T19:07:29.934378] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:07:29.945084] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T19:07:30.654402] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-30T19:07:31.287840] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-30T19:07:31.454382] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-30T19:07:31.598712] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T19:07:32.254383] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-30T19:07:32.857433] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T19:07:33.054374] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-30T19:07:33.859488] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-30T19:07:33.875039] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T19:07:34.576118] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T19:07:34.623839] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T19:07:34.654355] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-30T19:07:35.454360] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-30T19:07:36.254356] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-30T19:07:36.347592] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:07:37.059459] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-30T19:07:37.079737] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T19:07:37.854342] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-30T19:07:37.961022] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:07:38.654392] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-30T19:07:38.904424] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T19:07:39.454351] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-30T19:07:39.578771] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T19:07:40.254356] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-30T19:07:40.370896] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T19:07:40.381050] [INFO ] [REMOTE ] HASI: Full fetch complete (68092 records). [2025-09-30T19:07:40.381192] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-30T19:07:40.783589] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-30T19:07:40.783750] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-30T19:07:40.784665] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-30T19:07:40.784730] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-30T19:07:40.786137] [DEBUG] [LOCAL ] HASI: Trimmed 68092 records to 47161 (keeping 200 days of data) [2025-09-30T19:07:41.062705] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-30T19:07:41.077398] [DEBUG] [LOCAL ] HASI: Primary data saved (47161 records). [2025-09-30T19:07:41.077688] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-30T19:07:41.077868] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HASI took 36.0s. Estimated remaining: 2h 56m 11s. Rate: 7.8 symbols/min [2025-09-30T19:07:41.296993] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:07:41.300899] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T19:07:41.359042] [DEBUG] [LOCAL ] HCA: Loaded 46951 existing records from primary storage. [2025-09-30T19:07:41.359380] [INFO ] [MAIN ] HCA: Loaded 46951 existing records. [2025-09-30T19:07:41.545847] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:07:41.546057] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-30T19:07:41.546105] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-30T19:07:41.546744] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-30T19:07:41.546806] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-30T19:07:41.760087] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T19:07:41.864689] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-30T19:07:41.967334] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:07:42.003462] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T19:07:42.654368] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-30T19:07:43.454416] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-30T19:07:43.665418] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T19:07:44.146287] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T19:07:44.254369] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-30T19:07:44.450369] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T19:07:45.054360] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-30T19:07:45.854337] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-30T19:07:46.042747] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T19:07:46.654855] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-30T19:07:46.655612] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-30T19:07:46.658096] [INFO ] [REMOTE ] HBB: Full fetch complete (9690 records). [2025-09-30T19:07:46.658265] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-30T19:07:46.952825] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T19:07:47.122077] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-30T19:07:47.122161] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-30T19:07:47.122448] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-30T19:07:47.122511] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-30T19:07:47.123090] [DEBUG] [LOCAL ] HBB: Trimmed 9690 records to 6651 (keeping 200 days of data) [2025-09-30T19:07:47.166296] [DEBUG] [LOCAL ] HBB: Primary data saved (6651 records). [2025-09-30T19:07:47.166429] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-30T19:07:47.166517] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HBB took 31.7s. Estimated remaining: 2h 56m 1s. Rate: 7.8 symbols/min [2025-09-30T19:07:47.454381] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-30T19:07:48.254378] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-30T19:07:48.352593] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T19:07:48.740782] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T19:07:49.054378] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-30T19:07:49.854329] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-30T19:07:50.167405] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T19:07:50.654337] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-30T19:07:50.707525] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T19:07:51.363675] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T19:07:51.454398] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-30T19:07:52.254369] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-30T19:07:52.586558] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T19:07:52.597819] [INFO ] [REMOTE ] HBI: Full fetch complete (76894 records). [2025-09-30T19:07:52.597968] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-30T19:07:53.029004] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-30T19:07:53.029094] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-30T19:07:53.030127] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-30T19:07:53.030194] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-30T19:07:53.031778] [DEBUG] [LOCAL ] HBI: Trimmed 76894 records to 52992 (keeping 200 days of data) [2025-09-30T19:07:53.361799] [DEBUG] [LOCAL ] HBI: Primary data saved (52992 records). [2025-09-30T19:07:53.362127] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-30T19:07:53.363810] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 32.5s. Estimated remaining: 2h 55m 52s. Rate: 7.8 symbols/min [2025-09-30T19:07:53.434708] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T19:07:53.446332] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-30T19:07:54.098207] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T19:07:54.113458] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-30T19:07:54.986069] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:07:54.997962] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-30T19:07:55.840137] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:07:55.852162] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-30T19:07:56.458338] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T19:07:56.469076] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-30T19:07:57.498158] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:07:57.509707] [INFO ] [REMOTE ] HBM: Full fetch complete (76194 records). [2025-09-30T19:07:57.509877] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-30T19:07:57.927249] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-30T19:07:57.927396] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-30T19:07:57.928633] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-30T19:07:57.928744] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-30T19:07:57.930534] [DEBUG] [LOCAL ] HBM: Trimmed 76194 records to 52903 (keeping 200 days of data) [2025-09-30T19:07:58.204863] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-30T19:07:58.223637] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-30T19:07:58.307170] [DEBUG] [LOCAL ] HBM: Primary data saved (52903 records). [2025-09-30T19:07:58.307363] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-30T19:07:58.307503] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HBM took 29.2s. Estimated remaining: 2h 55m 40s. Rate: 7.8 symbols/min [2025-09-30T19:08:00.122591] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T19:08:00.134701] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-30T19:08:01.841989] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:08:01.852801] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-30T19:08:03.831847] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T19:08:03.841697] [INFO ] [REMOTE ] HCA: Full fetch complete (68961 records). [2025-09-30T19:08:03.841909] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-30T19:08:04.260823] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-30T19:08:04.260918] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-30T19:08:04.261895] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-30T19:08:04.261961] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-30T19:08:04.263428] [DEBUG] [LOCAL ] HCA: Trimmed 68961 records to 46952 (keeping 200 days of data) [2025-09-30T19:08:04.578472] [DEBUG] [LOCAL ] HCA: Primary data saved (46952 records). [2025-09-30T19:08:04.578619] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-30T19:08:04.578781] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HCA took 23.5s. Estimated remaining: 2h 55m 31s. Rate: 7.8 symbols/min [2025-09-30T19:08:05.213190] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:05.236024] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:05.374720] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:05.395012] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:05.395763] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-30T19:08:05.395809] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-30T19:08:05.395981] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-30T19:08:05.396036] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-30T19:08:05.396078] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-30T19:08:05.396134] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-30T19:08:05.609258] [DEBUG] [LOCAL ] HCI: Loaded 13948 existing records from primary storage. [2025-09-30T19:08:05.640558] [INFO ] [MAIN ] HCI: Loaded 13948 existing records. [2025-09-30T19:08:05.843743] [DEBUG] [LOCAL ] HD: Loaded 53503 existing records from primary storage. [2025-09-30T19:08:05.833797] [DEBUG] [LOCAL ] HCC: Loaded 45384 existing records from primary storage. [2025-09-30T19:08:05.855522] [INFO ] [MAIN ] HD: Loaded 53503 existing records. [2025-09-30T19:08:05.873275] [INFO ] [MAIN ] HCC: Loaded 45384 existing records. [2025-09-30T19:08:06.206101] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:06.285472] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-30T19:08:06.321965] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-30T19:08:06.406139] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:06.455678] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-30T19:08:06.461717] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:06.467385] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-30T19:08:06.472779] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-30T19:08:06.495709] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-30T19:08:06.540098] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-30T19:08:06.570724] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:06.606697] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-30T19:08:06.640878] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-30T19:08:06.640754] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-30T19:08:06.654507] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-30T19:08:06.706988] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-30T19:08:06.717588] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-30T19:08:07.057114] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-30T19:08:07.112703] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-30T19:08:07.575460] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:07.617708] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-30T19:08:07.785008] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-30T19:08:07.816522] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:07.852368] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:07.854237] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-30T19:08:07.852771] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-30T19:08:07.853818] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-30T19:08:08.185383] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T19:08:08.186378] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-30T19:08:08.413487] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-30T19:08:08.414631] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-30T19:08:08.519242] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T19:08:08.524351] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-30T19:08:08.635343] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-30T19:08:08.636238] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-30T19:08:08.862324] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-30T19:08:08.863477] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-30T19:08:09.124401] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T19:08:09.127639] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-30T19:08:09.181735] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-30T19:08:09.182593] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-30T19:08:09.331519] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T19:08:09.447334] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-30T19:08:09.853681] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-30T19:08:09.864548] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-30T19:08:09.915141] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T19:08:10.337937] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T19:08:10.654364] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-30T19:08:11.025914] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-30T19:08:11.026636] [INFO ] [REMOTE ] HCXY: Full fetch complete (571 records). [2025-09-30T19:08:11.026733] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-30T19:08:11.212495] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-30T19:08:11.212714] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:08:11.212786] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:08:11.212859] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-30T19:08:11.212925] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-30T19:08:11.212990] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-30T19:08:11.213072] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-30T19:08:11.213185] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 6.6s. Estimated remaining: 2h 55m 22s. Rate: 7.8 symbols/min [2025-09-30T19:08:11.396412] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:11.463426] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-30T19:08:11.470262] [DEBUG] [LOCAL ] HDB: Loaded 51912 existing records from primary storage. [2025-09-30T19:08:11.470966] [INFO ] [MAIN ] HDB: Loaded 51912 existing records. [2025-09-30T19:08:11.734938] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:11.735199] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-30T19:08:11.735261] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-30T19:08:11.735875] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-30T19:08:11.735937] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-30T19:08:12.119037] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:12.254357] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-30T19:08:12.502514] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T19:08:13.054364] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-30T19:08:13.854354] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-30T19:08:13.934069] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T19:08:14.654395] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-30T19:08:15.122366] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-30T19:08:15.348519] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-30T19:08:15.467385] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-30T19:08:15.495567] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T19:08:16.254370] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-30T19:08:16.963348] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-30T19:08:17.054363] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-30T19:08:17.138334] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T19:08:17.854398] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-30T19:08:18.654391] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-30T19:08:19.290803] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-30T19:08:19.454334] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-30T19:08:19.528349] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T19:08:19.623856] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-30T19:08:20.254374] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-30T19:08:21.054371] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-30T19:08:21.245918] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T19:08:21.498300] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-30T19:08:21.854355] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-30T19:08:22.654395] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-30T19:08:22.695927] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T19:08:22.732491] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T19:08:23.454370] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-30T19:08:24.166258] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T19:08:24.254393] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-30T19:08:25.054382] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-30T19:08:25.377990] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T19:08:25.800060] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:08:25.854403] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-30T19:08:26.103174] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T19:08:26.106865] [INFO ] [REMOTE ] HCI: Full fetch complete (19418 records). [2025-09-30T19:08:26.106950] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-30T19:08:26.497677] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-30T19:08:26.497767] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-30T19:08:26.498194] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-30T19:08:26.498264] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-30T19:08:26.499014] [DEBUG] [LOCAL ] HCI: Trimmed 19418 records to 13987 (keeping 200 days of data) [2025-09-30T19:08:26.588888] [DEBUG] [LOCAL ] HCI: Primary data saved (13987 records). [2025-09-30T19:08:26.589030] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-30T19:08:26.589128] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCI took 21.9s. Estimated remaining: 2h 55m 24s. Rate: 7.8 symbols/min [2025-09-30T19:08:26.659564] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-30T19:08:26.775812] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:26.830250] [DEBUG] [LOCAL ] HE: Loaded 49059 existing records from primary storage. [2025-09-30T19:08:26.830605] [INFO ] [MAIN ] HE: Loaded 49059 existing records. [2025-09-30T19:08:27.021374] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:27.021594] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-30T19:08:27.021680] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-30T19:08:27.022195] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-30T19:08:27.022254] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-30T19:08:27.432002] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:27.454373] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-30T19:08:27.967205] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-30T19:08:28.254343] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-30T19:08:28.460716] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T19:08:29.054374] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-30T19:08:29.115029] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T19:08:29.854372] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-30T19:08:30.393945] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-30T19:08:30.654345] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-30T19:08:30.748492] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:08:31.454338] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-30T19:08:31.546440] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T19:08:32.156334] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:08:32.254404] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-30T19:08:32.975529] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T19:08:33.054392] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-30T19:08:33.854370] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-30T19:08:34.045380] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T19:08:34.654353] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-30T19:08:34.906703] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T19:08:35.454347] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-30T19:08:35.598845] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T19:08:36.254345] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-30T19:08:36.455538] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T19:08:37.054357] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-30T19:08:37.173978] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T19:08:37.854361] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-30T19:08:37.973184] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T19:08:38.654373] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-30T19:08:39.099271] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T19:08:39.431212] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T19:08:39.444920] [INFO ] [REMOTE ] HDB: Full fetch complete (75250 records). [2025-09-30T19:08:39.445076] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-30T19:08:39.459461] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-30T19:08:39.868480] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-30T19:08:39.868565] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-30T19:08:39.869496] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-30T19:08:39.869567] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-30T19:08:39.871056] [DEBUG] [LOCAL ] HDB: Trimmed 75250 records to 51926 (keeping 200 days of data) [2025-09-30T19:08:40.228347] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-30T19:08:40.251263] [DEBUG] [LOCAL ] HDB: Primary data saved (51926 records). [2025-09-30T19:08:40.251411] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-30T19:08:40.251538] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HDB took 29.0s. Estimated remaining: 2h 55m 25s. Rate: 7.8 symbols/min [2025-09-30T19:08:40.256933] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-30T19:08:40.448687] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:40.486986] [DEBUG] [LOCAL ] HEI: Loaded 32223 existing records from primary storage. [2025-09-30T19:08:40.487281] [INFO ] [MAIN ] HEI: Loaded 32223 existing records. [2025-09-30T19:08:40.679382] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:40.679638] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-30T19:08:40.679724] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-30T19:08:40.680118] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-30T19:08:40.680178] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-30T19:08:41.058214] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-30T19:08:41.065916] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:41.306861] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-30T19:08:41.854364] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-30T19:08:42.121901] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T19:08:42.131972] [INFO ] [REMOTE ] HCC: Full fetch complete (64350 records). [2025-09-30T19:08:42.132169] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-30T19:08:42.577019] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-30T19:08:42.577109] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-30T19:08:42.578063] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-30T19:08:42.578167] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-30T19:08:42.579605] [DEBUG] [LOCAL ] HCC: Trimmed 64350 records to 45344 (keeping 200 days of data) [2025-09-30T19:08:42.675456] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-30T19:08:42.875078] [DEBUG] [LOCAL ] HCC: Primary data saved (45344 records). [2025-09-30T19:08:42.875222] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-30T19:08:42.875312] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HCC took 38.3s. Estimated remaining: 2h 55m 10s. Rate: 7.8 symbols/min [2025-09-30T19:08:43.069414] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:43.079045] [DEBUG] [LOCAL ] HEQ: Loaded 6221 existing records from primary storage. [2025-09-30T19:08:43.079245] [INFO ] [MAIN ] HEQ: Loaded 6221 existing records. [2025-09-30T19:08:43.271236] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:43.271736] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-30T19:08:43.271807] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-30T19:08:43.272149] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-30T19:08:43.272211] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-30T19:08:43.634963] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-30T19:08:43.717580] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:43.718432] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-30T19:08:43.719621] [INFO ] [REMOTE ] HD: Full fetch complete (77442 records). [2025-09-30T19:08:43.719988] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-30T19:08:43.832770] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T19:08:44.262820] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-30T19:08:44.259813] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-30T19:08:44.263447] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-30T19:08:44.265283] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-30T19:08:44.267437] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:08:44.268695] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-30T19:08:44.279326] [DEBUG] [LOCAL ] HD: Trimmed 77442 records to 53497 (keeping 200 days of data) [2025-09-30T19:08:44.381042] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T19:08:44.642624] [DEBUG] [LOCAL ] HD: Primary data saved (53497 records). [2025-09-30T19:08:44.642828] [INFO ] [MAIN ] HD: Full history saved. [2025-09-30T19:08:44.642943] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HD took 40.1s. Estimated remaining: 2h 54m 54s. Rate: 7.8 symbols/min [2025-09-30T19:08:44.815783] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:44.864169] [DEBUG] [LOCAL ] HESM: Loaded 48194 existing records from primary storage. [2025-09-30T19:08:44.864502] [INFO ] [MAIN ] HESM: Loaded 48194 existing records. [2025-09-30T19:08:45.058338] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-30T19:08:45.062765] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:08:45.063220] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-30T19:08:45.064227] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-30T19:08:45.064934] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-30T19:08:45.064995] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-30T19:08:45.466064] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:08:45.855816] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T19:08:45.854448] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-30T19:08:46.494693] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T19:08:46.659699] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-30T19:08:46.670559] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T19:08:47.272355] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T19:08:47.454379] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-30T19:08:48.254363] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-30T19:08:49.054372] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-30T19:08:49.145029] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:08:49.641064] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T19:08:49.708639] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T19:08:49.854364] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-30T19:08:50.366876] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-30T19:08:50.654378] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-30T19:08:51.240406] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T19:08:51.454392] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-30T19:08:52.119576] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T19:08:52.254363] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-30T19:08:53.054386] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-30T19:08:53.749510] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-30T19:08:53.854346] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-30T19:08:53.945520] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T19:08:54.190630] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-30T19:08:54.654360] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-30T19:08:55.454372] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-30T19:08:56.254341] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-30T19:08:56.435513] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T19:08:57.027281] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T19:08:57.054373] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-30T19:08:57.554489] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T19:08:57.854412] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-30T19:08:58.302136] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T19:08:58.647964] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-30T19:08:58.651293] [INFO ] [REMOTE ] HEQ: Full fetch complete (9217 records). [2025-09-30T19:08:58.651397] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-30T19:08:58.664492] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-30T19:08:59.061851] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-30T19:08:59.061955] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-30T19:08:59.062233] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-30T19:08:59.062320] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-30T19:08:59.062886] [DEBUG] [LOCAL ] HEQ: Trimmed 9217 records to 6231 (keeping 200 days of data) [2025-09-30T19:08:59.104215] [DEBUG] [LOCAL ] HEQ: Primary data saved (6231 records). [2025-09-30T19:08:59.104341] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-30T19:08:59.104438] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEQ took 16.2s. Estimated remaining: 2h 54m 56s. Rate: 7.8 symbols/min [2025-09-30T19:08:59.293120] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:08:59.293252] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-30T19:08:59.293309] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-30T19:08:59.293420] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-30T19:08:59.293462] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-30T19:08:59.293505] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-30T19:08:59.293557] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-30T19:08:59.459465] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-30T19:08:59.719168] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:00.254349] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-30T19:09:00.305414] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:09:01.054351] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-30T19:09:01.314530] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T19:09:01.841596] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T19:09:01.854325] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-30T19:09:02.655410] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T19:09:02.654611] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-30T19:09:02.999137] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-30T19:09:03.445319] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T19:09:03.455032] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-30T19:09:03.701501] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-30T19:09:04.254372] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-30T19:09:05.054390] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-30T19:09:05.854350] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-30T19:09:05.883912] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-30T19:09:06.654412] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-30T19:09:06.855683] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T19:09:06.873134] [INFO ] [REMOTE ] HE: Full fetch complete (72413 records). [2025-09-30T19:09:06.873397] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-30T19:09:07.456299] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-30T19:09:07.514870] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-30T19:09:07.515126] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-30T19:09:07.516455] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-30T19:09:07.516582] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-30T19:09:07.519165] [DEBUG] [LOCAL ] HE: Trimmed 72413 records to 49067 (keeping 200 days of data) [2025-09-30T19:09:07.660104] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T19:09:07.705169] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-30T19:09:07.796372] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-30T19:09:07.922984] [DEBUG] [LOCAL ] HE: Primary data saved (49067 records). [2025-09-30T19:09:07.923130] [INFO ] [MAIN ] HE: Full history saved. [2025-09-30T19:09:07.923869] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HE took 41.3s. Estimated remaining: 2h 54m 50s. Rate: 7.8 symbols/min [2025-09-30T19:09:08.105902] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:08.106070] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-30T19:09:08.106110] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-30T19:09:08.106261] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-30T19:09:08.106304] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-30T19:09:08.106346] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-30T19:09:08.106421] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-30T19:09:08.263750] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-30T19:09:08.506496] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:09.054368] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-30T19:09:09.292608] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-30T19:09:09.821276] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T19:09:09.854336] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-30T19:09:10.654368] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-30T19:09:11.452631] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T19:09:11.456392] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-30T19:09:11.710352] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-30T19:09:12.168932] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T19:09:12.254352] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-30T19:09:13.054360] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-30T19:09:13.854353] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-30T19:09:13.946633] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:09:14.092755] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-30T19:09:14.133479] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T19:09:14.139800] [INFO ] [REMOTE ] HEI: Full fetch complete (48825 records). [2025-09-30T19:09:14.139940] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-30T19:09:14.565225] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-30T19:09:14.565334] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-30T19:09:14.566150] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-30T19:09:14.566247] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-30T19:09:14.567348] [DEBUG] [LOCAL ] HEI: Trimmed 48825 records to 32152 (keeping 200 days of data) [2025-09-30T19:09:14.659880] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-30T19:09:14.781682] [DEBUG] [LOCAL ] HEI: Primary data saved (32152 records). [2025-09-30T19:09:14.781832] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-30T19:09:14.781926] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HEI took 34.5s. Estimated remaining: 2h 54m 41s. Rate: 7.8 symbols/min [2025-09-30T19:09:14.978595] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:15.003198] [DEBUG] [LOCAL ] HFRO: Loaded 17595 existing records from primary storage. [2025-09-30T19:09:15.003541] [INFO ] [MAIN ] HFRO: Loaded 17595 existing records. [2025-09-30T19:09:15.096422] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-30T19:09:15.214786] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:09:15.215040] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-30T19:09:15.215089] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-30T19:09:15.215389] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-30T19:09:15.215503] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-30T19:09:15.460505] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-30T19:09:15.593236] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:15.745605] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-30T19:09:16.254399] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-30T19:09:16.452615] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-30T19:09:17.054353] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-30T19:09:17.854373] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-30T19:09:18.654372] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-30T19:09:18.693286] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T19:09:18.984713] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-30T19:09:19.062892] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T19:09:19.454360] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-30T19:09:19.922165] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T19:09:20.254390] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-30T19:09:21.054337] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-30T19:09:21.415848] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-30T19:09:21.438737] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T19:09:21.854385] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-30T19:09:22.654408] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-30T19:09:22.876909] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-30T19:09:23.454372] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-30T19:09:23.765203] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T19:09:23.775951] [INFO ] [REMOTE ] HESM: Full fetch complete (69131 records). [2025-09-30T19:09:23.776118] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-30T19:09:23.867245] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-30T19:09:23.892531] [INFO ] [REMOTE ] HF: Full fetch complete (498 records). [2025-09-30T19:09:23.892747] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-30T19:09:24.271350] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-30T19:09:24.350039] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-09-30T19:09:24.357013] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:09:24.377785] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:09:24.400063] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-30T19:09:24.416486] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-30T19:09:24.434291] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-30T19:09:24.436733] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-30T19:09:24.440882] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HF took 25.3s. Estimated remaining: 2h 54m 36s. Rate: 7.8 symbols/min [2025-09-30T19:09:24.498009] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-30T19:09:24.535358] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-30T19:09:24.553638] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-30T19:09:24.574708] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-30T19:09:24.633565] [DEBUG] [LOCAL ] HESM: Trimmed 69131 records to 48247 (keeping 200 days of data) [2025-09-30T19:09:24.656537] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:24.770346] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-30T19:09:24.798006] [DEBUG] [LOCAL ] HGER: Loaded 13386 existing records from primary storage. [2025-09-30T19:09:24.800061] [INFO ] [MAIN ] HGER: Loaded 13386 existing records. [2025-09-30T19:09:25.062827] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:09:25.057556] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-30T19:09:25.073293] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-30T19:09:25.102426] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-30T19:09:25.106748] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-30T19:09:25.107163] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-30T19:09:25.480320] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-30T19:09:25.557914] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:25.636368] [DEBUG] [LOCAL ] HESM: Primary data saved (48247 records). [2025-09-30T19:09:25.636543] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-30T19:09:25.636696] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HESM took 41.0s. Estimated remaining: 2h 54m 20s. Rate: 7.8 symbols/min [2025-09-30T19:09:25.826787] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:25.837614] [DEBUG] [LOCAL ] HGLB: Loaded 9393 existing records from primary storage. [2025-09-30T19:09:25.837856] [INFO ] [MAIN ] HGLB: Loaded 9393 existing records. [2025-09-30T19:09:25.861595] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-30T19:09:26.034249] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:09:26.034483] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-30T19:09:26.034532] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-30T19:09:26.034763] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-30T19:09:26.034825] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-30T19:09:26.415772] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:26.654344] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-30T19:09:26.915189] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T19:09:27.397902] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T19:09:27.454316] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-30T19:09:28.140720] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T19:09:28.254355] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-30T19:09:29.054400] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-30T19:09:29.549079] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-30T19:09:29.807572] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-30T19:09:29.854314] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-30T19:09:30.408016] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-30T19:09:30.654380] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-30T19:09:30.977668] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-30T19:09:31.454375] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-30T19:09:32.200252] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T19:09:32.254434] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-30T19:09:32.850858] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-30T19:09:33.054376] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-30T19:09:33.833009] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T19:09:33.854319] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-30T19:09:34.654409] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-30T19:09:34.676239] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-30T19:09:35.454386] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-30T19:09:35.694086] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-30T19:09:35.861360] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-30T19:09:36.254424] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-30T19:09:36.728378] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-30T19:09:37.054410] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-30T19:09:37.389340] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-30T19:09:37.854401] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-30T19:09:38.648364] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T19:09:38.654319] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-30T19:09:39.157670] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-30T19:09:39.159069] [INFO ] [REMOTE ] HFND: Full fetch complete (1797 records). [2025-09-30T19:09:39.159161] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-30T19:09:39.370126] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-30T19:09:39.370470] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:09:39.370545] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:09:39.370624] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-30T19:09:39.370740] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-30T19:09:39.370787] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-30T19:09:39.370845] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-30T19:09:39.370947] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HFND took 31.4s. Estimated remaining: 2h 54m 20s. Rate: 7.8 symbols/min [2025-09-30T19:09:39.459621] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-30T19:09:39.550513] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:39.570941] [DEBUG] [LOCAL ] HGTY: Loaded 13122 existing records from primary storage. [2025-09-30T19:09:39.571258] [INFO ] [MAIN ] HGTY: Loaded 13122 existing records. [2025-09-30T19:09:39.779290] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:09:39.779523] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-30T19:09:39.779573] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-30T19:09:39.779818] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-30T19:09:39.779878] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-30T19:09:40.192955] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:40.215880] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-30T19:09:40.254366] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-30T19:09:40.990196] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T19:09:41.054396] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-30T19:09:41.772684] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T19:09:41.854362] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-30T19:09:42.654367] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-30T19:09:42.710170] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T19:09:43.412802] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T19:09:43.454389] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-30T19:09:43.934791] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-30T19:09:44.254365] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-30T19:09:44.993273] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T19:09:45.054385] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-30T19:09:45.854328] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-30T19:09:46.019158] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T19:09:46.605894] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T19:09:46.654370] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-30T19:09:47.413273] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-30T19:09:47.454362] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-30T19:09:48.055005] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T19:09:48.254409] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-30T19:09:49.028807] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T19:09:49.054324] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-30T19:09:49.613907] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-30T19:09:49.854388] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-30T19:09:50.654331] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-30T19:09:50.678401] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T19:09:51.454406] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-30T19:09:51.620754] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-30T19:09:51.623586] [INFO ] [REMOTE ] HGLB: Full fetch complete (14540 records). [2025-09-30T19:09:51.623688] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-30T19:09:52.021755] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T19:09:52.031012] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-30T19:09:52.031935] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-30T19:09:52.034326] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-30T19:09:52.034764] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-30T19:09:52.035290] [DEBUG] [LOCAL ] HGLB: Trimmed 14540 records to 9473 (keeping 200 days of data) [2025-09-30T19:09:52.097163] [DEBUG] [LOCAL ] HGLB: Primary data saved (9473 records). [2025-09-30T19:09:52.097327] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-30T19:09:52.097429] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HGLB took 26.5s. Estimated remaining: 2h 54m 19s. Rate: 7.8 symbols/min [2025-09-30T19:09:52.254736] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-30T19:09:52.279976] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:52.325068] [DEBUG] [LOCAL ] HGV: Loaded 46645 existing records from primary storage. [2025-09-30T19:09:52.325385] [INFO ] [MAIN ] HGV: Loaded 46645 existing records. [2025-09-30T19:09:52.520517] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:09:52.520819] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-30T19:09:52.520878] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-30T19:09:52.521353] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-30T19:09:52.521419] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-30T19:09:52.933152] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:53.054337] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-30T19:09:53.114275] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T19:09:53.119124] [INFO ] [REMOTE ] HFRO: Full fetch complete (29074 records). [2025-09-30T19:09:53.119212] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-30T19:09:53.521827] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-30T19:09:53.521911] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-30T19:09:53.522503] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-30T19:09:53.522578] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-30T19:09:53.523389] [DEBUG] [LOCAL ] HFRO: Trimmed 29074 records to 17720 (keeping 200 days of data) [2025-09-30T19:09:53.636424] [DEBUG] [LOCAL ] HFRO: Primary data saved (17720 records). [2025-09-30T19:09:53.636606] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-30T19:09:53.636735] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HFRO took 38.9s. Estimated remaining: 2h 54m 3s. Rate: 7.8 symbols/min [2025-09-30T19:09:53.832827] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:09:53.854406] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-30T19:09:53.869065] [DEBUG] [LOCAL ] HHH: Loaded 32605 existing records from primary storage. [2025-09-30T19:09:53.869437] [INFO ] [MAIN ] HHH: Loaded 32605 existing records. [2025-09-30T19:09:54.086490] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:09:54.086759] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-30T19:09:54.086817] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-30T19:09:54.087073] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-30T19:09:54.087133] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-30T19:09:54.491458] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:09:54.520090] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T19:09:54.654382] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-30T19:09:54.663157] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T19:09:55.454388] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-30T19:09:55.735599] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T19:09:55.998396] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-30T19:09:56.254409] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-30T19:09:56.859181] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T19:09:57.054363] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-30T19:09:57.854373] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-30T19:09:58.193212] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T19:09:58.654411] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-30T19:09:58.866779] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T19:09:59.454442] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-30T19:09:59.619168] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T19:10:00.254389] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-30T19:10:00.712817] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T19:10:00.718297] [INFO ] [REMOTE ] HGTY: Full fetch complete (17272 records). [2025-09-30T19:10:00.718447] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-30T19:10:01.059415] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-30T19:10:01.146680] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-30T19:10:01.146912] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-30T19:10:01.147405] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-30T19:10:01.147488] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-30T19:10:01.148556] [DEBUG] [LOCAL ] HGTY: Trimmed 17272 records to 13203 (keeping 200 days of data) [2025-09-30T19:10:01.217786] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T19:10:01.245528] [DEBUG] [LOCAL ] HGTY: Primary data saved (13203 records). [2025-09-30T19:10:01.245746] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-30T19:10:01.245838] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGTY took 21.9s. Estimated remaining: 2h 53m 55s. Rate: 7.8 symbols/min [2025-09-30T19:10:01.427544] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:01.475101] [DEBUG] [LOCAL ] HI: Loaded 35198 existing records from primary storage. [2025-09-30T19:10:01.475445] [INFO ] [MAIN ] HI: Loaded 35198 existing records. [2025-09-30T19:10:01.718692] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:01.718985] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-30T19:10:01.719047] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-30T19:10:01.719376] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-30T19:10:01.719435] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-30T19:10:01.859548] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-30T19:10:02.142299] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:02.581433] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T19:10:02.654378] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-30T19:10:03.124481] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-30T19:10:03.129603] [INFO ] [REMOTE ] HGER: Full fetch complete (16680 records). [2025-09-30T19:10:03.129754] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-30T19:10:03.467482] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-30T19:10:03.519955] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-30T19:10:03.520043] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-30T19:10:03.520447] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-30T19:10:03.520489] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-30T19:10:03.521510] [DEBUG] [LOCAL ] HGER: Trimmed 16680 records to 13442 (keeping 200 days of data) [2025-09-30T19:10:03.614294] [DEBUG] [LOCAL ] HGER: Primary data saved (13442 records). [2025-09-30T19:10:03.614448] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-30T19:10:03.614542] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HGER took 39.2s. Estimated remaining: 2h 53m 41s. Rate: 7.8 symbols/min [2025-09-30T19:10:03.833638] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:03.907281] [DEBUG] [LOCAL ] HIG: Loaded 51212 existing records from primary storage. [2025-09-30T19:10:03.907678] [INFO ] [MAIN ] HIG: Loaded 51212 existing records. [2025-09-30T19:10:04.127367] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T19:10:04.168900] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:04.169673] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-30T19:10:04.169736] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-30T19:10:04.170431] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-30T19:10:04.170492] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-30T19:10:04.261846] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-30T19:10:04.611680] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:04.684033] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T19:10:05.054371] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-30T19:10:05.679335] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T19:10:05.854355] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-30T19:10:06.654365] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-30T19:10:06.855738] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T19:10:07.272274] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:10:07.454372] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-30T19:10:08.239421] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T19:10:08.254307] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-30T19:10:08.802200] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-30T19:10:09.054361] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-30T19:10:09.854350] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-30T19:10:09.907032] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T19:10:10.654359] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-30T19:10:11.251592] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T19:10:11.286084] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-30T19:10:11.454350] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-30T19:10:11.893307] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T19:10:12.254353] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-30T19:10:12.808200] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-30T19:10:13.054360] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-30T19:10:13.757986] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T19:10:13.854349] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-30T19:10:14.404559] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T19:10:14.654392] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-30T19:10:15.259554] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T19:10:15.454358] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-30T19:10:15.760430] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T19:10:16.254387] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-30T19:10:16.530743] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T19:10:17.054381] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-30T19:10:17.854340] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-30T19:10:18.032308] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-30T19:10:18.521798] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T19:10:18.654399] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-30T19:10:19.268359] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T19:10:19.454421] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-30T19:10:20.254356] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-30T19:10:20.589691] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-30T19:10:20.932114] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T19:10:21.054354] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-30T19:10:21.691615] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T19:10:21.854347] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-30T19:10:22.654428] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-30T19:10:22.743089] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:10:23.221314] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T19:10:23.454372] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-30T19:10:23.686637] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T19:10:23.693826] [INFO ] [REMOTE ] HHH: Full fetch complete (45395 records). [2025-09-30T19:10:23.693947] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-30T19:10:24.110075] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-30T19:10:24.110168] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-30T19:10:24.111042] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-30T19:10:24.111111] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-30T19:10:24.112232] [DEBUG] [LOCAL ] HHH: Trimmed 45395 records to 32605 (keeping 200 days of data) [2025-09-30T19:10:24.278974] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-30T19:10:24.332463] [DEBUG] [LOCAL ] HHH: Primary data saved (32605 records). [2025-09-30T19:10:24.332661] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-30T19:10:24.332884] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HHH took 30.7s. Estimated remaining: 2h 53m 50s. Rate: 7.8 symbols/min [2025-09-30T19:10:24.526214] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:24.575088] [DEBUG] [LOCAL ] HII: Loaded 34805 existing records from primary storage. [2025-09-30T19:10:24.575383] [INFO ] [MAIN ] HII: Loaded 34805 existing records. [2025-09-30T19:10:24.783924] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:24.784747] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-30T19:10:24.784929] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-30T19:10:24.785528] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-30T19:10:24.785599] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-30T19:10:24.957925] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T19:10:25.063234] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-30T19:10:25.229254] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:25.854407] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-30T19:10:25.912246] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T19:10:26.541814] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-30T19:10:26.654361] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-30T19:10:27.454353] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-30T19:10:27.501065] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T19:10:28.235581] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T19:10:28.245454] [INFO ] [REMOTE ] HGV: Full fetch complete (65815 records). [2025-09-30T19:10:28.245604] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-30T19:10:28.260307] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-30T19:10:28.670376] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-30T19:10:28.670503] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-30T19:10:28.671470] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-30T19:10:28.671538] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-30T19:10:28.674700] [DEBUG] [LOCAL ] HGV: Trimmed 65815 records to 46608 (keeping 200 days of data) [2025-09-30T19:10:28.934685] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:10:28.969720] [INFO ] [REMOTE ] HI: Full fetch complete (49925 records). [2025-09-30T19:10:28.978999] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-30T19:10:29.055801] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-30T19:10:29.092384] [DEBUG] [LOCAL ] HGV: Primary data saved (46608 records). [2025-09-30T19:10:29.106060] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-30T19:10:29.106712] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HGV took 37.0s. Estimated remaining: 2h 53m 39s. Rate: 7.8 symbols/min [2025-09-30T19:10:29.458730] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:29.669869] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-30T19:10:29.670038] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-30T19:10:29.670945] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-30T19:10:29.671104] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-30T19:10:29.674210] [DEBUG] [LOCAL ] HI: Trimmed 49925 records to 35264 (keeping 200 days of data) [2025-09-30T19:10:29.815926] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T19:10:29.863431] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-30T19:10:29.870711] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-30T19:10:29.873972] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-09-30T19:10:30.095370] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:30.147038] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-30T19:10:30.147423] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-30T19:10:30.167862] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-30T19:10:30.168701] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-30T19:10:30.324619] [DEBUG] [LOCAL ] HI: Primary data saved (35264 records). [2025-09-30T19:10:30.335416] [INFO ] [MAIN ] HI: Full history saved. [2025-09-30T19:10:30.340799] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HI took 29.1s. Estimated remaining: 2h 53m 22s. Rate: 7.8 symbols/min [2025-09-30T19:10:30.802837] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:30.838619] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:30.839510] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-30T19:10:30.881138] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:10:30.910610] [DEBUG] [LOCAL ] HIO: Loaded 23694 existing records from primary storage. [2025-09-30T19:10:30.910993] [INFO ] [MAIN ] HIO: Loaded 23694 existing records. [2025-09-30T19:10:31.105164] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:31.105392] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-30T19:10:31.105444] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-30T19:10:31.105834] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-30T19:10:31.105897] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-30T19:10:31.468900] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-30T19:10:31.508634] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:31.560776] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-30T19:10:32.254360] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-30T19:10:32.878338] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T19:10:33.054353] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-30T19:10:33.354684] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-30T19:10:33.641283] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:10:33.854352] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-30T19:10:34.217267] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T19:10:34.654382] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-30T19:10:35.405562] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-30T19:10:35.454338] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-30T19:10:36.254360] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-30T19:10:36.955444] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T19:10:37.031409] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-30T19:10:37.054402] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-30T19:10:37.508697] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-30T19:10:37.854364] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-30T19:10:38.654415] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-30T19:10:39.428884] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-30T19:10:39.454313] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-30T19:10:39.690342] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T19:10:39.774237] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-30T19:10:40.254385] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-30T19:10:41.054399] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-30T19:10:41.418418] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T19:10:41.854336] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-30T19:10:42.114872] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-30T19:10:42.478320] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-30T19:10:42.654371] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-30T19:10:42.725671] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T19:10:43.454423] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-30T19:10:44.103632] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T19:10:44.254421] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-30T19:10:45.054333] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-30T19:10:45.160618] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:10:45.854360] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-30T19:10:46.248271] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T19:10:46.255551] [INFO ] [REMOTE ] HII: Full fetch complete (53141 records). [2025-09-30T19:10:46.255710] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-30T19:10:46.659797] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-30T19:10:46.674147] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-30T19:10:46.674241] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-30T19:10:46.675109] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-30T19:10:46.675382] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-30T19:10:46.676601] [DEBUG] [LOCAL ] HII: Trimmed 53141 records to 34713 (keeping 200 days of data) [2025-09-30T19:10:46.915820] [DEBUG] [LOCAL ] HII: Primary data saved (34713 records). [2025-09-30T19:10:46.915971] [INFO ] [MAIN ] HII: Full history saved. [2025-09-30T19:10:46.916077] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HII took 22.6s. Estimated remaining: 2h 53m 26s. Rate: 7.8 symbols/min [2025-09-30T19:10:47.131013] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:47.180421] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-30T19:10:47.208571] [DEBUG] [LOCAL ] HIPO: Loaded 22166 existing records from primary storage. [2025-09-30T19:10:47.208884] [INFO ] [MAIN ] HIPO: Loaded 22166 existing records. [2025-09-30T19:10:47.400896] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:47.401232] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-30T19:10:47.401284] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-30T19:10:47.401568] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-30T19:10:47.401637] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-30T19:10:47.468071] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-30T19:10:47.807418] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:47.840139] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T19:10:47.852472] [INFO ] [REMOTE ] HIG: Full fetch complete (73243 records). [2025-09-30T19:10:47.852692] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-30T19:10:48.067377] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-30T19:10:48.259529] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-30T19:10:48.351353] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-30T19:10:48.351445] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-30T19:10:48.352756] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-30T19:10:48.352837] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-30T19:10:48.354365] [DEBUG] [LOCAL ] HIG: Trimmed 73243 records to 51228 (keeping 200 days of data) [2025-09-30T19:10:48.692830] [DEBUG] [LOCAL ] HIG: Primary data saved (51228 records). [2025-09-30T19:10:48.692980] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-30T19:10:48.693079] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIG took 45.1s. Estimated remaining: 2h 53m 11s. Rate: 7.8 symbols/min [2025-09-30T19:10:48.882484] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:10:48.928504] [DEBUG] [LOCAL ] HIW: Loaded 44565 existing records from primary storage. [2025-09-30T19:10:48.928982] [INFO ] [MAIN ] HIW: Loaded 44565 existing records. [2025-09-30T19:10:49.069234] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-30T19:10:49.123842] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:10:49.124238] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-30T19:10:49.124311] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-30T19:10:49.124714] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-30T19:10:49.124802] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-30T19:10:49.496937] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T19:10:49.591616] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:10:49.854326] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-30T19:10:49.894788] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T19:10:50.028008] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-30T19:10:50.654372] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-30T19:10:51.356877] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:10:51.454361] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-30T19:10:51.647136] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-30T19:10:52.254364] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-30T19:10:52.963182] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T19:10:52.984802] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T19:10:53.054408] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-30T19:10:53.854350] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-30T19:10:54.101990] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T19:10:54.654427] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-30T19:10:55.407060] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T19:10:55.454348] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-30T19:10:56.254411] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-30T19:10:57.059754] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-30T19:10:57.084974] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T19:10:57.227375] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T19:10:57.264132] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-30T19:10:57.854328] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-30T19:10:58.176203] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T19:10:58.654369] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-30T19:10:59.454395] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-30T19:10:59.855509] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T19:11:00.254337] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-30T19:11:00.634517] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-30T19:11:00.890235] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T19:11:01.027044] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T19:11:01.054337] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-30T19:11:01.854366] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-30T19:11:02.654353] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-30T19:11:02.732947] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T19:11:03.454395] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-30T19:11:03.593780] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T19:11:04.254374] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-30T19:11:04.660914] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-30T19:11:04.957952] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T19:11:05.013235] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T19:11:05.054382] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-30T19:11:05.854361] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-30T19:11:06.547567] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T19:11:06.654335] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-30T19:11:07.007412] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T19:11:07.454337] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-30T19:11:07.805442] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T19:11:08.254356] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-30T19:11:09.054119] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T19:11:09.057853] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-30T19:11:09.542340] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T19:11:09.547351] [INFO ] [REMOTE ] HIPO: Full fetch complete (31539 records). [2025-09-30T19:11:09.547495] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-30T19:11:09.859533] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-30T19:11:09.967369] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-30T19:11:09.967459] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-30T19:11:09.968132] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-30T19:11:09.968238] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-30T19:11:09.969192] [DEBUG] [LOCAL ] HIPO: Trimmed 31539 records to 22110 (keeping 200 days of data) [2025-09-30T19:11:10.105941] [DEBUG] [LOCAL ] HIPO: Primary data saved (22110 records). [2025-09-30T19:11:10.106076] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-30T19:11:10.106160] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIPO took 23.2s. Estimated remaining: 2h 53m 21s. Rate: 7.8 symbols/min [2025-09-30T19:11:10.284292] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:10.305776] [DEBUG] [LOCAL ] HIX: Loaded 20488 existing records from primary storage. [2025-09-30T19:11:10.306071] [INFO ] [MAIN ] HIX: Loaded 20488 existing records. [2025-09-30T19:11:10.547569] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:10.547861] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-30T19:11:10.547916] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-30T19:11:10.548099] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-30T19:11:10.548189] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-30T19:11:10.659433] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-30T19:11:10.939832] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:11.454328] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-30T19:11:11.548945] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T19:11:11.559048] [INFO ] [REMOTE ] HIW: Full fetch complete (64724 records). [2025-09-30T19:11:11.559209] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-30T19:11:11.982445] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-30T19:11:11.982890] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-30T19:11:11.984057] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-30T19:11:11.984301] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-30T19:11:11.997426] [DEBUG] [LOCAL ] HIW: Trimmed 64724 records to 44523 (keeping 200 days of data) [2025-09-30T19:11:12.019129] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-09-30T19:11:12.109941] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-09-30T19:11:12.143450] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:11:12.142732] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-30T19:11:12.170606] [INFO ] [REMOTE ] HIO: Full fetch complete (37094 records). [2025-09-30T19:11:12.187941] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-30T19:11:12.868969] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T19:11:12.900548] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-30T19:11:13.171117] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-30T19:11:13.202109] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-30T19:11:13.202803] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-30T19:11:13.202608] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-30T19:11:13.241873] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-30T19:11:13.243147] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-30T19:11:13.249015] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-30T19:11:13.251113] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-30T19:11:13.269374] [DEBUG] [LOCAL ] HIO: Trimmed 37094 records to 23693 (keeping 200 days of data) [2025-09-30T19:11:13.272524] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-09-30T19:11:13.644940] [DEBUG] [LOCAL ] HIW: Primary data saved (44523 records). [2025-09-30T19:11:13.651063] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-30T19:11:13.651605] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIW took 25.0s. Estimated remaining: 2h 53m 8s. Rate: 7.8 symbols/min [2025-09-30T19:11:13.884630] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:13.936801] [DEBUG] [LOCAL ] HKD: Loaded 18306 existing records from primary storage. [2025-09-30T19:11:13.943218] [INFO ] [MAIN ] HKD: Loaded 18306 existing records. [2025-09-30T19:11:13.947946] [DEBUG] [LOCAL ] HIO: Primary data saved (23693 records). [2025-09-30T19:11:14.001379] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-30T19:11:14.050533] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIO took 43.7s. Estimated remaining: 2h 52m 51s. Rate: 7.8 symbols/min [2025-09-30T19:11:14.204017] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T19:11:14.270470] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-30T19:11:14.371823] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:14.394200] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-30T19:11:14.419290] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-30T19:11:14.434917] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-30T19:11:14.452853] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-30T19:11:14.457066] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:14.582817] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-09-30T19:11:14.588959] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-30T19:11:14.605022] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIMS took 45.5s. Estimated remaining: 2h 52m 34s. Rate: 7.8 symbols/min [2025-09-30T19:11:15.065955] [DEBUG] [LOCAL ] HL: Loaded 53671 existing records from primary storage. [2025-09-30T19:11:15.108556] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:15.112264] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:15.112803] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-30T19:11:15.116195] [INFO ] [MAIN ] HL: Loaded 53671 existing records. [2025-09-30T19:11:15.349927] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:15.366041] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-30T19:11:15.367810] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-30T19:11:15.374633] [DEBUG] [LOCAL ] HLF: Loaded 48569 existing records from primary storage. [2025-09-30T19:11:15.374796] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-30T19:11:15.379137] [INFO ] [MAIN ] HLF: Loaded 48569 existing records. [2025-09-30T19:11:15.413944] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-30T19:11:15.428961] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T19:11:15.523394] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-30T19:11:15.738443] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:15.767439] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-30T19:11:15.774432] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-30T19:11:15.849329] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-30T19:11:15.863318] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-30T19:11:16.212923] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:16.267301] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-30T19:11:16.462500] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:16.471072] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-30T19:11:16.473712] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T19:11:16.696122] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-30T19:11:17.054400] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-30T19:11:17.854399] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-30T19:11:17.954004] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T19:11:18.243100] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T19:11:18.287547] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T19:11:18.654353] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-30T19:11:19.049112] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T19:11:19.454402] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-30T19:11:20.052324] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T19:11:20.254409] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-30T19:11:20.474759] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T19:11:21.054383] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-30T19:11:21.854380] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-30T19:11:21.991616] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T19:11:22.253349] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T19:11:22.654419] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-30T19:11:23.104204] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T19:11:23.454367] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-30T19:11:24.254335] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-30T19:11:24.295715] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T19:11:25.054343] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-30T19:11:25.392236] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-30T19:11:25.431680] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T19:11:25.854370] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-30T19:11:26.173905] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-30T19:11:26.654357] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-30T19:11:26.835824] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T19:11:27.454387] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-30T19:11:28.254374] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-30T19:11:28.381130] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T19:11:28.603682] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T19:11:29.054339] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-30T19:11:29.114498] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-30T19:11:29.854398] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-30T19:11:30.624259] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T19:11:30.654347] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-30T19:11:30.912102] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T19:11:31.454421] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-30T19:11:32.254390] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-30T19:11:32.320576] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T19:11:32.537836] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T19:11:32.542594] [INFO ] [REMOTE ] HIX: Full fetch complete (30697 records). [2025-09-30T19:11:32.542795] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-30T19:11:32.965177] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-30T19:11:32.965288] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-30T19:11:32.965999] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-30T19:11:32.966089] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-30T19:11:32.967111] [DEBUG] [LOCAL ] HIX: Trimmed 30697 records to 20593 (keeping 200 days of data) [2025-09-30T19:11:33.060785] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-30T19:11:33.113175] [DEBUG] [LOCAL ] HIX: Primary data saved (20593 records). [2025-09-30T19:11:33.113338] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-30T19:11:33.113438] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HIX took 23.0s. Estimated remaining: 2h 52m 40s. Rate: 7.8 symbols/min [2025-09-30T19:11:33.306888] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:33.343249] [DEBUG] [LOCAL ] HLI: Loaded 30942 existing records from primary storage. [2025-09-30T19:11:33.343542] [INFO ] [MAIN ] HLI: Loaded 30942 existing records. [2025-09-30T19:11:33.532461] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:33.532761] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-30T19:11:33.532852] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-30T19:11:33.533116] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-30T19:11:33.533194] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-30T19:11:33.857464] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-30T19:11:33.938121] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:34.089183] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T19:11:34.184534] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T19:11:34.654362] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-30T19:11:35.425091] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T19:11:35.454362] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-30T19:11:36.254412] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-30T19:11:36.570752] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T19:11:37.054393] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-30T19:11:37.213950] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T19:11:37.224843] [INFO ] [REMOTE ] HLF: Full fetch complete (71249 records). [2025-09-30T19:11:37.224999] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-30T19:11:37.453214] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T19:11:37.697618] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-30T19:11:37.697766] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-30T19:11:37.698760] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-30T19:11:37.698832] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-30T19:11:37.700326] [DEBUG] [LOCAL ] HLF: Trimmed 71249 records to 48536 (keeping 200 days of data) [2025-09-30T19:11:37.865481] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-30T19:11:37.997579] [DEBUG] [LOCAL ] HLF: Primary data saved (48536 records). [2025-09-30T19:11:37.997757] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-30T19:11:37.997863] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HLF took 23.4s. Estimated remaining: 2h 52m 29s. Rate: 7.8 symbols/min [2025-09-30T19:11:38.186981] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:38.216829] [DEBUG] [LOCAL ] HLIO: Loaded 27930 existing records from primary storage. [2025-09-30T19:11:38.217121] [INFO ] [MAIN ] HLIO: Loaded 27930 existing records. [2025-09-30T19:11:38.415333] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:38.415620] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-30T19:11:38.415706] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-30T19:11:38.416124] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-30T19:11:38.416184] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-30T19:11:38.659554] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-30T19:11:38.818075] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:38.996850] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-30T19:11:39.313850] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:11:39.454404] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-30T19:11:39.502000] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-30T19:11:40.254366] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-30T19:11:40.834116] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T19:11:41.054355] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-30T19:11:41.221706] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T19:11:41.759894] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-30T19:11:41.854380] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-30T19:11:42.654409] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-30T19:11:43.185270] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-30T19:11:43.191060] [INFO ] [REMOTE ] HKD: Full fetch complete (28523 records). [2025-09-30T19:11:43.191193] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-30T19:11:43.462504] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-30T19:11:43.604504] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-30T19:11:43.604581] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-30T19:11:43.605240] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-30T19:11:43.605304] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-30T19:11:43.606085] [DEBUG] [LOCAL ] HKD: Trimmed 28523 records to 18365 (keeping 200 days of data) [2025-09-30T19:11:43.727769] [DEBUG] [LOCAL ] HKD: Primary data saved (18365 records). [2025-09-30T19:11:43.728004] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-30T19:11:43.728164] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HKD took 30.1s. Estimated remaining: 2h 52m 19s. Rate: 7.8 symbols/min [2025-09-30T19:11:43.912749] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:11:43.955742] [DEBUG] [LOCAL ] HLLY: Loaded 33226 existing records from primary storage. [2025-09-30T19:11:43.956132] [INFO ] [MAIN ] HLLY: Loaded 33226 existing records. [2025-09-30T19:11:44.148333] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:11:44.148845] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-30T19:11:44.148969] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-30T19:11:44.157543] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-30T19:11:44.173049] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-30T19:11:44.175324] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T19:11:44.257330] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-30T19:11:44.572001] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:11:45.054383] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-30T19:11:45.659809] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-30T19:11:45.854345] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-30T19:11:45.933604] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:11:46.140151] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T19:11:46.654401] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-30T19:11:47.454332] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-30T19:11:47.641572] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T19:11:47.714209] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T19:11:48.254381] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-30T19:11:48.859239] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-30T19:11:49.054330] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-30T19:11:49.195387] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-30T19:11:49.854377] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-30T19:11:50.654339] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-30T19:11:50.944497] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T19:11:51.203501] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-30T19:11:51.335998] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T19:11:51.454395] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-30T19:11:52.254408] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-30T19:11:53.054383] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-30T19:11:53.324212] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T19:11:53.522266] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T19:11:53.854384] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-30T19:11:53.965781] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T19:11:54.654357] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-30T19:11:55.149560] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T19:11:55.454357] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-30T19:11:56.042755] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:11:56.254383] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-30T19:11:56.999739] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-30T19:11:57.054347] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-30T19:11:57.538511] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T19:11:57.854356] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-30T19:11:58.096374] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-30T19:11:58.654367] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-30T19:11:59.454339] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-30T19:11:59.933931] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-30T19:11:59.946085] [INFO ] [REMOTE ] HL: Full fetch complete (77655 records). [2025-09-30T19:11:59.946242] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-30T19:12:00.298314] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T19:12:00.276436] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-30T19:12:00.411193] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-30T19:12:00.411276] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-30T19:12:00.412308] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-30T19:12:00.412377] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-30T19:12:00.413904] [DEBUG] [LOCAL ] HL: Trimmed 77655 records to 53671 (keeping 200 days of data) [2025-09-30T19:12:00.763306] [DEBUG] [LOCAL ] HL: Primary data saved (53671 records). [2025-09-30T19:12:00.763461] [INFO ] [MAIN ] HL: Full history saved. [2025-09-30T19:12:00.764173] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HL took 46.7s. Estimated remaining: 2h 52m 23s. Rate: 7.8 symbols/min [2025-09-30T19:12:00.957547] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:01.025573] [DEBUG] [LOCAL ] HLN: Loaded 53085 existing records from primary storage. [2025-09-30T19:12:01.025937] [INFO ] [MAIN ] HLN: Loaded 53085 existing records. [2025-09-30T19:12:01.065476] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-30T19:12:01.243847] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:01.244258] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-30T19:12:01.244347] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-30T19:12:01.261178] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-30T19:12:01.263512] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-30T19:12:01.331710] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T19:12:01.697414] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:01.716807] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T19:12:01.854358] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-30T19:12:02.445469] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T19:12:02.654362] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-30T19:12:03.178821] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T19:12:03.186809] [INFO ] [REMOTE ] HLI: Full fetch complete (45369 records). [2025-09-30T19:12:03.186964] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-30T19:12:03.459528] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-30T19:12:03.644860] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-30T19:12:03.644961] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-30T19:12:03.645803] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-30T19:12:03.645872] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-30T19:12:03.647081] [DEBUG] [LOCAL ] HLI: Trimmed 45369 records to 30960 (keeping 200 days of data) [2025-09-30T19:12:03.944009] [DEBUG] [LOCAL ] HLI: Primary data saved (30960 records). [2025-09-30T19:12:03.944292] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-30T19:12:03.944432] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLI took 30.8s. Estimated remaining: 2h 52m 10s. Rate: 7.8 symbols/min [2025-09-30T19:12:04.256304] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-30T19:12:04.256208] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:04.316167] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:12:04.390184] [DEBUG] [LOCAL ] HLT: Loaded 50632 existing records from primary storage. [2025-09-30T19:12:04.390681] [INFO ] [MAIN ] HLT: Loaded 50632 existing records. [2025-09-30T19:12:04.697780] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:04.698636] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-30T19:12:04.698947] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-30T19:12:04.706343] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-30T19:12:04.718592] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-30T19:12:04.725631] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T19:12:05.056953] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-30T19:12:05.165070] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:05.367502] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T19:12:05.854375] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-30T19:12:06.654405] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-30T19:12:06.836723] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-30T19:12:07.455934] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-30T19:12:07.463173] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T19:12:07.574882] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T19:12:08.254364] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-30T19:12:08.703035] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:12:08.707846] [INFO ] [REMOTE ] HLIO: Full fetch complete (36212 records). [2025-09-30T19:12:08.707961] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-30T19:12:09.066819] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-30T19:12:09.122551] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-30T19:12:09.122688] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-30T19:12:09.123526] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-30T19:12:09.123596] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-30T19:12:09.126041] [DEBUG] [LOCAL ] HLIO: Trimmed 36212 records to 27935 (keeping 200 days of data) [2025-09-30T19:12:09.317395] [DEBUG] [LOCAL ] HLIO: Primary data saved (27935 records). [2025-09-30T19:12:09.322720] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-30T19:12:09.333712] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLIO took 31.3s. Estimated remaining: 2h 51m 59s. Rate: 7.8 symbols/min [2025-09-30T19:12:09.410036] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T19:12:09.543693] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:09.591446] [DEBUG] [LOCAL ] HLX: Loaded 47869 existing records from primary storage. [2025-09-30T19:12:09.591799] [INFO ] [MAIN ] HLX: Loaded 47869 existing records. [2025-09-30T19:12:09.786866] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:09.787134] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-30T19:12:09.787201] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-30T19:12:09.788257] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-30T19:12:09.788331] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-30T19:12:09.859505] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-30T19:12:10.223890] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:10.654393] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-30T19:12:10.883834] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T19:12:11.011123] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-30T19:12:11.019442] [INFO ] [REMOTE ] HLLY: Full fetch complete (46049 records). [2025-09-30T19:12:11.019622] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-30T19:12:11.416602] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-30T19:12:11.416720] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-30T19:12:11.417534] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-30T19:12:11.417598] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-30T19:12:11.418794] [DEBUG] [LOCAL ] HLLY: Trimmed 46049 records to 33120 (keeping 200 days of data) [2025-09-30T19:12:11.468800] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-30T19:12:11.614482] [DEBUG] [LOCAL ] HLLY: Primary data saved (33120 records). [2025-09-30T19:12:11.614666] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-30T19:12:11.614771] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLLY took 27.9s. Estimated remaining: 2h 51m 44s. Rate: 7.8 symbols/min [2025-09-30T19:12:11.792004] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:11.842947] [DEBUG] [LOCAL ] HMC: Loaded 46704 existing records from primary storage. [2025-09-30T19:12:11.843281] [INFO ] [MAIN ] HMC: Loaded 46704 existing records. [2025-09-30T19:12:12.044145] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:12.044489] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-30T19:12:12.044544] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-30T19:12:12.045633] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-30T19:12:12.045764] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-30T19:12:12.276969] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-30T19:12:12.385334] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T19:12:12.482800] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:13.054361] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-30T19:12:13.229299] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T19:12:13.854376] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-30T19:12:14.031449] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T19:12:14.654380] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-30T19:12:14.856556] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T19:12:15.416693] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T19:12:15.454387] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-30T19:12:16.254342] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-30T19:12:16.332389] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T19:12:17.054323] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-30T19:12:17.456486] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-30T19:12:17.854381] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-30T19:12:18.098091] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T19:12:18.654361] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-30T19:12:19.047402] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T19:12:19.127220] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T19:12:19.454379] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-30T19:12:20.254370] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-30T19:12:20.390677] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T19:12:21.061760] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-30T19:12:21.067250] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T19:12:21.854316] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-30T19:12:21.925965] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T19:12:22.654333] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-30T19:12:22.856566] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T19:12:23.310837] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T19:12:23.454365] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-30T19:12:24.254349] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-30T19:12:24.424078] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T19:12:25.054369] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-30T19:12:25.264100] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T19:12:25.723425] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T19:12:25.854374] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-30T19:12:26.488844] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T19:12:26.654387] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-30T19:12:27.454425] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-30T19:12:27.680024] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-30T19:12:28.254382] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-30T19:12:28.303854] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T19:12:28.990331] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T19:12:29.054362] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-30T19:12:29.595886] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T19:12:29.854366] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-30T19:12:30.367749] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T19:12:30.654368] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-30T19:12:31.454343] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-30T19:12:31.818667] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T19:12:31.831915] [INFO ] [REMOTE ] HLN: Full fetch complete (76778 records). [2025-09-30T19:12:31.832108] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-30T19:12:32.263737] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-30T19:12:32.267842] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-30T19:12:32.267945] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-30T19:12:32.269099] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-30T19:12:32.270196] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-30T19:12:32.272085] [DEBUG] [LOCAL ] HLN: Trimmed 76778 records to 53083 (keeping 200 days of data) [2025-09-30T19:12:32.429333] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T19:12:32.677498] [DEBUG] [LOCAL ] HLN: Primary data saved (53083 records). [2025-09-30T19:12:32.677683] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-30T19:12:32.678469] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLN took 31.9s. Estimated remaining: 2h 51m 54s. Rate: 7.8 symbols/min [2025-09-30T19:12:32.865550] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:32.890732] [DEBUG] [LOCAL ] HMN: Loaded 23360 existing records from primary storage. [2025-09-30T19:12:32.891072] [INFO ] [MAIN ] HMN: Loaded 23360 existing records. [2025-09-30T19:12:33.059955] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-30T19:12:33.096871] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:33.098616] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-30T19:12:33.098817] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-30T19:12:33.100824] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-30T19:12:33.100892] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-30T19:12:33.428506] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T19:12:33.566438] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:33.854342] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-30T19:12:34.056008] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T19:12:34.654399] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-30T19:12:34.858934] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-30T19:12:35.429117] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:12:35.439804] [INFO ] [REMOTE ] HLT: Full fetch complete (73418 records). [2025-09-30T19:12:35.439958] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-30T19:12:35.462159] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-30T19:12:35.803623] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T19:12:35.900222] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-30T19:12:35.900336] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-30T19:12:35.901351] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-30T19:12:35.901418] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-30T19:12:35.902934] [DEBUG] [LOCAL ] HLT: Trimmed 73418 records to 50626 (keeping 200 days of data) [2025-09-30T19:12:36.244665] [DEBUG] [LOCAL ] HLT: Primary data saved (50626 records). [2025-09-30T19:12:36.244835] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-30T19:12:36.244947] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLT took 32.3s. Estimated remaining: 2h 51m 41s. Rate: 7.8 symbols/min [2025-09-30T19:12:36.259503] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-30T19:12:36.428438] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:36.484304] [DEBUG] [LOCAL ] HMY: Loaded 53136 existing records from primary storage. [2025-09-30T19:12:36.484676] [INFO ] [MAIN ] HMY: Loaded 53136 existing records. [2025-09-30T19:12:36.669668] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:36.669927] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-30T19:12:36.670030] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-30T19:12:36.672178] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-30T19:12:36.672240] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-30T19:12:37.054911] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-30T19:12:37.054791] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:37.280329] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T19:12:37.290201] [INFO ] [REMOTE ] HLX: Full fetch complete (69198 records). [2025-09-30T19:12:37.290369] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-30T19:12:37.418913] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T19:12:37.742993] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-30T19:12:37.743086] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-30T19:12:37.743996] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-30T19:12:37.744079] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-30T19:12:37.745550] [DEBUG] [LOCAL ] HLX: Trimmed 69198 records to 47823 (keeping 200 days of data) [2025-09-30T19:12:37.854525] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-30T19:12:38.036801] [DEBUG] [LOCAL ] HLX: Primary data saved (47823 records). [2025-09-30T19:12:38.036944] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-30T19:12:38.037028] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HLX took 28.7s. Estimated remaining: 2h 51m 25s. Rate: 7.8 symbols/min [2025-09-30T19:12:38.224744] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:38.224951] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-30T19:12:38.224999] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-30T19:12:38.225111] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-30T19:12:38.225155] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-30T19:12:38.225198] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-30T19:12:38.225233] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-30T19:12:38.640560] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:38.654332] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-30T19:12:38.707222] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T19:12:38.866225] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T19:12:38.877669] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:12:38.877922] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-30T19:12:38.878014] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:12:38.878117] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-09-30T19:12:38.878216] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:12:38.878291] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-30T19:12:38.878356] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-30T19:12:38.878393] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-30T19:12:38.878455] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-30T19:12:38.878524] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HNGE took 0.8s. Estimated remaining: 2h 51m 9s. Rate: 7.8 symbols/min [2025-09-30T19:12:39.069929] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:39.101801] [DEBUG] [LOCAL ] HNI: Loaded 29037 existing records from primary storage. [2025-09-30T19:12:39.102086] [INFO ] [MAIN ] HNI: Loaded 29037 existing records. [2025-09-30T19:12:39.293900] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:39.294163] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-30T19:12:39.294213] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-30T19:12:39.296220] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-30T19:12:39.296285] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-30T19:12:39.459463] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-30T19:12:39.687164] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:40.254408] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-30T19:12:40.526456] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T19:12:41.054376] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-30T19:12:41.085060] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T19:12:41.854372] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-30T19:12:42.654378] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-30T19:12:42.944391] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-30T19:12:43.004134] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T19:12:43.454396] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-30T19:12:44.254330] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-30T19:12:44.291109] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T19:12:44.631378] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T19:12:45.054366] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-30T19:12:45.854399] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-30T19:12:45.987680] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T19:12:46.019512] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T19:12:46.654339] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-30T19:12:47.153364] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T19:12:47.454351] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-30T19:12:47.902886] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-30T19:12:48.254388] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-30T19:12:48.525040] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T19:12:49.054369] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-30T19:12:49.500623] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-30T19:12:49.854359] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-30T19:12:49.900115] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-30T19:12:50.654383] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-30T19:12:51.454426] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-30T19:12:51.642930] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T19:12:52.254341] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-30T19:12:52.422856] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-30T19:12:52.584763] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-30T19:12:53.054387] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-30T19:12:53.854335] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-30T19:12:53.894740] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T19:12:54.162117] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-30T19:12:54.654398] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-30T19:12:55.454338] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-30T19:12:55.665153] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T19:12:56.254371] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-30T19:12:56.361991] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T19:12:56.469541] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T19:12:56.481674] [INFO ] [REMOTE ] HMC: Full fetch complete (69483 records). [2025-09-30T19:12:56.481910] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-30T19:12:56.994501] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-30T19:12:56.994610] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-30T19:12:56.995782] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-30T19:12:56.995881] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-30T19:12:56.997544] [DEBUG] [LOCAL ] HMC: Trimmed 69483 records to 46717 (keeping 200 days of data) [2025-09-30T19:12:57.068024] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-30T19:12:57.447171] [DEBUG] [LOCAL ] HMC: Primary data saved (46717 records). [2025-09-30T19:12:57.447355] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-30T19:12:57.447577] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMC took 45.8s. Estimated remaining: 2h 51m 15s. Rate: 7.8 symbols/min [2025-09-30T19:12:57.675431] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:12:57.731340] [DEBUG] [LOCAL ] HOG: Loaded 51157 existing records from primary storage. [2025-09-30T19:12:57.731736] [INFO ] [MAIN ] HOG: Loaded 51157 existing records. [2025-09-30T19:12:57.858009] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-30T19:12:57.959387] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:12:57.960556] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-30T19:12:57.960702] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-30T19:12:57.962688] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-30T19:12:57.962770] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-30T19:12:58.358186] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T19:12:58.356505] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:12:58.453433] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-30T19:12:58.654384] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-30T19:12:59.014011] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T19:12:59.021173] [INFO ] [REMOTE ] HMN: Full fetch complete (31606 records). [2025-09-30T19:12:59.021367] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-30T19:12:59.439905] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-30T19:12:59.439982] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-30T19:12:59.440579] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-30T19:12:59.440661] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-30T19:12:59.441501] [DEBUG] [LOCAL ] HMN: Trimmed 31606 records to 23372 (keeping 200 days of data) [2025-09-30T19:12:59.496982] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-30T19:12:59.595750] [DEBUG] [LOCAL ] HMN: Primary data saved (23372 records). [2025-09-30T19:12:59.595919] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-30T19:12:59.596072] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HMN took 26.9s. Estimated remaining: 2h 51m 0s. Rate: 7.8 symbols/min [2025-09-30T19:13:00.254335] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-30T19:13:00.302241] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T19:13:01.054362] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-30T19:13:01.260443] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T19:13:01.861379] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-30T19:13:01.882470] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T19:13:02.504707] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:13:02.654365] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-30T19:13:03.454378] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-30T19:13:03.944287] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-30T19:13:04.048095] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T19:13:04.254363] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-30T19:13:04.950404] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-30T19:13:04.959396] [INFO ] [REMOTE ] HNI: Full fetch complete (41677 records). [2025-09-30T19:13:04.959515] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-30T19:13:05.059468] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-30T19:13:05.380196] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-30T19:13:05.380326] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-30T19:13:05.381131] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-30T19:13:05.381208] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-30T19:13:05.382191] [DEBUG] [LOCAL ] HNI: Trimmed 41677 records to 29190 (keeping 200 days of data) [2025-09-30T19:13:05.574437] [DEBUG] [LOCAL ] HNI: Primary data saved (29190 records). [2025-09-30T19:13:05.574563] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-30T19:13:05.574691] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HNI took 26.7s. Estimated remaining: 2h 50m 50s. Rate: 7.8 symbols/min [2025-09-30T19:13:06.076306] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T19:13:06.087716] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-30T19:13:06.699072] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T19:13:06.711043] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-30T19:13:07.951688] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T19:13:07.963631] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-30T19:13:08.710571] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T19:13:08.726305] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-30T19:13:09.749123] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T19:13:09.761173] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-30T19:13:10.929769] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T19:13:10.941593] [INFO ] [REMOTE ] HMY: Full fetch complete (76690 records). [2025-09-30T19:13:10.941812] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-30T19:13:11.400456] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-30T19:13:11.400592] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-30T19:13:11.401771] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-30T19:13:11.401867] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-30T19:13:11.413632] [DEBUG] [LOCAL ] HMY: Trimmed 76690 records to 53136 (keeping 200 days of data) [2025-09-30T19:13:11.433030] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T19:13:11.443805] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-30T19:13:11.790518] [DEBUG] [LOCAL ] HMY: Primary data saved (53136 records). [2025-09-30T19:13:11.790742] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-30T19:13:11.790910] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HMY took 35.5s. Estimated remaining: 2h 50m 41s. Rate: 7.8 symbols/min [2025-09-30T19:13:13.404784] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T19:13:13.416368] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-30T19:13:15.186547] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T19:13:15.198830] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-30T19:13:17.089317] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T19:13:17.100572] [INFO ] [REMOTE ] HOG: Full fetch complete (74210 records). [2025-09-30T19:13:17.100820] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-30T19:13:17.516965] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-30T19:13:17.517078] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-30T19:13:17.518604] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-30T19:13:17.518703] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-30T19:13:17.520428] [DEBUG] [LOCAL ] HOG: Trimmed 74210 records to 51137 (keeping 200 days of data) [2025-09-30T19:13:17.858183] [DEBUG] [LOCAL ] HOG: Primary data saved (51137 records). [2025-09-30T19:13:17.858353] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-30T19:13:17.858477] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HOG took 20.4s. Estimated remaining: 2h 50m 31s. Rate: 7.8 symbols/min [2025-09-30T19:13:18.559800] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:18.563746] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:18.571724] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:18.700982] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:18.714942] [DEBUG] [LOCAL ] HOV: Loaded 13801 existing records from primary storage. [2025-09-30T19:13:18.715346] [INFO ] [MAIN ] HOV: Loaded 13801 existing records. [2025-09-30T19:13:18.888296] [DEBUG] [LOCAL ] HOMB: Loaded 43516 existing records from primary storage. [2025-09-30T19:13:18.913215] [INFO ] [MAIN ] HOMB: Loaded 43516 existing records. [2025-09-30T19:13:19.028126] [DEBUG] [LOCAL ] HOUS: Loaded 44315 existing records from primary storage. [2025-09-30T19:13:19.056743] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:19.062508] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-30T19:13:19.073227] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-30T19:13:19.073698] [INFO ] [MAIN ] HOUS: Loaded 44315 existing records. [2025-09-30T19:13:19.079331] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-30T19:13:19.185401] [DEBUG] [LOCAL ] HP: Loaded 51572 existing records from primary storage. [2025-09-30T19:13:19.155113] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-30T19:13:19.263164] [INFO ] [MAIN ] HP: Loaded 51572 existing records. [2025-09-30T19:13:19.487818] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:19.593772] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-30T19:13:19.671863] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-30T19:13:19.721347] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-30T19:13:19.762014] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-30T19:13:19.725631] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:19.917852] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:19.964183] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-30T19:13:19.893865] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-30T19:13:19.985856] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-30T19:13:19.968367] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-30T19:13:20.038898] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-30T19:13:20.033722] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-30T19:13:20.059777] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-30T19:13:20.096864] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-30T19:13:20.683789] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:20.793443] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-30T19:13:21.067835] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:21.122820] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-30T19:13:21.319888] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:21.341351] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-30T19:13:21.341086] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:21.341633] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-30T19:13:21.804299] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:13:21.808300] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-30T19:13:22.622927] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-30T19:13:22.626127] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-30T19:13:22.686009] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T19:13:22.695296] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-30T19:13:22.772685] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T19:13:22.784128] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-30T19:13:22.810156] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T19:13:22.819877] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-30T19:13:23.139431] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-30T19:13:23.142273] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-30T19:13:24.024299] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T19:13:24.027808] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-30T19:13:24.090349] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T19:13:24.121432] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T19:13:24.120069] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-30T19:13:24.131576] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-30T19:13:24.364622] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:13:24.375386] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-30T19:13:24.948356] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-30T19:13:24.951741] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-30T19:13:25.601730] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T19:13:25.612002] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-30T19:13:25.638806] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T19:13:25.647794] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-30T19:13:25.703783] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T19:13:25.753212] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T19:13:25.854346] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-30T19:13:26.654344] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-30T19:13:26.703312] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T19:13:27.081106] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T19:13:27.309305] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T19:13:27.454374] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-30T19:13:28.254376] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-30T19:13:28.311536] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-30T19:13:28.511980] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T19:13:29.054373] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-30T19:13:29.278980] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-30T19:13:29.854396] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-30T19:13:30.541230] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T19:13:30.654386] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-30T19:13:31.454375] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-30T19:13:31.525970] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T19:13:32.096387] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T19:13:32.135400] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-30T19:13:32.254409] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-30T19:13:33.054369] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-30T19:13:33.854355] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-30T19:13:34.005934] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T19:13:34.050977] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T19:13:34.054581] [INFO ] [REMOTE ] HOV: Full fetch complete (19377 records). [2025-09-30T19:13:34.054723] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-30T19:13:34.432028] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-30T19:13:34.432119] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-30T19:13:34.432594] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-30T19:13:34.432680] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-30T19:13:34.433285] [DEBUG] [LOCAL ] HOV: Trimmed 19377 records to 13796 (keeping 200 days of data) [2025-09-30T19:13:34.524606] [DEBUG] [LOCAL ] HOV: Primary data saved (13796 records). [2025-09-30T19:13:34.524777] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-30T19:13:34.524888] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 16.7s. Estimated remaining: 2h 50m 35s. Rate: 7.8 symbols/min [2025-09-30T19:13:34.669896] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-30T19:13:34.706737] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:34.762847] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-30T19:13:34.763221] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-09-30T19:13:34.948896] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:34.949149] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-30T19:13:34.949196] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-30T19:13:34.949791] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-30T19:13:34.949896] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-30T19:13:35.330779] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:35.454363] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-30T19:13:35.600868] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-30T19:13:36.125035] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T19:13:36.254374] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-30T19:13:37.059503] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-30T19:13:37.074385] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T19:13:37.841893] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:13:37.854316] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-30T19:13:38.654325] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-30T19:13:39.121990] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-30T19:13:39.164863] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T19:13:39.454367] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-30T19:13:40.240663] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T19:13:40.254314] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-30T19:13:41.054350] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-30T19:13:41.336683] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T19:13:41.854356] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-30T19:13:42.036932] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T19:13:42.047743] [INFO ] [REMOTE ] HOUS: Full fetch complete (63288 records). [2025-09-30T19:13:42.047945] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-30T19:13:42.466229] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-30T19:13:42.466337] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-30T19:13:42.467532] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-30T19:13:42.467618] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-30T19:13:42.469406] [DEBUG] [LOCAL ] HOUS: Trimmed 63288 records to 44419 (keeping 200 days of data) [2025-09-30T19:13:42.564211] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-30T19:13:42.679222] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-30T19:13:42.782059] [DEBUG] [LOCAL ] HOUS: Primary data saved (44419 records). [2025-09-30T19:13:42.782211] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-30T19:13:42.784004] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOUS took 24.9s. Estimated remaining: 2h 50m 28s. Rate: 7.8 symbols/min [2025-09-30T19:13:42.965195] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:42.976301] [DEBUG] [LOCAL ] HPF: Loaded 7335 existing records from primary storage. [2025-09-30T19:13:42.976516] [INFO ] [MAIN ] HPF: Loaded 7335 existing records. [2025-09-30T19:13:43.165374] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:43.165565] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-30T19:13:43.165612] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-30T19:13:43.165935] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-30T19:13:43.165994] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-30T19:13:43.459037] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-30T19:13:43.559114] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:43.627858] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T19:13:44.254323] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-30T19:13:44.523869] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T19:13:44.607833] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-30T19:13:45.054386] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-30T19:13:45.854350] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-30T19:13:46.397184] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-30T19:13:46.416530] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-30T19:13:46.654349] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-30T19:13:46.739762] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T19:13:46.749572] [INFO ] [REMOTE ] HOMB: Full fetch complete (63935 records). [2025-09-30T19:13:46.749752] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-30T19:13:47.170108] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-30T19:13:47.170197] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-30T19:13:47.171128] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-30T19:13:47.171194] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-30T19:13:47.172666] [DEBUG] [LOCAL ] HOMB: Trimmed 63935 records to 43513 (keeping 200 days of data) [2025-09-30T19:13:47.428341] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T19:13:47.454569] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-30T19:13:47.486741] [DEBUG] [LOCAL ] HOMB: Primary data saved (43513 records). [2025-09-30T19:13:47.486863] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-30T19:13:47.488351] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HOMB took 29.6s. Estimated remaining: 2h 50m 16s. Rate: 7.8 symbols/min [2025-09-30T19:13:47.669588] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:13:47.690934] [DEBUG] [LOCAL ] HPI: Loaded 10210 existing records from primary storage. [2025-09-30T19:13:47.691174] [INFO ] [MAIN ] HPI: Loaded 10210 existing records. [2025-09-30T19:13:47.889740] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:13:47.890037] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-30T19:13:47.890091] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-30T19:13:47.890348] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-30T19:13:47.890412] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-30T19:13:48.202982] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T19:13:48.259052] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-30T19:13:48.287702] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:13:49.054384] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-30T19:13:49.665198] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T19:13:49.854442] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-30T19:13:50.011559] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T19:13:50.654404] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-30T19:13:51.290863] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T19:13:51.454360] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-30T19:13:51.970513] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-30T19:13:52.146607] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T19:13:52.254393] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-30T19:13:53.003954] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-30T19:13:53.054395] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-30T19:13:53.788107] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-30T19:13:53.854365] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-30T19:13:54.654375] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-30T19:13:55.082485] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-30T19:13:55.454373] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-30T19:13:55.973616] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-30T19:13:56.046719] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-30T19:13:56.254405] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-30T19:13:57.008302] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T19:13:57.054343] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-30T19:13:57.624838] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-30T19:13:57.854421] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-30T19:13:58.654372] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-30T19:13:59.387957] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T19:13:59.454410] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-30T19:13:59.671860] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T19:13:59.683545] [INFO ] [REMOTE ] HP: Full fetch complete (73949 records). [2025-09-30T19:13:59.683780] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-30T19:14:00.076234] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-30T19:14:00.136474] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-30T19:14:00.136567] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-30T19:14:00.137690] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-30T19:14:00.137764] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-30T19:14:00.139398] [DEBUG] [LOCAL ] HP: Trimmed 73949 records to 51593 (keeping 200 days of data) [2025-09-30T19:14:00.257082] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-30T19:14:00.475971] [DEBUG] [LOCAL ] HP: Primary data saved (51593 records). [2025-09-30T19:14:00.476133] [INFO ] [MAIN ] HP: Full history saved. [2025-09-30T19:14:00.476225] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HP took 42.6s. Estimated remaining: 2h 50m 15s. Rate: 7.8 symbols/min [2025-09-30T19:14:00.669668] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:00.729300] [DEBUG] [LOCAL ] HPP: Loaded 50872 existing records from primary storage. [2025-09-30T19:14:00.729675] [INFO ] [MAIN ] HPP: Loaded 50872 existing records. [2025-09-30T19:14:00.907397] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T19:14:00.951538] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:00.952101] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-30T19:14:00.952156] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-30T19:14:00.952554] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-30T19:14:00.952617] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-30T19:14:01.057580] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-30T19:14:01.352725] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:01.854341] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-30T19:14:02.008453] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T19:14:02.010976] [INFO ] [REMOTE ] HPF: Full fetch complete (10877 records). [2025-09-30T19:14:02.011052] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-30T19:14:02.438335] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-30T19:14:02.438430] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-30T19:14:02.438757] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-30T19:14:02.438822] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-30T19:14:02.439552] [DEBUG] [LOCAL ] HPF: Trimmed 10877 records to 7392 (keeping 200 days of data) [2025-09-30T19:14:02.489676] [DEBUG] [LOCAL ] HPF: Primary data saved (7392 records). [2025-09-30T19:14:02.489839] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-30T19:14:02.489931] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPF took 19.7s. Estimated remaining: 2h 50m 1s. Rate: 7.8 symbols/min [2025-09-30T19:14:02.656713] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-30T19:14:02.678877] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:02.734976] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-09-30T19:14:02.735327] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-09-30T19:14:02.930090] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:02.930333] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-30T19:14:02.930382] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-30T19:14:02.930825] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-30T19:14:02.930889] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-30T19:14:03.329780] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:03.454336] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-30T19:14:03.488391] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T19:14:03.571874] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-30T19:14:04.254380] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-30T19:14:05.032385] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T19:14:05.054326] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-30T19:14:05.407327] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-30T19:14:05.854350] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-30T19:14:06.654351] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-30T19:14:06.736110] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T19:14:06.943419] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T19:14:07.454384] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-30T19:14:08.256859] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-30T19:14:08.273565] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T19:14:08.275532] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T19:14:08.291718] [INFO ] [REMOTE ] HPI: Full fetch complete (13763 records). [2025-09-30T19:14:08.292527] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-30T19:14:08.792874] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-30T19:14:08.793012] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-30T19:14:08.793402] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-30T19:14:08.793593] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-30T19:14:08.794353] [DEBUG] [LOCAL ] HPI: Trimmed 13763 records to 10334 (keeping 200 days of data) [2025-09-30T19:14:08.861366] [DEBUG] [LOCAL ] HPI: Primary data saved (10334 records). [2025-09-30T19:14:08.861516] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-30T19:14:08.861609] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPI took 21.4s. Estimated remaining: 2h 49m 51s. Rate: 7.8 symbols/min [2025-09-30T19:14:09.051233] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:09.054316] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-30T19:14:09.064770] [DEBUG] [LOCAL ] HPS: Loaded 10187 existing records from primary storage. [2025-09-30T19:14:09.064979] [INFO ] [MAIN ] HPS: Loaded 10187 existing records. [2025-09-30T19:14:09.260151] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:09.260372] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-30T19:14:09.260423] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-30T19:14:09.260762] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-30T19:14:09.260823] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-30T19:14:09.670231] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:09.854334] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-30T19:14:10.283600] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-30T19:14:10.654338] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-30T19:14:10.858444] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T19:14:11.363046] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T19:14:11.454402] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-30T19:14:12.254407] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-30T19:14:12.423806] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T19:14:13.054407] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-30T19:14:13.241860] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:14:13.266286] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:14:13.854392] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-30T19:14:14.654400] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-30T19:14:15.260102] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-30T19:14:15.271591] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-09-30T19:14:15.271763] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-30T19:14:15.454608] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-30T19:14:15.455595] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-30T19:14:15.728214] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-30T19:14:15.762868] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-30T19:14:15.763125] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-30T19:14:15.764174] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-30T19:14:15.764263] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-30T19:14:15.766091] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-09-30T19:14:16.124327] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-09-30T19:14:16.124483] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-30T19:14:16.124567] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPE took 41.6s. Estimated remaining: 2h 49m 43s. Rate: 7.8 symbols/min [2025-09-30T19:14:16.266934] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-30T19:14:16.302711] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:16.332260] [DEBUG] [LOCAL ] HQH: Loaded 25061 existing records from primary storage. [2025-09-30T19:14:16.332540] [INFO ] [MAIN ] HQH: Loaded 25061 existing records. [2025-09-30T19:14:16.521881] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:16.522141] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-30T19:14:16.522206] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-30T19:14:16.522535] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-30T19:14:16.522595] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-30T19:14:16.904547] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:17.054367] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-30T19:14:17.477001] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-30T19:14:17.854140] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T19:14:17.863707] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-30T19:14:17.896859] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T19:14:18.654368] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-30T19:14:19.454374] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-30T19:14:19.468789] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-30T19:14:19.729704] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-30T19:14:20.254361] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-30T19:14:20.739691] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T19:14:20.862398] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T19:14:21.054338] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-30T19:14:21.856927] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-30T19:14:21.857972] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-30T19:14:22.654419] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-30T19:14:23.056421] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T19:14:23.454375] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-30T19:14:24.254343] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-30T19:14:24.311596] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T19:14:24.574338] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-30T19:14:24.731233] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-30T19:14:25.054373] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-30T19:14:25.854333] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-30T19:14:26.147071] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:14:26.654405] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-30T19:14:26.703973] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T19:14:27.394822] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-30T19:14:27.454357] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-30T19:14:28.254369] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-30T19:14:29.054344] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-30T19:14:29.427933] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T19:14:29.477185] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T19:14:29.854395] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-30T19:14:30.654382] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-30T19:14:30.701517] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T19:14:30.757460] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T19:14:30.760745] [INFO ] [REMOTE ] HPS: Full fetch complete (15243 records). [2025-09-30T19:14:30.760832] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-30T19:14:31.150432] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-30T19:14:31.150517] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-30T19:14:31.150919] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-30T19:14:31.150986] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-30T19:14:31.151726] [DEBUG] [LOCAL ] HPS: Trimmed 15243 records to 10167 (keeping 200 days of data) [2025-09-30T19:14:31.226000] [DEBUG] [LOCAL ] HPS: Primary data saved (10167 records). [2025-09-30T19:14:31.226187] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-30T19:14:31.226284] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPS took 22.4s. Estimated remaining: 2h 49m 45s. Rate: 7.8 symbols/min [2025-09-30T19:14:31.459537] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-30T19:14:31.491933] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:31.521691] [DEBUG] [LOCAL ] HQL: Loaded 15953 existing records from primary storage. [2025-09-30T19:14:31.522376] [INFO ] [MAIN ] HQL: Loaded 15953 existing records. [2025-09-30T19:14:31.710520] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:31.710876] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-30T19:14:31.710943] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-30T19:14:31.711240] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-30T19:14:31.711302] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-30T19:14:32.088802] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:32.254398] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-30T19:14:32.578557] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T19:14:32.908081] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T19:14:33.054351] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-30T19:14:33.457608] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T19:14:33.854375] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-30T19:14:34.654386] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-30T19:14:34.932147] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T19:14:34.996158] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T19:14:35.454387] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-30T19:14:36.254429] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-30T19:14:36.471468] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T19:14:36.886043] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T19:14:37.054368] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-30T19:14:37.212159] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T19:14:37.854374] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-30T19:14:38.144086] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:14:38.654372] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-30T19:14:38.886925] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T19:14:39.454404] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-30T19:14:40.254327] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-30T19:14:40.429975] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-30T19:14:40.611827] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T19:14:40.624018] [INFO ] [REMOTE ] HPQ: Full fetch complete (77668 records). [2025-09-30T19:14:40.624243] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-30T19:14:41.065902] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-30T19:14:41.061739] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-30T19:14:41.066044] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-30T19:14:41.068780] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-30T19:14:41.069030] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-30T19:14:41.072705] [DEBUG] [LOCAL ] HPQ: Trimmed 77668 records to 53668 (keeping 200 days of data) [2025-09-30T19:14:41.437299] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-09-30T19:14:41.437460] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-30T19:14:41.437620] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPQ took 38.9s. Estimated remaining: 2h 49m 40s. Rate: 7.8 symbols/min [2025-09-30T19:14:41.656962] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:41.739993] [DEBUG] [LOCAL ] HR: Loaded 51953 existing records from primary storage. [2025-09-30T19:14:41.740538] [INFO ] [MAIN ] HR: Loaded 51953 existing records. [2025-09-30T19:14:41.856423] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-30T19:14:42.146905] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:42.152938] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T19:14:42.153161] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-30T19:14:42.159979] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-30T19:14:42.161785] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-30T19:14:42.161904] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-30T19:14:42.193952] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T19:14:42.312622] [INFO ] [REMOTE ] HPP: Full fetch complete (73367 records). [2025-09-30T19:14:42.340189] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-30T19:14:42.664998] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-30T19:14:43.023242] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:43.154169] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-30T19:14:43.154324] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-30T19:14:43.172017] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T19:14:43.171304] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-30T19:14:43.178050] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-30T19:14:43.180028] [DEBUG] [LOCAL ] HPP: Trimmed 73367 records to 50907 (keeping 200 days of data) [2025-09-30T19:14:43.455461] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-30T19:14:43.493240] [DEBUG] [LOCAL ] HPP: Primary data saved (50907 records). [2025-09-30T19:14:43.493404] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-30T19:14:43.493562] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HPP took 43.0s. Estimated remaining: 2h 49m 25s. Rate: 7.8 symbols/min [2025-09-30T19:14:43.695167] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:43.696884] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T19:14:43.747255] [DEBUG] [LOCAL ] HRB: Loaded 48501 existing records from primary storage. [2025-09-30T19:14:43.747687] [INFO ] [MAIN ] HRB: Loaded 48501 existing records. [2025-09-30T19:14:43.934431] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:43.934701] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-30T19:14:43.934774] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-30T19:14:43.935172] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-30T19:14:43.935232] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-30T19:14:44.259494] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-30T19:14:44.330006] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:44.380081] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T19:14:44.385622] [INFO ] [REMOTE ] HQH: Full fetch complete (37450 records). [2025-09-30T19:14:44.385782] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-30T19:14:44.808572] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-30T19:14:44.808867] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-30T19:14:44.809577] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-30T19:14:44.809672] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-30T19:14:44.810761] [DEBUG] [LOCAL ] HQH: Trimmed 37450 records to 25151 (keeping 200 days of data) [2025-09-30T19:14:44.990318] [DEBUG] [LOCAL ] HQH: Primary data saved (25151 records). [2025-09-30T19:14:44.990551] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-30T19:14:44.990777] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HQH took 28.9s. Estimated remaining: 2h 49m 10s. Rate: 7.8 symbols/min [2025-09-30T19:14:45.059545] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-30T19:14:45.191564] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:14:45.233286] [DEBUG] [LOCAL ] HRI: Loaded 32840 existing records from primary storage. [2025-09-30T19:14:45.233609] [INFO ] [MAIN ] HRI: Loaded 32840 existing records. [2025-09-30T19:14:45.422592] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:14:45.422848] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-30T19:14:45.422897] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-30T19:14:45.423217] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-30T19:14:45.423276] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-30T19:14:45.803708] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:14:45.854333] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-30T19:14:46.270115] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-30T19:14:46.622403] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T19:14:46.654322] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-30T19:14:46.866853] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T19:14:47.454389] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-30T19:14:48.180395] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T19:14:48.254328] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-30T19:14:48.777522] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T19:14:49.054409] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-30T19:14:49.804096] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T19:14:49.854397] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-30T19:14:50.281756] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T19:14:50.654346] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-30T19:14:50.727510] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T19:14:51.454358] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-30T19:14:52.254369] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-30T19:14:52.532191] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T19:14:53.007422] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T19:14:53.054331] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-30T19:14:53.435563] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T19:14:53.854374] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-30T19:14:54.626045] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T19:14:54.654378] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-30T19:14:55.454377] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-30T19:14:55.640679] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T19:14:56.254411] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-30T19:14:56.560388] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T19:14:56.987411] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:14:57.054381] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-30T19:14:57.854348] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-30T19:14:57.947889] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:14:58.654423] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-30T19:14:58.696416] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:14:59.369593] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-30T19:14:59.427840] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T19:14:59.454353] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-30T19:15:00.254434] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-30T19:15:01.054413] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-30T19:15:01.344423] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-30T19:15:01.854351] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-30T19:15:01.907601] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-30T19:15:02.105560] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T19:15:02.654408] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-30T19:15:03.343391] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T19:15:03.454364] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-30T19:15:03.784014] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-30T19:15:03.788400] [INFO ] [REMOTE ] HQL: Full fetch complete (24652 records). [2025-09-30T19:15:03.788499] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-30T19:15:04.187009] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-30T19:15:04.187092] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-30T19:15:04.187670] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-30T19:15:04.187746] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-30T19:15:04.188480] [DEBUG] [LOCAL ] HQL: Trimmed 24652 records to 16097 (keeping 200 days of data) [2025-09-30T19:15:04.264590] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-30T19:15:04.301236] [DEBUG] [LOCAL ] HQL: Primary data saved (16097 records). [2025-09-30T19:15:04.301398] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-30T19:15:04.301555] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HQL took 33.1s. Estimated remaining: 2h 49m 17s. Rate: 7.8 symbols/min [2025-09-30T19:15:04.498948] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:04.559187] [DEBUG] [LOCAL ] HRL: Loaded 53074 existing records from primary storage. [2025-09-30T19:15:04.559584] [INFO ] [MAIN ] HRL: Loaded 53074 existing records. [2025-09-30T19:15:04.753562] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:04.753927] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-30T19:15:04.754008] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-30T19:15:04.754546] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-30T19:15:04.754606] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-30T19:15:05.056308] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-30T19:15:05.150452] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:05.182674] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T19:15:05.409513] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T19:15:05.854359] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-30T19:15:06.497813] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:15:06.654360] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-30T19:15:07.454342] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-30T19:15:07.569082] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T19:15:08.254371] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-30T19:15:08.323125] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T19:15:08.616307] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T19:15:09.054376] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-30T19:15:09.347030] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:15:09.854354] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-30T19:15:10.654369] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-30T19:15:10.933030] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T19:15:10.945057] [INFO ] [REMOTE ] HRB: Full fetch complete (69749 records). [2025-09-30T19:15:10.945225] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-30T19:15:11.291448] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T19:15:11.427148] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-30T19:15:11.427280] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-30T19:15:11.428402] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-30T19:15:11.428473] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-30T19:15:11.433171] [DEBUG] [LOCAL ] HRB: Trimmed 69749 records to 48466 (keeping 200 days of data) [2025-09-30T19:15:11.490100] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-30T19:15:11.755693] [DEBUG] [LOCAL ] HRB: Primary data saved (48466 records). [2025-09-30T19:15:11.755884] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-30T19:15:11.755992] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HRB took 28.3s. Estimated remaining: 2h 49m 9s. Rate: 7.8 symbols/min [2025-09-30T19:15:11.952109] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:11.988825] [DEBUG] [LOCAL ] HRTG: Loaded 33324 existing records from primary storage. [2025-09-30T19:15:11.989114] [INFO ] [MAIN ] HRTG: Loaded 33324 existing records. [2025-09-30T19:15:12.190942] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:12.191296] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-30T19:15:12.191353] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-30T19:15:12.191694] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-30T19:15:12.191760] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-30T19:15:12.259493] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-30T19:15:12.598394] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:12.630353] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-30T19:15:12.659812] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T19:15:12.666877] [INFO ] [REMOTE ] HRI: Full fetch complete (46186 records). [2025-09-30T19:15:12.666984] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-30T19:15:13.064267] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-30T19:15:13.082331] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-30T19:15:13.083365] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-30T19:15:13.084370] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-30T19:15:13.084455] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-30T19:15:13.085621] [DEBUG] [LOCAL ] HRI: Trimmed 46186 records to 32784 (keeping 200 days of data) [2025-09-30T19:15:13.298089] [DEBUG] [LOCAL ] HRI: Primary data saved (32784 records). [2025-09-30T19:15:13.298249] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-30T19:15:13.298340] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HRI took 28.3s. Estimated remaining: 2h 48m 53s. Rate: 7.8 symbols/min [2025-09-30T19:15:13.481540] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:13.533047] [DEBUG] [LOCAL ] HSBC: Loaded 51077 existing records from primary storage. [2025-09-30T19:15:13.533361] [INFO ] [MAIN ] HSBC: Loaded 51077 existing records. [2025-09-30T19:15:13.729899] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:13.730160] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-30T19:15:13.730235] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-30T19:15:13.730921] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-30T19:15:13.731002] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-30T19:15:13.859275] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-30T19:15:14.302148] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:14.332164] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T19:15:14.654346] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-30T19:15:14.755936] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T19:15:15.185792] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T19:15:15.454362] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-30T19:15:16.254344] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-30T19:15:16.620697] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T19:15:16.638211] [INFO ] [REMOTE ] HR: Full fetch complete (74834 records). [2025-09-30T19:15:16.638424] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-30T19:15:17.073278] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-30T19:15:17.073027] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-30T19:15:17.073780] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-30T19:15:17.076470] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-30T19:15:17.076722] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-30T19:15:17.078704] [DEBUG] [LOCAL ] HR: Trimmed 74834 records to 51939 (keeping 200 days of data) [2025-09-30T19:15:17.210032] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-30T19:15:17.264499] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T19:15:17.509239] [DEBUG] [LOCAL ] HR: Primary data saved (51939 records). [2025-09-30T19:15:17.509409] [INFO ] [MAIN ] HR: Full history saved. [2025-09-30T19:15:17.509517] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HR took 36.1s. Estimated remaining: 2h 48m 41s. Rate: 7.8 symbols/min [2025-09-30T19:15:17.694610] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:17.712306] [DEBUG] [LOCAL ] HSHP: Loaded 15287 existing records from primary storage. [2025-09-30T19:15:17.712568] [INFO ] [MAIN ] HSHP: Loaded 15287 existing records. [2025-09-30T19:15:17.870732] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-30T19:15:17.919885] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:17.920113] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-30T19:15:17.920163] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-30T19:15:17.920412] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-30T19:15:17.920469] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-30T19:15:18.327457] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:18.654371] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-30T19:15:18.812507] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T19:15:19.007581] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T19:15:19.454370] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-30T19:15:20.254379] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-30T19:15:20.763774] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T19:15:20.947689] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-30T19:15:21.054384] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-30T19:15:21.473236] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:15:21.854377] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-30T19:15:22.488333] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T19:15:22.654416] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-30T19:15:23.454364] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-30T19:15:23.670232] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T19:15:24.186418] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T19:15:24.254379] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-30T19:15:24.902033] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T19:15:24.962537] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-30T19:15:25.054397] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-30T19:15:25.787362] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T19:15:25.854378] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-30T19:15:26.654421] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-30T19:15:26.926146] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T19:15:27.454397] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-30T19:15:28.254415] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-30T19:15:28.308611] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T19:15:29.027041] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T19:15:29.054326] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-30T19:15:29.634958] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T19:15:29.854375] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-30T19:15:30.599841] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T19:15:30.654328] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-30T19:15:30.740007] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-30T19:15:31.454374] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-30T19:15:32.254424] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-30T19:15:32.559462] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-30T19:15:33.054434] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-30T19:15:33.282503] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T19:15:33.663879] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T19:15:33.854417] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-30T19:15:34.654437] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-30T19:15:34.867465] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T19:15:34.913762] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T19:15:35.454405] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-30T19:15:36.254349] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-30T19:15:36.348716] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:15:37.054454] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-30T19:15:37.242840] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T19:15:37.255581] [INFO ] [REMOTE ] HRL: Full fetch complete (76678 records). [2025-09-30T19:15:37.255866] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-30T19:15:37.690246] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-30T19:15:37.690542] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-30T19:15:37.691997] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-30T19:15:37.692153] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-30T19:15:37.694222] [DEBUG] [LOCAL ] HRL: Trimmed 76678 records to 53075 (keeping 200 days of data) [2025-09-30T19:15:37.827914] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:15:37.846320] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-30T19:15:37.846434] [INFO ] [REMOTE ] HRTG: Full fetch complete (42754 records). [2025-09-30T19:15:37.851905] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-30T19:15:37.866399] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-30T19:15:38.292026] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-30T19:15:38.292606] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-30T19:15:38.293830] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-30T19:15:38.294560] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-30T19:15:38.298338] [DEBUG] [LOCAL ] HRTG: Trimmed 42754 records to 33359 (keeping 200 days of data) [2025-09-30T19:15:38.673609] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-30T19:15:38.725771] [DEBUG] [LOCAL ] HRTG: Primary data saved (33359 records). [2025-09-30T19:15:38.727019] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-30T19:15:38.727156] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRTG took 27.0s. Estimated remaining: 2h 48m 50s. Rate: 7.8 symbols/min [2025-09-30T19:15:38.942840] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:38.939049] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T19:15:38.953378] [DEBUG] [LOCAL ] HRL: Primary data saved (53075 records). [2025-09-30T19:15:38.953480] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-30T19:15:38.954499] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HRL took 34.7s. Estimated remaining: 2h 48m 33s. Rate: 7.8 symbols/min [2025-09-30T19:15:39.151696] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:39.163157] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-30T19:15:39.163253] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-30T19:15:39.163406] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-30T19:15:39.163459] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-30T19:15:39.163557] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-30T19:15:39.163623] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-30T19:15:39.319012] [DEBUG] [LOCAL ] HSY: Loaded 50371 existing records from primary storage. [2025-09-30T19:15:39.344411] [INFO ] [MAIN ] HSY: Loaded 50371 existing records. [2025-09-30T19:15:39.484017] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-30T19:15:39.789925] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:39.804160] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:39.804332] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-30T19:15:39.804453] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-30T19:15:39.805189] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-30T19:15:39.805250] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-30T19:15:40.202769] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:40.254356] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-30T19:15:40.543569] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T19:15:40.601340] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T19:15:41.054376] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-30T19:15:41.673215] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:15:41.814417] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T19:15:41.854387] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-30T19:15:42.654395] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-30T19:15:42.851576] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:15:42.851983] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-30T19:15:42.852067] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:15:42.852113] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-09-30T19:15:42.852147] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:15:42.852185] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-30T19:15:42.852240] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-30T19:15:42.852275] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-30T19:15:42.852337] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-30T19:15:42.852406] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HTB took 3.9s. Estimated remaining: 2h 48m 21s. Rate: 7.8 symbols/min [2025-09-30T19:15:43.036461] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:43.058842] [DEBUG] [LOCAL ] HTD: Loaded 13657 existing records from primary storage. [2025-09-30T19:15:43.059157] [INFO ] [MAIN ] HTD: Loaded 13657 existing records. [2025-09-30T19:15:43.259367] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:43.259588] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-30T19:15:43.259668] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-30T19:15:43.259959] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-30T19:15:43.260023] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-30T19:15:43.462045] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-30T19:15:43.719891] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:43.758182] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T19:15:44.254406] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-30T19:15:45.054330] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-30T19:15:45.198979] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T19:15:45.854389] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-30T19:15:45.875962] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T19:15:46.109510] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T19:15:46.654424] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-30T19:15:47.454369] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-30T19:15:47.715039] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-30T19:15:47.753147] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-30T19:15:47.757530] [INFO ] [REMOTE ] HSHP: Full fetch complete (23470 records). [2025-09-30T19:15:47.757699] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-30T19:15:48.168450] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-30T19:15:48.168546] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-30T19:15:48.169166] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-30T19:15:48.169238] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-30T19:15:48.170863] [DEBUG] [LOCAL ] HSHP: Trimmed 23470 records to 15280 (keeping 200 days of data) [2025-09-30T19:15:48.254595] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-30T19:15:48.274306] [DEBUG] [LOCAL ] HSHP: Primary data saved (15280 records). [2025-09-30T19:15:48.274517] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-30T19:15:48.274614] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSHP took 30.8s. Estimated remaining: 2h 48m 10s. Rate: 7.8 symbols/min [2025-09-30T19:15:48.475373] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:48.475583] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-30T19:15:48.475665] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-30T19:15:48.475797] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-30T19:15:48.475842] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-30T19:15:48.475887] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-30T19:15:48.475922] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-30T19:15:48.903807] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:49.043896] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T19:15:49.054463] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-30T19:15:49.054818] [INFO ] [REMOTE ] HSBC: Full fetch complete (73694 records). [2025-09-30T19:15:49.055865] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-30T19:15:49.488210] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-30T19:15:49.488308] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-30T19:15:49.489378] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-30T19:15:49.489447] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-30T19:15:49.491018] [DEBUG] [LOCAL ] HSBC: Trimmed 73694 records to 51058 (keeping 200 days of data) [2025-09-30T19:15:49.821311] [DEBUG] [LOCAL ] HSBC: Primary data saved (51058 records). [2025-09-30T19:15:49.821482] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-30T19:15:49.821581] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HSBC took 36.5s. Estimated remaining: 2h 47m 55s. Rate: 7.8 symbols/min [2025-09-30T19:15:49.859588] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-30T19:15:50.024211] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:15:50.029502] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T19:15:50.065337] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-30T19:15:50.115082] [DEBUG] [LOCAL ] HTGC: Loaded 47424 existing records from primary storage. [2025-09-30T19:15:50.115478] [INFO ] [MAIN ] HTGC: Loaded 47424 existing records. [2025-09-30T19:15:50.298367] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-30T19:15:50.321128] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:15:50.321364] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-30T19:15:50.321427] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-30T19:15:50.321823] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-30T19:15:50.321884] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-30T19:15:50.659509] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-30T19:15:50.754297] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:15:51.125170] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-30T19:15:51.454363] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-30T19:15:51.785214] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-30T19:15:52.254435] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-30T19:15:53.049993] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T19:15:53.054309] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-30T19:15:53.836199] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T19:15:53.854369] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-30T19:15:54.654392] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-30T19:15:54.994596] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-30T19:15:55.329063] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T19:15:55.454394] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-30T19:15:55.876604] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-30T19:15:56.254368] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-30T19:15:56.562948] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-30T19:15:57.054343] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-30T19:15:57.368846] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-30T19:15:57.854367] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-30T19:15:58.654400] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-30T19:15:59.454348] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-30T19:15:59.645379] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-30T19:15:59.700754] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-30T19:16:00.247589] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T19:16:00.258274] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-30T19:16:00.536999] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-30T19:16:01.054372] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-30T19:16:01.854381] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-30T19:16:01.908920] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T19:16:02.654356] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-30T19:16:03.454357] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-30T19:16:03.546861] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:16:04.207353] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T19:16:04.254352] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-30T19:16:04.370607] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-30T19:16:04.695531] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-30T19:16:04.696294] [INFO ] [REMOTE ] HTFC: Full fetch complete (835 records). [2025-09-30T19:16:04.696365] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-30T19:16:04.896408] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-30T19:16:04.896593] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:16:04.896666] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:16:04.896745] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-30T19:16:04.896813] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-30T19:16:04.896852] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-30T19:16:04.896921] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-30T19:16:04.897005] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTFC took 16.6s. Estimated remaining: 2h 47m 57s. Rate: 7.8 symbols/min [2025-09-30T19:16:05.061889] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-30T19:16:05.083768] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:05.118836] [DEBUG] [LOCAL ] HTH: Loaded 32136 existing records from primary storage. [2025-09-30T19:16:05.119146] [INFO ] [MAIN ] HTH: Loaded 32136 existing records. [2025-09-30T19:16:05.318073] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:05.318316] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-30T19:16:05.318368] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-30T19:16:05.318762] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-30T19:16:05.318823] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-30T19:16:05.711039] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:05.854376] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-30T19:16:06.654340] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-30T19:16:06.809200] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T19:16:07.105042] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-30T19:16:07.454371] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-30T19:16:08.254348] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-30T19:16:08.297476] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T19:16:08.981570] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T19:16:09.054388] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-30T19:16:09.235165] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T19:16:09.854378] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-30T19:16:10.252241] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T19:16:10.654364] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-30T19:16:11.454370] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-30T19:16:11.687580] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T19:16:11.688400] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T19:16:12.254382] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-30T19:16:12.664161] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T19:16:13.054546] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-30T19:16:13.117809] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T19:16:13.854411] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-30T19:16:14.654326] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-30T19:16:14.823473] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T19:16:14.883183] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T19:16:14.887276] [INFO ] [REMOTE ] HTD: Full fetch complete (19053 records). [2025-09-30T19:16:14.887381] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-30T19:16:15.311875] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-30T19:16:15.311996] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-30T19:16:15.312471] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-30T19:16:15.312520] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-30T19:16:15.313369] [DEBUG] [LOCAL ] HTD: Trimmed 19053 records to 13765 (keeping 200 days of data) [2025-09-30T19:16:15.407303] [DEBUG] [LOCAL ] HTD: Primary data saved (13765 records). [2025-09-30T19:16:15.407491] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-30T19:16:15.407628] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HTD took 32.6s. Estimated remaining: 2h 47m 52s. Rate: 7.8 symbols/min [2025-09-30T19:16:15.459573] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-30T19:16:15.606312] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:15.626284] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T19:16:15.678583] [DEBUG] [LOCAL ] HUBB: Loaded 36843 existing records from primary storage. [2025-09-30T19:16:15.678954] [INFO ] [MAIN ] HUBB: Loaded 36843 existing records. [2025-09-30T19:16:15.875433] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:15.875681] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-30T19:16:15.875741] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-30T19:16:15.876120] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-30T19:16:15.876182] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-30T19:16:16.259574] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-30T19:16:16.262805] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:17.054401] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-30T19:16:17.514555] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-30T19:16:17.526636] [INFO ] [REMOTE ] HSY: Full fetch complete (73703 records). [2025-09-30T19:16:17.526850] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-30T19:16:17.804202] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:16:17.855930] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-30T19:16:18.046862] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-30T19:16:18.046949] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-30T19:16:18.048031] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-30T19:16:18.048097] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-30T19:16:18.049525] [DEBUG] [LOCAL ] HSY: Trimmed 73703 records to 50351 (keeping 200 days of data) [2025-09-30T19:16:18.386325] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T19:16:18.415063] [DEBUG] [LOCAL ] HSY: Primary data saved (50351 records). [2025-09-30T19:16:18.415221] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-30T19:16:18.415319] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HSY took 39.7s. Estimated remaining: 2h 47m 39s. Rate: 7.8 symbols/min [2025-09-30T19:16:18.609376] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:18.654348] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-30T19:16:18.656982] [DEBUG] [LOCAL ] HUBS: Loaded 39200 existing records from primary storage. [2025-09-30T19:16:18.657298] [INFO ] [MAIN ] HUBS: Loaded 39200 existing records. [2025-09-30T19:16:18.862675] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:18.863144] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-30T19:16:18.863210] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-30T19:16:18.863534] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-30T19:16:18.863593] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-30T19:16:19.254756] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:19.454374] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-30T19:16:19.733290] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T19:16:19.819099] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T19:16:20.254382] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-30T19:16:20.673507] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T19:16:21.054420] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-30T19:16:21.854408] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-30T19:16:21.999144] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T19:16:22.598413] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T19:16:22.654380] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-30T19:16:23.430282] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:16:23.454348] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-30T19:16:23.867931] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T19:16:24.254380] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-30T19:16:24.926158] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T19:16:25.054383] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-30T19:16:25.394899] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T19:16:25.854430] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-30T19:16:26.627521] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T19:16:26.654411] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-30T19:16:27.454380] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-30T19:16:27.511016] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T19:16:27.717854] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T19:16:28.254406] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-30T19:16:29.054362] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-30T19:16:29.168301] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:16:29.829108] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T19:16:29.854328] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-30T19:16:30.284218] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T19:16:30.654376] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-30T19:16:31.338618] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:16:31.348873] [INFO ] [REMOTE ] HTGC: Full fetch complete (68206 records). [2025-09-30T19:16:31.349134] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-30T19:16:31.462698] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-30T19:16:31.806928] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-30T19:16:31.807121] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-30T19:16:31.808064] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-30T19:16:31.808201] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-30T19:16:31.831699] [DEBUG] [LOCAL ] HTGC: Trimmed 68206 records to 47389 (keeping 200 days of data) [2025-09-30T19:16:31.831543] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T19:16:32.155344] [DEBUG] [LOCAL ] HTGC: Primary data saved (47389 records). [2025-09-30T19:16:32.155562] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-30T19:16:32.155834] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTGC took 42.3s. Estimated remaining: 2h 47m 39s. Rate: 7.8 symbols/min [2025-09-30T19:16:32.261158] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-30T19:16:32.359378] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:32.410124] [DEBUG] [LOCAL ] HUM: Loaded 48801 existing records from primary storage. [2025-09-30T19:16:32.410499] [INFO ] [MAIN ] HUM: Loaded 48801 existing records. [2025-09-30T19:16:32.616534] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:32.616938] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-30T19:16:32.617007] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-30T19:16:32.617295] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-30T19:16:32.617371] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-30T19:16:33.030762] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:33.033353] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T19:16:33.054389] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-30T19:16:33.575557] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T19:16:33.854344] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-30T19:16:34.341779] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T19:16:34.654364] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-30T19:16:35.291483] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T19:16:35.454372] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-30T19:16:36.254342] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-30T19:16:36.527932] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-30T19:16:36.971240] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T19:16:37.054414] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-30T19:16:37.442380] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-30T19:16:37.854411] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-30T19:16:38.468914] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-30T19:16:38.654392] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-30T19:16:39.277233] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T19:16:39.454368] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-30T19:16:40.254353] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-30T19:16:40.348810] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T19:16:40.984602] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T19:16:41.054363] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-30T19:16:41.797978] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T19:16:41.807039] [INFO ] [REMOTE ] HUBB: Full fetch complete (53719 records). [2025-09-30T19:16:41.807201] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-30T19:16:41.859509] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-30T19:16:42.227958] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-30T19:16:42.228058] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-30T19:16:42.229247] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-30T19:16:42.229337] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-30T19:16:42.230618] [DEBUG] [LOCAL ] HUBB: Trimmed 53719 records to 36727 (keeping 200 days of data) [2025-09-30T19:16:42.480709] [DEBUG] [LOCAL ] HUBB: Primary data saved (36727 records). [2025-09-30T19:16:42.481024] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-30T19:16:42.481149] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBB took 27.1s. Estimated remaining: 2h 47m 34s. Rate: 7.8 symbols/min [2025-09-30T19:16:42.666888] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-30T19:16:42.670675] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:42.703619] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T19:16:42.761525] [DEBUG] [LOCAL ] HUN: Loaded 53195 existing records from primary storage. [2025-09-30T19:16:42.761971] [INFO ] [MAIN ] HUN: Loaded 53195 existing records. [2025-09-30T19:16:42.970557] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:42.970867] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-30T19:16:42.970928] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-30T19:16:42.971281] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-30T19:16:42.971353] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-30T19:16:43.361096] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:43.454417] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-30T19:16:43.701232] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T19:16:44.082755] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T19:16:44.090998] [INFO ] [REMOTE ] HTH: Full fetch complete (46703 records). [2025-09-30T19:16:44.091206] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-30T19:16:44.259612] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-30T19:16:44.659706] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-30T19:16:44.659915] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-30T19:16:44.661051] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-30T19:16:44.661163] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-30T19:16:44.662833] [DEBUG] [LOCAL ] HTH: Trimmed 46703 records to 32188 (keeping 200 days of data) [2025-09-30T19:16:44.893661] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T19:16:44.919538] [DEBUG] [LOCAL ] HTH: Primary data saved (32188 records). [2025-09-30T19:16:44.913543] [INFO ] [REMOTE ] HUBS: Full fetch complete (55431 records). [2025-09-30T19:16:44.919901] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-30T19:16:44.920026] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-30T19:16:44.920443] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HTH took 40.0s. Estimated remaining: 2h 47m 20s. Rate: 7.8 symbols/min [2025-09-30T19:16:45.054776] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-30T19:16:45.304296] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:45.595903] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-30T19:16:45.608552] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-30T19:16:45.609613] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-30T19:16:45.609773] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-30T19:16:45.611130] [DEBUG] [LOCAL ] HUYA: Loaded 44246 existing records from primary storage. [2025-09-30T19:16:45.611675] [INFO ] [MAIN ] HUYA: Loaded 44246 existing records. [2025-09-30T19:16:45.711281] [DEBUG] [LOCAL ] HUBS: Trimmed 55431 records to 39238 (keeping 200 days of data) [2025-09-30T19:16:45.910140] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:45.915430] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-30T19:16:45.918594] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-30T19:16:45.920204] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-30T19:16:45.920538] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-30T19:16:46.472313] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:46.475724] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-30T19:16:46.523941] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-30T19:16:46.538124] [DEBUG] [LOCAL ] HUBS: Primary data saved (39238 records). [2025-09-30T19:16:46.538484] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-30T19:16:46.538622] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUBS took 28.1s. Estimated remaining: 2h 47m 5s. Rate: 7.8 symbols/min [2025-09-30T19:16:46.660286] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-30T19:16:46.744120] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:16:46.779759] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-30T19:16:46.802709] [DEBUG] [LOCAL ] HVT: Loaded 15684 existing records from primary storage. [2025-09-30T19:16:46.802988] [INFO ] [MAIN ] HVT: Loaded 15684 existing records. [2025-09-30T19:16:46.996473] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:16:46.996814] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-30T19:16:46.996870] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-30T19:16:46.997198] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-30T19:16:46.997272] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-30T19:16:47.398699] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:16:47.454374] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-30T19:16:47.767620] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-30T19:16:48.264629] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-30T19:16:48.292573] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T19:16:49.054376] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-30T19:16:49.161594] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-30T19:16:49.483578] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:16:49.854389] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-30T19:16:50.418476] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T19:16:50.654365] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-30T19:16:50.951911] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-30T19:16:51.454382] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-30T19:16:52.254364] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-30T19:16:52.479500] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T19:16:52.918328] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T19:16:53.043896] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-30T19:16:53.054338] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-30T19:16:53.854360] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-30T19:16:54.654378] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-30T19:16:54.847821] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:16:55.273425] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T19:16:55.454405] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-30T19:16:56.247964] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-30T19:16:56.254297] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-30T19:16:56.445881] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T19:16:57.054341] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-30T19:16:57.282337] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T19:16:57.854352] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-30T19:16:58.654370] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-30T19:16:58.807536] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T19:16:59.457550] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-30T19:16:59.464430] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T19:16:59.476863] [INFO ] [REMOTE ] HUM: Full fetch complete (70970 records). [2025-09-30T19:16:59.477035] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-30T19:16:59.914965] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-30T19:16:59.915102] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-30T19:16:59.916218] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-30T19:16:59.916286] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-30T19:16:59.919743] [DEBUG] [LOCAL ] HUM: Trimmed 70970 records to 48794 (keeping 200 days of data) [2025-09-30T19:17:00.262837] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-30T19:17:00.287312] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T19:17:00.312555] [DEBUG] [LOCAL ] HUM: Primary data saved (48794 records). [2025-09-30T19:17:00.312741] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-30T19:17:00.312846] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUM took 28.2s. Estimated remaining: 2h 47m 5s. Rate: 7.8 symbols/min [2025-09-30T19:17:00.510546] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:00.575785] [DEBUG] [LOCAL ] HWM: Loaded 52984 existing records from primary storage. [2025-09-30T19:17:00.576234] [INFO ] [MAIN ] HWM: Loaded 52984 existing records. [2025-09-30T19:17:00.783139] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:17:00.783439] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-30T19:17:00.783519] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-30T19:17:00.798626] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T19:17:00.798707] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-30T19:17:00.803623] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-30T19:17:01.065423] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-30T19:17:01.202119] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:01.854362] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-30T19:17:02.218027] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-30T19:17:02.662397] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-30T19:17:02.681930] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-30T19:17:03.454399] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-30T19:17:03.673501] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T19:17:03.920894] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-30T19:17:04.047610] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T19:17:04.254357] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-30T19:17:05.054366] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-30T19:17:05.854359] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-30T19:17:06.046047] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T19:17:06.654338] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-30T19:17:06.932695] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T19:17:07.111226] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T19:17:07.377760] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T19:17:07.454380] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-30T19:17:08.254360] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-30T19:17:08.949456] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T19:17:09.054401] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-30T19:17:09.854375] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-30T19:17:10.005003] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T19:17:10.002971] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T19:17:10.654390] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-30T19:17:11.454318] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-30T19:17:11.560809] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T19:17:12.201489] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:17:12.254350] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-30T19:17:13.054321] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-30T19:17:13.182762] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:17:13.854370] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-30T19:17:14.017543] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T19:17:14.174724] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T19:17:14.654372] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-30T19:17:15.454315] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-30T19:17:15.488441] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-30T19:17:15.521519] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-30T19:17:15.524875] [INFO ] [REMOTE ] HVT: Full fetch complete (23465 records). [2025-09-30T19:17:15.524973] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-30T19:17:15.931995] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-30T19:17:15.932083] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-30T19:17:15.932624] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-30T19:17:15.932703] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-30T19:17:15.933367] [DEBUG] [LOCAL ] HVT: Trimmed 23465 records to 15579 (keeping 200 days of data) [2025-09-30T19:17:16.036543] [DEBUG] [LOCAL ] HVT: Primary data saved (15579 records). [2025-09-30T19:17:16.036717] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-30T19:17:16.036851] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HVT took 29.5s. Estimated remaining: 2h 47m 7s. Rate: 7.8 symbols/min [2025-09-30T19:17:16.230575] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:16.254367] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-30T19:17:16.294583] [DEBUG] [LOCAL ] HXL: Loaded 45991 existing records from primary storage. [2025-09-30T19:17:16.294964] [INFO ] [MAIN ] HXL: Loaded 45991 existing records. [2025-09-30T19:17:16.487990] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:17:16.488226] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-30T19:17:16.488286] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-30T19:17:16.488935] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-30T19:17:16.488998] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-30T19:17:16.871769] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:17.054427] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-30T19:17:17.303889] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T19:17:17.316251] [INFO ] [REMOTE ] HUN: Full fetch complete (76620 records). [2025-09-30T19:17:17.316418] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-30T19:17:17.785636] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-30T19:17:17.785791] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-30T19:17:17.786943] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-30T19:17:17.787023] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-30T19:17:17.788774] [DEBUG] [LOCAL ] HUN: Trimmed 76620 records to 53197 (keeping 200 days of data) [2025-09-30T19:17:17.861508] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-30T19:17:18.161114] [DEBUG] [LOCAL ] HUN: Primary data saved (53197 records). [2025-09-30T19:17:18.161347] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-30T19:17:18.162859] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HUN took 35.7s. Estimated remaining: 2h 46m 52s. Rate: 7.8 symbols/min [2025-09-30T19:17:18.347529] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-30T19:17:18.409766] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:18.437428] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T19:17:18.455085] [DEBUG] [LOCAL ] HY: Loaded 9987 existing records from primary storage. [2025-09-30T19:17:18.455337] [INFO ] [MAIN ] HY: Loaded 9987 existing records. [2025-09-30T19:17:18.647617] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:17:18.647888] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-30T19:17:18.647938] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-30T19:17:18.648320] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-30T19:17:18.648400] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-30T19:17:18.659732] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-30T19:17:19.047336] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:19.283429] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T19:17:19.294434] [INFO ] [REMOTE ] HUYA: Full fetch complete (63647 records). [2025-09-30T19:17:19.294569] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-30T19:17:19.464545] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-30T19:17:19.717444] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-30T19:17:19.717552] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-30T19:17:19.718557] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-30T19:17:19.718637] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-30T19:17:19.720621] [DEBUG] [LOCAL ] HUYA: Trimmed 63647 records to 44164 (keeping 200 days of data) [2025-09-30T19:17:19.992277] [DEBUG] [LOCAL ] HUYA: Primary data saved (44164 records). [2025-09-30T19:17:19.992415] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-30T19:17:19.992523] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HUYA took 35.1s. Estimated remaining: 2h 46m 37s. Rate: 7.8 symbols/min [2025-09-30T19:17:20.177364] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:20.177584] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-30T19:17:20.177737] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-30T19:17:20.177889] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-30T19:17:20.177932] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-30T19:17:20.177976] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-30T19:17:20.178008] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-30T19:17:20.257386] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-30T19:17:20.460828] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T19:17:20.591792] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:20.839273] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-30T19:17:21.054395] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-30T19:17:21.400126] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-30T19:17:21.862580] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-30T19:17:21.868825] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T19:17:22.652449] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T19:17:22.655017] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-30T19:17:23.454408] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-30T19:17:24.030880] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-30T19:17:24.254398] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-30T19:17:24.622130] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T19:17:25.054383] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-30T19:17:25.141510] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T19:17:25.358597] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-30T19:17:25.854415] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-30T19:17:26.654399] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-30T19:17:26.969881] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-30T19:17:27.454414] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-30T19:17:27.696632] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-30T19:17:27.843675] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T19:17:28.254343] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-30T19:17:28.567141] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-30T19:17:29.054393] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-30T19:17:29.854377] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-30T19:17:30.198234] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-30T19:17:30.654352] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-30T19:17:31.047169] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-30T19:17:31.152545] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T19:17:31.164278] [INFO ] [REMOTE ] HWM: Full fetch complete (76631 records). [2025-09-30T19:17:31.164435] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-30T19:17:31.459530] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-30T19:17:31.601164] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-30T19:17:31.601250] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-30T19:17:31.602323] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-30T19:17:31.602402] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-30T19:17:31.603936] [DEBUG] [LOCAL ] HWM: Trimmed 76631 records to 52974 (keeping 200 days of data) [2025-09-30T19:17:31.953198] [DEBUG] [LOCAL ] HWM: Primary data saved (52974 records). [2025-09-30T19:17:31.953337] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-30T19:17:31.953443] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HWM took 31.6s. Estimated remaining: 2h 46m 35s. Rate: 7.8 symbols/min [2025-09-30T19:17:32.138085] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:32.138300] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-30T19:17:32.138344] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-30T19:17:32.138464] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-30T19:17:32.138511] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-30T19:17:32.138553] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-30T19:17:32.138590] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-30T19:17:32.259555] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-30T19:17:32.599304] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:32.719459] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T19:17:32.772787] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-30T19:17:33.054370] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-30T19:17:33.854378] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-30T19:17:33.915900] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T19:17:34.108543] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-30T19:17:34.654402] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-30T19:17:35.403712] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T19:17:35.454366] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-30T19:17:36.222233] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T19:17:36.254409] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-30T19:17:37.004376] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-30T19:17:37.054415] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-30T19:17:37.401813] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-30T19:17:37.854378] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-30T19:17:38.177046] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-30T19:17:38.654400] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-30T19:17:38.998129] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-30T19:17:38.998950] [INFO ] [REMOTE ] HYAC: Full fetch complete (862 records). [2025-09-30T19:17:38.999025] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-30T19:17:39.211795] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-30T19:17:39.212004] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:17:39.212077] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:17:39.212153] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-30T19:17:39.212221] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-30T19:17:39.212261] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-30T19:17:39.212323] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-30T19:17:39.212407] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HYAC took 19.2s. Estimated remaining: 2h 46m 27s. Rate: 7.8 symbols/min [2025-09-30T19:17:39.407329] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:39.419867] [DEBUG] [LOCAL ] HYI: Loaded 9292 existing records from primary storage. [2025-09-30T19:17:39.420094] [INFO ] [MAIN ] HYI: Loaded 9292 existing records. [2025-09-30T19:17:39.459505] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-30T19:17:39.631852] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:17:39.632067] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-30T19:17:39.632113] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-30T19:17:39.632423] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-30T19:17:39.632482] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-30T19:17:40.039268] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:40.254329] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-30T19:17:40.341070] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T19:17:40.475470] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-30T19:17:41.054378] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-30T19:17:41.854374] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-30T19:17:41.991502] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T19:17:41.994729] [INFO ] [REMOTE ] HY: Full fetch complete (15183 records). [2025-09-30T19:17:41.994811] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-30T19:17:42.315327] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T19:17:42.407322] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-30T19:17:42.407411] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-30T19:17:42.407776] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-30T19:17:42.407840] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-30T19:17:42.408533] [DEBUG] [LOCAL ] HY: Trimmed 15183 records to 9962 (keeping 200 days of data) [2025-09-30T19:17:42.476855] [DEBUG] [LOCAL ] HY: Primary data saved (9962 records). [2025-09-30T19:17:42.477016] [INFO ] [MAIN ] HY: Full history saved. [2025-09-30T19:17:42.477106] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HY took 24.3s. Estimated remaining: 2h 46m 14s. Rate: 7.8 symbols/min [2025-09-30T19:17:42.660545] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:42.660616] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-30T19:17:42.713821] [DEBUG] [LOCAL ] HYT: Loaded 33536 existing records from primary storage. [2025-09-30T19:17:42.714249] [INFO ] [MAIN ] HYT: Loaded 33536 existing records. [2025-09-30T19:17:42.909527] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:17:42.909863] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-30T19:17:42.909950] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-30T19:17:42.910559] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-30T19:17:42.910620] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-30T19:17:43.295776] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:43.454380] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-30T19:17:44.254349] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-30T19:17:44.354548] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:17:44.354970] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T19:17:44.520243] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-30T19:17:45.054373] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-30T19:17:45.854357] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-30T19:17:46.654450] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-30T19:17:46.746539] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T19:17:47.150170] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T19:17:47.401883] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T19:17:47.454404] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-30T19:17:48.254373] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-30T19:17:48.607355] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-30T19:17:49.054367] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-30T19:17:49.140443] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:17:49.789187] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T19:17:49.854337] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-30T19:17:50.591310] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-30T19:17:50.654392] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-30T19:17:51.454365] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-30T19:17:52.178029] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T19:17:52.254375] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-30T19:17:53.039579] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:17:53.054398] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-30T19:17:53.216412] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-30T19:17:53.854544] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-30T19:17:53.857867] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T19:17:54.171674] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-30T19:17:54.654372] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-30T19:17:54.899279] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-30T19:17:55.454363] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-30T19:17:55.799053] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-30T19:17:56.254354] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-30T19:17:56.674158] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-30T19:17:56.674905] [INFO ] [REMOTE ] HYBX: Full fetch complete (783 records). [2025-09-30T19:17:56.674989] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-30T19:17:56.867284] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-30T19:17:56.867478] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:17:56.867548] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:17:56.867624] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-30T19:17:56.867727] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-30T19:17:56.867771] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-30T19:17:56.867857] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-30T19:17:56.867932] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HYBX took 24.9s. Estimated remaining: 2h 46m 14s. Rate: 7.8 symbols/min [2025-09-30T19:17:57.055220] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-30T19:17:57.055138] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:17:57.062929] [DEBUG] [LOCAL ] HYTR: Loaded 3140 existing records from primary storage. [2025-09-30T19:17:57.063170] [INFO ] [MAIN ] HYTR: Loaded 3140 existing records. [2025-09-30T19:17:57.255690] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:17:57.255896] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-30T19:17:57.255943] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-30T19:17:57.256161] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-30T19:17:57.256219] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-30T19:17:57.690135] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:17:57.854361] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-30T19:17:58.344331] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-30T19:17:58.654353] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-30T19:17:58.685999] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T19:17:59.454382] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-30T19:17:59.691259] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T19:18:00.254377] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-30T19:18:01.054394] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-30T19:18:01.168853] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:18:01.815515] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T19:18:01.845395] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T19:18:01.854566] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-30T19:18:02.654362] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-30T19:18:03.020972] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-30T19:18:03.392430] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T19:18:03.454410] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-30T19:18:04.159521] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T19:18:04.254358] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-30T19:18:05.054358] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-30T19:18:05.081554] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-30T19:18:05.854358] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-30T19:18:06.181518] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T19:18:06.624234] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T19:18:06.654348] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-30T19:18:07.454355] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-30T19:18:07.545833] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-30T19:18:07.548486] [INFO ] [REMOTE ] HYI: Full fetch complete (13369 records). [2025-09-30T19:18:07.548623] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-30T19:18:07.864107] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-30T19:18:07.983021] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-30T19:18:07.983110] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-30T19:18:07.983420] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-30T19:18:07.983462] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-30T19:18:07.984081] [DEBUG] [LOCAL ] HYI: Trimmed 13369 records to 9392 (keeping 200 days of data) [2025-09-30T19:18:08.046572] [DEBUG] [LOCAL ] HYI: Primary data saved (9392 records). [2025-09-30T19:18:08.046763] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-30T19:18:08.046865] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HYI took 28.8s. Estimated remaining: 2h 46m 11s. Rate: 7.8 symbols/min [2025-09-30T19:18:08.254403] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-30T19:18:08.282755] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:08.318284] [DEBUG] [LOCAL ] HZO: Loaded 29189 existing records from primary storage. [2025-09-30T19:18:08.318712] [INFO ] [MAIN ] HZO: Loaded 29189 existing records. [2025-09-30T19:18:08.556023] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:08.556311] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-30T19:18:08.556370] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-30T19:18:08.556875] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-30T19:18:08.556935] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-30T19:18:08.955033] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:09.054388] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-30T19:18:09.698115] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:18:09.854346] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-30T19:18:10.413034] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-30T19:18:10.447472] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T19:18:10.458319] [INFO ] [REMOTE ] HXL: Full fetch complete (66211 records). [2025-09-30T19:18:10.458500] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-30T19:18:10.662897] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-30T19:18:10.907240] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-30T19:18:10.907341] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-30T19:18:10.908335] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-30T19:18:10.908402] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-30T19:18:10.909906] [DEBUG] [LOCAL ] HXL: Trimmed 66211 records to 46000 (keeping 200 days of data) [2025-09-30T19:18:11.225947] [DEBUG] [LOCAL ] HXL: Primary data saved (46000 records). [2025-09-30T19:18:11.226130] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-30T19:18:11.226245] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HXL took 55.2s. Estimated remaining: 2h 45m 57s. Rate: 7.8 symbols/min [2025-09-30T19:18:11.454446] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-30T19:18:11.888203] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-30T19:18:11.904093] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T19:18:12.254404] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-30T19:18:12.956409] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-30T19:18:13.054397] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-30T19:18:13.526324] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-30T19:18:13.854412] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-30T19:18:14.654356] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-30T19:18:15.346731] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T19:18:15.454415] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-30T19:18:15.864766] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T19:18:16.254397] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-30T19:18:16.929367] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T19:18:16.940622] [INFO ] [REMOTE ] HYT: Full fetch complete (47376 records). [2025-09-30T19:18:16.940884] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-30T19:18:17.063156] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-30T19:18:17.390799] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-30T19:18:17.390951] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-30T19:18:17.391998] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-30T19:18:17.392076] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-30T19:18:17.413387] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T19:18:17.418561] [DEBUG] [LOCAL ] HYT: Trimmed 47376 records to 33686 (keeping 200 days of data) [2025-09-30T19:18:17.483816] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-30T19:18:17.654848] [DEBUG] [LOCAL ] HYT: Primary data saved (33686 records). [2025-09-30T19:18:17.655017] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-30T19:18:17.655536] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HYT took 35.2s. Estimated remaining: 2h 45m 48s. Rate: 7.8 symbols/min [2025-09-30T19:18:17.854349] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-30T19:18:18.315600] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-30T19:18:18.654389] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-30T19:18:19.454416] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-30T19:18:19.720080] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-30T19:18:20.035324] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T19:18:20.036567] [INFO ] [REMOTE ] HYTR: Full fetch complete (4504 records). [2025-09-30T19:18:20.036638] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-30T19:18:20.267738] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-30T19:18:20.413005] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-30T19:18:20.413087] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-30T19:18:20.413227] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-30T19:18:20.413266] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-30T19:18:20.413637] [DEBUG] [LOCAL ] HYTR: Trimmed 4504 records to 3151 (keeping 200 days of data) [2025-09-30T19:18:20.433676] [DEBUG] [LOCAL ] HYTR: Primary data saved (3151 records). [2025-09-30T19:18:20.433800] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-30T19:18:20.433897] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYTR took 23.6s. Estimated remaining: 2h 45m 35s. Rate: 7.8 symbols/min [2025-09-30T19:18:21.509610] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-30T19:18:21.518055] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-30T19:18:22.714227] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-30T19:18:22.720709] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-30T19:18:23.937511] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T19:18:23.944210] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-30T19:18:24.959196] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-30T19:18:24.966628] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-30T19:18:26.354843] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-30T19:18:26.361086] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-30T19:18:27.727387] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T19:18:27.733834] [INFO ] [REMOTE ] HZO: Full fetch complete (40916 records). [2025-09-30T19:18:27.733939] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-30T19:18:28.154835] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-30T19:18:28.154966] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-30T19:18:28.155793] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-30T19:18:28.155860] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-30T19:18:28.157154] [DEBUG] [LOCAL ] HZO: Trimmed 40916 records to 29205 (keeping 200 days of data) [2025-09-30T19:18:28.338080] [DEBUG] [LOCAL ] HZO: Primary data saved (29205 records). [2025-09-30T19:18:28.338256] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-30T19:18:28.338365] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HZO took 20.3s. Estimated remaining: 2h 45m 27s. Rate: 7.8 symbols/min [2025-09-30T19:18:29.177290] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:29.152456] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:29.291763] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:29.312932] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:29.370564] [DEBUG] [LOCAL ] IAE: Loaded 6041 existing records from primary storage. [2025-09-30T19:18:29.371591] [INFO ] [MAIN ] IAE: Loaded 6041 existing records. [2025-09-30T19:18:29.528946] [DEBUG] [LOCAL ] IBN: Loaded 52868 existing records from primary storage. [2025-09-30T19:18:29.535812] [INFO ] [MAIN ] IBN: Loaded 52868 existing records. [2025-09-30T19:18:29.630154] [DEBUG] [LOCAL ] IBM: Loaded 53636 existing records from primary storage. [2025-09-30T19:18:29.668862] [INFO ] [MAIN ] IBM: Loaded 53636 existing records. [2025-09-30T19:18:29.892408] [DEBUG] [LOCAL ] IAG: Loaded 53448 existing records from primary storage. [2025-09-30T19:18:30.028518] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:30.034464] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-30T19:18:30.045052] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-30T19:18:30.018509] [INFO ] [MAIN ] IAG: Loaded 53448 existing records. [2025-09-30T19:18:30.094614] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-30T19:18:30.111289] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-30T19:18:30.276995] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:30.349821] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-30T19:18:30.484487] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-30T19:18:30.508102] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:30.545264] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-30T19:18:30.576400] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-30T19:18:30.658450] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-30T19:18:30.763778] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:30.757614] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-30T19:18:30.809417] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-30T19:18:30.830216] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-30T19:18:30.849542] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-30T19:18:30.887568] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-30T19:18:30.903841] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-30T19:18:30.966097] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-30T19:18:31.432966] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:31.465287] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-30T19:18:31.870857] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:31.899594] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-30T19:18:32.160887] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:32.181717] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-30T19:18:32.185891] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:32.187208] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-30T19:18:32.314909] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T19:18:32.316842] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-30T19:18:33.101596] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-30T19:18:33.103519] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-30T19:18:33.788754] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-30T19:18:33.790973] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-30T19:18:33.845707] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-30T19:18:33.857459] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-30T19:18:33.956511] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T19:18:33.968506] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-30T19:18:34.013340] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T19:18:34.024901] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-30T19:18:34.176471] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-30T19:18:34.178836] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-30T19:18:34.843059] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T19:18:34.844851] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-30T19:18:35.236964] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-30T19:18:35.239209] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-30T19:18:35.366343] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-30T19:18:35.454411] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-30T19:18:35.587909] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-30T19:18:35.843028] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T19:18:35.878911] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-30T19:18:36.254370] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-30T19:18:36.848876] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T19:18:37.054411] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-30T19:18:37.854317] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-30T19:18:38.365306] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-30T19:18:38.495338] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T19:18:38.523172] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-30T19:18:38.654375] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-30T19:18:39.454602] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-30T19:18:40.254367] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-30T19:18:40.831332] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-30T19:18:40.903118] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T19:18:41.054361] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-30T19:18:41.115223] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T19:18:41.854368] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-30T19:18:42.654394] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-30T19:18:42.693509] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T19:18:42.696013] [INFO ] [REMOTE ] IAE: Full fetch complete (8646 records). [2025-09-30T19:18:42.696160] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-30T19:18:43.110155] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-30T19:18:43.110290] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-30T19:18:43.110625] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-30T19:18:43.110739] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-30T19:18:43.111356] [DEBUG] [LOCAL ] IAE: Trimmed 8646 records to 6043 (keeping 200 days of data) [2025-09-30T19:18:43.180489] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-30T19:18:43.182823] [DEBUG] [LOCAL ] IAE: Primary data saved (6043 records). [2025-09-30T19:18:43.194803] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-30T19:18:43.195383] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IAE took 14.9s. Estimated remaining: 2h 45m 28s. Rate: 7.8 symbols/min [2025-09-30T19:18:43.380917] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:43.416888] [DEBUG] [LOCAL ] IBP: Loaded 29054 existing records from primary storage. [2025-09-30T19:18:43.417160] [INFO ] [MAIN ] IBP: Loaded 29054 existing records. [2025-09-30T19:18:43.462910] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-30T19:18:43.618411] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:43.618693] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-30T19:18:43.618777] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-30T19:18:43.619255] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-30T19:18:43.619338] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-30T19:18:44.016851] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:44.254392] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-30T19:18:44.945262] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-30T19:18:45.008889] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:18:45.054326] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-30T19:18:45.854336] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-30T19:18:46.090813] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-30T19:18:46.151802] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T19:18:46.654374] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-30T19:18:47.454401] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-30T19:18:47.750070] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-30T19:18:48.254386] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-30T19:18:48.519779] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T19:18:49.054357] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-30T19:18:49.250554] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T19:18:49.699418] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T19:18:49.854345] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-30T19:18:50.654358] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-30T19:18:51.233105] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-30T19:18:51.360240] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T19:18:51.454387] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-30T19:18:52.254386] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-30T19:18:52.459303] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T19:18:53.007098] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T19:18:53.054363] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-30T19:18:53.279483] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T19:18:53.854347] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-30T19:18:54.654366] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-30T19:18:55.187010] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-30T19:18:55.454352] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-30T19:18:55.645681] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T19:18:55.945317] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T19:18:56.254364] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-30T19:18:57.054366] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-30T19:18:57.321279] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T19:18:57.333159] [INFO ] [REMOTE ] IAG: Full fetch complete (77245 records). [2025-09-30T19:18:57.333317] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-30T19:18:57.759348] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-30T19:18:57.759450] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-30T19:18:57.760635] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-30T19:18:57.760734] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-30T19:18:57.762375] [DEBUG] [LOCAL ] IAG: Trimmed 77245 records to 53449 (keeping 200 days of data) [2025-09-30T19:18:57.859691] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-30T19:18:58.106250] [DEBUG] [LOCAL ] IAG: Primary data saved (53449 records). [2025-09-30T19:18:58.106405] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-30T19:18:58.107043] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IAG took 29.8s. Estimated remaining: 2h 45m 29s. Rate: 7.8 symbols/min [2025-09-30T19:18:58.318036] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:18:58.369438] [DEBUG] [LOCAL ] IBTA: Loaded 37651 existing records from primary storage. [2025-09-30T19:18:58.369793] [INFO ] [MAIN ] IBTA: Loaded 37651 existing records. [2025-09-30T19:18:58.604187] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:18:58.623257] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-30T19:18:58.624865] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-30T19:18:58.625051] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-30T19:18:58.633141] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-30T19:18:58.633283] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-30T19:18:58.659449] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-30T19:18:58.998886] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-30T19:18:59.096300] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:18:59.155458] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T19:18:59.454368] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-30T19:18:59.642720] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-30T19:19:00.254396] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-30T19:19:00.605932] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T19:19:01.054365] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-30T19:19:01.854368] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-30T19:19:02.331837] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-30T19:19:02.458931] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T19:19:02.472344] [INFO ] [REMOTE ] IBM: Full fetch complete (77620 records). [2025-09-30T19:19:02.472491] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-30T19:19:02.660863] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-30T19:19:02.896866] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-30T19:19:02.897061] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-30T19:19:02.898176] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-30T19:19:02.898244] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-30T19:19:02.899783] [DEBUG] [LOCAL ] IBM: Trimmed 77620 records to 53635 (keeping 200 days of data) [2025-09-30T19:19:03.025394] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-30T19:19:03.283429] [DEBUG] [LOCAL ] IBM: Primary data saved (53635 records). [2025-09-30T19:19:03.283576] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-30T19:19:03.283720] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IBM took 34.9s. Estimated remaining: 2h 45m 18s. Rate: 7.8 symbols/min [2025-09-30T19:19:03.454507] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-30T19:19:03.479001] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:03.545277] [DEBUG] [LOCAL ] ICE: Loaded 53015 existing records from primary storage. [2025-09-30T19:19:03.545712] [INFO ] [MAIN ] ICE: Loaded 53015 existing records. [2025-09-30T19:19:03.744872] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:03.745158] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-30T19:19:03.745235] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-30T19:19:03.745925] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-30T19:19:03.746000] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-30T19:19:04.092761] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:19:04.217290] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:04.254325] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-30T19:19:04.675709] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T19:19:05.054354] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-30T19:19:05.854360] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-30T19:19:06.247207] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T19:19:06.654406] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-30T19:19:06.730756] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-30T19:19:07.012556] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T19:19:07.024451] [INFO ] [REMOTE ] IBN: Full fetch complete (76284 records). [2025-09-30T19:19:07.024587] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-30T19:19:07.465861] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-30T19:19:07.470095] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-30T19:19:07.471305] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-30T19:19:07.472723] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-30T19:19:07.472926] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-30T19:19:07.474997] [DEBUG] [LOCAL ] IBN: Trimmed 76284 records to 52867 (keeping 200 days of data) [2025-09-30T19:19:07.811334] [DEBUG] [LOCAL ] IBN: Primary data saved (52867 records). [2025-09-30T19:19:07.811488] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-30T19:19:07.812626] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBN took 39.5s. Estimated remaining: 2h 45m 7s. Rate: 7.8 symbols/min [2025-09-30T19:19:07.996487] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:08.042445] [DEBUG] [LOCAL ] ICL: Loaded 38401 existing records from primary storage. [2025-09-30T19:19:08.042771] [INFO ] [MAIN ] ICL: Loaded 38401 existing records. [2025-09-30T19:19:08.229408] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:08.229699] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-30T19:19:08.229779] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-30T19:19:08.230350] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-30T19:19:08.230445] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-30T19:19:08.257717] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-30T19:19:08.623603] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:08.656155] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T19:19:08.689610] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-30T19:19:09.054379] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-30T19:19:09.739770] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T19:19:09.854345] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-30T19:19:10.323995] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T19:19:10.330161] [INFO ] [REMOTE ] IBP: Full fetch complete (41162 records). [2025-09-30T19:19:10.330292] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-30T19:19:10.659476] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-30T19:19:10.730006] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-30T19:19:10.730097] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-30T19:19:10.730811] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-30T19:19:10.730876] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-30T19:19:10.731909] [DEBUG] [LOCAL ] IBP: Trimmed 41162 records to 28967 (keeping 200 days of data) [2025-09-30T19:19:10.922595] [DEBUG] [LOCAL ] IBP: Primary data saved (28967 records). [2025-09-30T19:19:10.922783] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-30T19:19:10.922888] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBP took 27.7s. Estimated remaining: 2h 44m 54s. Rate: 7.8 symbols/min [2025-09-30T19:19:11.120914] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:11.187281] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T19:19:11.185626] [DEBUG] [LOCAL ] IDA: Loaded 31989 existing records from primary storage. [2025-09-30T19:19:11.198383] [INFO ] [MAIN ] IDA: Loaded 31989 existing records. [2025-09-30T19:19:11.389995] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:11.390256] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-30T19:19:11.390319] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-30T19:19:11.390709] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-30T19:19:11.390778] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-30T19:19:11.459545] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-30T19:19:11.771365] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:12.036798] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T19:19:12.254402] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-30T19:19:12.959589] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:19:13.054362] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-30T19:19:13.548626] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T19:19:13.854347] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-30T19:19:14.513205] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T19:19:14.611890] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T19:19:14.654357] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-30T19:19:15.454387] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-30T19:19:15.857342] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T19:19:16.254384] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-30T19:19:16.612030] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T19:19:17.054377] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-30T19:19:17.448317] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T19:19:17.854363] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-30T19:19:18.654375] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-30T19:19:18.929731] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T19:19:19.369397] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T19:19:19.454365] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-30T19:19:20.122782] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T19:19:20.254413] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-30T19:19:21.054341] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-30T19:19:21.225964] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T19:19:21.633949] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T19:19:21.854363] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-30T19:19:22.597319] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T19:19:22.606708] [INFO ] [REMOTE ] IBTA: Full fetch complete (50720 records). [2025-09-30T19:19:22.606865] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-30T19:19:22.659492] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-30T19:19:23.055813] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-30T19:19:23.055940] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-30T19:19:23.056731] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-30T19:19:23.056826] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-30T19:19:23.057991] [DEBUG] [LOCAL ] IBTA: Trimmed 50720 records to 37607 (keeping 200 days of data) [2025-09-30T19:19:23.289360] [DEBUG] [LOCAL ] IBTA: Primary data saved (37607 records). [2025-09-30T19:19:23.289511] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-30T19:19:23.290102] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. IBTA took 25.2s. Estimated remaining: 2h 44m 52s. Rate: 7.8 symbols/min [2025-09-30T19:19:23.473361] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-30T19:19:23.477956] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:23.492584] [DEBUG] [LOCAL ] IDE: Loaded 8697 existing records from primary storage. [2025-09-30T19:19:23.492887] [INFO ] [MAIN ] IDE: Loaded 8697 existing records. [2025-09-30T19:19:23.698574] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:23.698879] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-30T19:19:23.699040] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-30T19:19:23.699336] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-30T19:19:23.699460] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-30T19:19:24.109746] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T19:19:24.119151] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-30T19:19:24.172860] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:24.254330] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-30T19:19:25.051053] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T19:19:25.059770] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-30T19:19:25.070171] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-30T19:19:25.854327] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-30T19:19:26.009474] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-30T19:19:26.654379] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-30T19:19:27.454337] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-30T19:19:27.547950] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:19:28.038345] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T19:19:28.216573] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T19:19:28.254359] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-30T19:19:28.986507] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T19:19:29.054375] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-30T19:19:29.854358] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-30T19:19:30.398142] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T19:19:30.654361] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-30T19:19:31.355358] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T19:19:31.454379] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-30T19:19:32.025449] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-30T19:19:32.254373] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-30T19:19:32.665475] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-30T19:19:33.054395] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-30T19:19:33.760895] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T19:19:33.854365] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-30T19:19:34.392963] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T19:19:34.654397] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-30T19:19:34.879592] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T19:19:35.454370] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-30T19:19:36.073320] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-30T19:19:36.254364] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-30T19:19:36.384607] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:19:37.054339] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-30T19:19:37.109155] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-30T19:19:37.854360] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-30T19:19:38.654433] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-30T19:19:39.056544] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-30T19:19:39.077459] [INFO ] [REMOTE ] ICE: Full fetch complete (76755 records). [2025-09-30T19:19:39.077749] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-30T19:19:39.429948] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T19:19:39.463481] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-30T19:19:39.537289] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-30T19:19:39.594214] [INFO ] [REMOTE ] ICL: Full fetch complete (55949 records). [2025-09-30T19:19:39.594439] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-30T19:19:39.894266] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-30T19:19:39.901448] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-30T19:19:39.917725] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-30T19:19:39.920307] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-30T19:19:40.031815] [DEBUG] [LOCAL ] ICE: Trimmed 76755 records to 53003 (keeping 200 days of data) [2025-09-30T19:19:40.252441] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-30T19:19:40.254909] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-30T19:19:40.257693] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-30T19:19:40.259350] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-30T19:19:40.260462] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-30T19:19:40.270978] [DEBUG] [LOCAL ] ICL: Trimmed 55949 records to 38406 (keeping 200 days of data) [2025-09-30T19:19:40.732434] [DEBUG] [LOCAL ] ICL: Primary data saved (38406 records). [2025-09-30T19:19:40.734312] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-30T19:19:40.734429] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. ICL took 32.9s. Estimated remaining: 2h 44m 55s. Rate: 7.8 symbols/min [2025-09-30T19:19:40.947325] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:40.957106] [DEBUG] [LOCAL ] ICE: Primary data saved (53003 records). [2025-09-30T19:19:40.957232] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-30T19:19:40.957313] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. ICE took 37.7s. Estimated remaining: 2h 44m 39s. Rate: 7.8 symbols/min [2025-09-30T19:19:41.060167] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T19:19:41.086242] [DEBUG] [LOCAL ] IDT: Loaded 17684 existing records from primary storage. [2025-09-30T19:19:41.103222] [INFO ] [MAIN ] IDT: Loaded 17684 existing records. [2025-09-30T19:19:41.087592] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-30T19:19:41.255851] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:41.281492] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-30T19:19:41.411709] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:41.411955] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-30T19:19:41.412004] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-30T19:19:41.412294] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-30T19:19:41.412353] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-30T19:19:41.562930] [DEBUG] [LOCAL ] IEX: Loaded 38289 existing records from primary storage. [2025-09-30T19:19:41.590921] [INFO ] [MAIN ] IEX: Loaded 38289 existing records. [2025-09-30T19:19:41.855013] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-30T19:19:41.860738] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T19:19:41.999828] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:42.018450] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-30T19:19:42.019071] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-30T19:19:42.043396] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:42.043453] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-30T19:19:42.043910] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-30T19:19:42.411695] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:42.654362] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-30T19:19:43.218247] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-30T19:19:43.439818] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-30T19:19:43.454308] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-30T19:19:44.196175] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T19:19:44.198828] [INFO ] [REMOTE ] IDE: Full fetch complete (12700 records). [2025-09-30T19:19:44.198906] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-30T19:19:44.262153] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-30T19:19:44.594289] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-30T19:19:44.594370] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-30T19:19:44.594680] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-30T19:19:44.594743] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-30T19:19:44.595203] [DEBUG] [LOCAL ] IDE: Trimmed 12700 records to 8748 (keeping 200 days of data) [2025-09-30T19:19:44.650525] [DEBUG] [LOCAL ] IDE: Primary data saved (8748 records). [2025-09-30T19:19:44.650695] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-30T19:19:44.650797] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDE took 21.4s. Estimated remaining: 2h 44m 26s. Rate: 7.8 symbols/min [2025-09-30T19:19:44.842878] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:44.897373] [DEBUG] [LOCAL ] IFF: Loaded 50976 existing records from primary storage. [2025-09-30T19:19:44.897738] [INFO ] [MAIN ] IFF: Loaded 50976 existing records. [2025-09-30T19:19:45.060140] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-30T19:19:45.092152] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:45.093158] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-30T19:19:45.093227] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-30T19:19:45.093885] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-30T19:19:45.093956] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-30T19:19:45.483264] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:45.763958] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:19:45.854341] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-30T19:19:46.663604] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-30T19:19:46.666857] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T19:19:46.676758] [INFO ] [REMOTE ] IDA: Full fetch complete (44793 records). [2025-09-30T19:19:46.676877] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-30T19:19:47.099162] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-30T19:19:47.099304] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-30T19:19:47.100096] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-30T19:19:47.100176] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-30T19:19:47.107700] [DEBUG] [LOCAL ] IDA: Trimmed 44793 records to 32082 (keeping 200 days of data) [2025-09-30T19:19:47.119782] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T19:19:47.339626] [DEBUG] [LOCAL ] IDA: Primary data saved (32082 records). [2025-09-30T19:19:47.339799] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-30T19:19:47.339887] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDA took 36.4s. Estimated remaining: 2h 44m 13s. Rate: 7.8 symbols/min [2025-09-30T19:19:47.459524] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-30T19:19:47.531965] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:19:47.555541] [DEBUG] [LOCAL ] IFN: Loaded 18221 existing records from primary storage. [2025-09-30T19:19:47.555882] [INFO ] [MAIN ] IFN: Loaded 18221 existing records. [2025-09-30T19:19:47.756882] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:19:47.757127] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-30T19:19:47.757183] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-30T19:19:47.757495] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-30T19:19:47.757556] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-30T19:19:48.168749] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:19:48.254326] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-30T19:19:48.297991] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-30T19:19:48.416611] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-30T19:19:49.054335] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-30T19:19:49.159235] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T19:19:49.854356] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-30T19:19:50.369746] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T19:19:50.654354] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-30T19:19:50.875896] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T19:19:51.454415] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-30T19:19:51.914811] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T19:19:52.254365] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-30T19:19:53.054357] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-30T19:19:53.264826] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T19:19:53.854332] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-30T19:19:53.888382] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T19:19:53.940752] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T19:19:54.654377] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-30T19:19:55.454336] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-30T19:19:55.574704] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T19:19:55.718538] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-30T19:19:56.254359] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-30T19:19:57.054334] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-30T19:19:57.096389] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:19:57.624188] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T19:19:57.854368] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-30T19:19:57.898715] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T19:19:58.654359] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-30T19:19:59.375394] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T19:19:59.428417] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T19:19:59.454312] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-30T19:20:00.254357] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-30T19:20:00.955992] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T19:20:00.976695] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T19:20:01.054349] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-30T19:20:01.854364] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-30T19:20:02.122384] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T19:20:02.572846] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-30T19:20:02.654374] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-30T19:20:03.454373] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-30T19:20:04.254356] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-30T19:20:04.516268] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T19:20:04.568842] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T19:20:05.054352] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-30T19:20:05.785741] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-30T19:20:05.854370] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-30T19:20:06.648512] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:20:06.658333] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-30T19:20:07.454379] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-30T19:20:07.583159] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:20:07.611181] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T19:20:08.254375] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-30T19:20:08.435281] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T19:20:09.054347] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-30T19:20:09.179019] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T19:20:09.854326] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-30T19:20:09.934853] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T19:20:10.654380] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-30T19:20:11.454389] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-30T19:20:11.595483] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T19:20:11.637361] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T19:20:12.254319] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-30T19:20:12.349356] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-30T19:20:13.054390] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-30T19:20:13.478013] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T19:20:13.482924] [INFO ] [REMOTE ] IDT: Full fetch complete (22701 records). [2025-09-30T19:20:13.483031] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-30T19:20:13.877000] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-30T19:20:13.891317] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-30T19:20:13.891400] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-30T19:20:13.891981] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-30T19:20:13.892047] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-30T19:20:13.892777] [DEBUG] [LOCAL ] IDT: Trimmed 22701 records to 17861 (keeping 200 days of data) [2025-09-30T19:20:14.005781] [DEBUG] [LOCAL ] IDT: Primary data saved (17861 records). [2025-09-30T19:20:14.005960] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-30T19:20:14.006095] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IDT took 33.3s. Estimated remaining: 2h 44m 27s. Rate: 7.8 symbols/min [2025-09-30T19:20:14.192680] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:20:14.216125] [DEBUG] [LOCAL ] IFS: Loaded 22930 existing records from primary storage. [2025-09-30T19:20:14.216393] [INFO ] [MAIN ] IFS: Loaded 22930 existing records. [2025-09-30T19:20:14.423479] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:20:14.423923] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-30T19:20:14.424072] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-30T19:20:14.424795] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-30T19:20:14.424860] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-30T19:20:14.658568] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-30T19:20:14.887126] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:20:14.918902] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-30T19:20:14.972780] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T19:20:15.454407] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-30T19:20:16.254374] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-30T19:20:16.313095] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:20:16.323035] [INFO ] [REMOTE ] IEX: Full fetch complete (53413 records). [2025-09-30T19:20:16.323213] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-30T19:20:16.699552] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:20:16.736717] [INFO ] [REMOTE ] IFN: Full fetch complete (29052 records). [2025-09-30T19:20:16.750356] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-30T19:20:16.750755] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-30T19:20:16.750966] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-30T19:20:16.751851] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-30T19:20:16.757437] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-30T19:20:16.868201] [DEBUG] [LOCAL ] IEX: Trimmed 53413 records to 38324 (keeping 200 days of data) [2025-09-30T19:20:17.059534] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-30T19:20:17.262049] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:20:17.301463] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-30T19:20:17.304150] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-30T19:20:17.305771] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-30T19:20:17.306703] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-30T19:20:17.319288] [DEBUG] [LOCAL ] IFN: Trimmed 29052 records to 18249 (keeping 200 days of data) [2025-09-30T19:20:17.543947] [DEBUG] [LOCAL ] IEX: Primary data saved (38324 records). [2025-09-30T19:20:17.544681] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-30T19:20:17.544827] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IEX took 36.6s. Estimated remaining: 2h 44m 15s. Rate: 7.8 symbols/min [2025-09-30T19:20:17.694705] [DEBUG] [LOCAL ] IFN: Primary data saved (18249 records). [2025-09-30T19:20:17.719226] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-30T19:20:17.744208] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:20:17.741219] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFN took 30.4s. Estimated remaining: 2h 43m 58s. Rate: 7.8 symbols/min [2025-09-30T19:20:17.854951] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-30T19:20:17.875278] [DEBUG] [LOCAL ] IGA: Loaded 9733 existing records from primary storage. [2025-09-30T19:20:17.914386] [INFO ] [MAIN ] IGA: Loaded 9733 existing records. [2025-09-30T19:20:18.014429] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:20:18.154082] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:20:18.161162] [DEBUG] [LOCAL ] IGD: Loaded 18910 existing records from primary storage. [2025-09-30T19:20:18.160797] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-30T19:20:18.161514] [INFO ] [MAIN ] IGD: Loaded 18910 existing records. [2025-09-30T19:20:18.161410] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-30T19:20:18.232996] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-30T19:20:18.270239] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-30T19:20:18.506850] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:20:18.549284] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-30T19:20:18.590736] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-30T19:20:18.633918] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-30T19:20:18.658085] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-30T19:20:18.989702] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-30T19:20:18.976992] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:20:19.046345] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-30T19:20:19.248402] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:20:19.282979] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T19:20:19.295045] [INFO ] [REMOTE ] IFF: Full fetch complete (73018 records). [2025-09-30T19:20:19.295225] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-30T19:20:19.464060] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-30T19:20:19.729910] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-30T19:20:19.729998] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-30T19:20:19.731078] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-30T19:20:19.731147] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-30T19:20:19.732745] [DEBUG] [LOCAL ] IFF: Trimmed 73018 records to 50986 (keeping 200 days of data) [2025-09-30T19:20:20.073197] [DEBUG] [LOCAL ] IFF: Primary data saved (50986 records). [2025-09-30T19:20:20.073478] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-30T19:20:20.073584] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IFF took 35.4s. Estimated remaining: 2h 43m 44s. Rate: 7.8 symbols/min [2025-09-30T19:20:20.264003] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-30T19:20:20.265010] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:20:20.272148] [DEBUG] [LOCAL ] IGI: Loaded 3620 existing records from primary storage. [2025-09-30T19:20:20.272348] [INFO ] [MAIN ] IGI: Loaded 3620 existing records. [2025-09-30T19:20:20.426208] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T19:20:20.505802] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:20:20.516992] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-30T19:20:20.517766] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-30T19:20:20.518312] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T19:20:20.522913] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-30T19:20:20.522999] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-30T19:20:20.920106] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:20:20.987710] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-30T19:20:21.054388] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-30T19:20:21.662768] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-30T19:20:21.854378] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-30T19:20:22.654370] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-30T19:20:23.074242] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-30T19:20:23.427801] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T19:20:23.454350] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-30T19:20:24.254338] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-30T19:20:24.651112] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T19:20:24.717428] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-30T19:20:25.054403] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-30T19:20:25.654880] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T19:20:25.854375] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-30T19:20:26.654337] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-30T19:20:26.968402] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T19:20:27.087104] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-30T19:20:27.454400] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-30T19:20:28.254387] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-30T19:20:28.468904] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T19:20:29.054379] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-30T19:20:29.383555] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-30T19:20:29.653121] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T19:20:29.854348] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-30T19:20:30.491303] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T19:20:30.654369] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-30T19:20:31.134579] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T19:20:31.454426] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-30T19:20:32.254432] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-30T19:20:32.542399] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T19:20:32.999271] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T19:20:33.054402] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-30T19:20:33.854385] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-30T19:20:34.169079] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T19:20:34.458685] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T19:20:34.654399] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-30T19:20:35.264214] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T19:20:35.454398] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-30T19:20:36.254365] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-30T19:20:36.448217] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T19:20:36.753377] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-30T19:20:37.054360] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-30T19:20:37.695298] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T19:20:37.697541] [INFO ] [REMOTE ] IGI: Full fetch complete (5272 records). [2025-09-30T19:20:37.697676] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-30T19:20:37.860806] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-30T19:20:38.096507] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-30T19:20:38.096615] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-30T19:20:38.096822] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-30T19:20:38.096876] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-30T19:20:38.097252] [DEBUG] [LOCAL ] IGI: Trimmed 5272 records to 3617 (keeping 200 days of data) [2025-09-30T19:20:38.123100] [DEBUG] [LOCAL ] IGI: Primary data saved (3617 records). [2025-09-30T19:20:38.123202] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-30T19:20:38.123282] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IGI took 18.0s. Estimated remaining: 2h 43m 49s. Rate: 7.8 symbols/min [2025-09-30T19:20:38.295352] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:20:38.339082] [DEBUG] [LOCAL ] IGR: Loaded 30457 existing records from primary storage. [2025-09-30T19:20:38.339429] [INFO ] [MAIN ] IGR: Loaded 30457 existing records. [2025-09-30T19:20:38.537318] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:20:38.537794] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-30T19:20:38.537858] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-30T19:20:38.538271] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-30T19:20:38.538337] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-30T19:20:38.659512] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-30T19:20:38.762115] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T19:20:38.956263] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:20:39.454346] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-30T19:20:39.807909] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T19:20:40.254371] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-30T19:20:40.349270] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-30T19:20:41.054392] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-30T19:20:41.335511] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-30T19:20:41.854358] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-30T19:20:42.123805] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T19:20:42.654362] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-30T19:20:43.103564] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:20:43.108984] [INFO ] [REMOTE ] IFS: Full fetch complete (31604 records). [2025-09-30T19:20:43.109104] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-30T19:20:43.470422] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-30T19:20:43.524375] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-30T19:20:43.524470] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-30T19:20:43.525134] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-30T19:20:43.525205] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-30T19:20:43.526544] [DEBUG] [LOCAL ] IFS: Trimmed 31604 records to 22986 (keeping 200 days of data) [2025-09-30T19:20:43.666081] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:20:43.706751] [DEBUG] [LOCAL ] IFS: Primary data saved (22986 records). [2025-09-30T19:20:43.706899] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-30T19:20:43.707002] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IFS took 29.7s. Estimated remaining: 2h 43m 39s. Rate: 7.8 symbols/min [2025-09-30T19:20:43.898459] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:20:43.904471] [DEBUG] [LOCAL ] IH: Loaded 3313 existing records from primary storage. [2025-09-30T19:20:43.904724] [INFO ] [MAIN ] IH: Loaded 3313 existing records. [2025-09-30T19:20:44.071455] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-30T19:20:44.105455] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:20:44.106069] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-30T19:20:44.106133] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-30T19:20:44.106371] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-30T19:20:44.106432] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-30T19:20:44.264328] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-30T19:20:44.506624] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:20:45.054367] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-30T19:20:45.651372] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T19:20:45.854379] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-30T19:20:45.877611] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-30T19:20:46.654377] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-30T19:20:47.059446] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T19:20:47.454398] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-30T19:20:47.807905] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T19:20:48.254333] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-30T19:20:48.418712] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-30T19:20:48.660772] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-30T19:20:49.054397] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-30T19:20:49.854364] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-30T19:20:50.358318] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-30T19:20:50.431109] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T19:20:50.654363] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-30T19:20:51.454369] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-30T19:20:51.958233] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T19:20:52.258039] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-30T19:20:52.260932] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-30T19:20:52.832376] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T19:20:53.054375] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-30T19:20:53.625515] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-30T19:20:53.854367] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-30T19:20:54.322712] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-30T19:20:54.654356] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-30T19:20:55.454351] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-30T19:20:55.876978] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-30T19:20:55.957388] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T19:20:56.254350] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-30T19:20:56.746127] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-30T19:20:57.054376] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-30T19:20:57.854366] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-30T19:20:58.440859] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T19:20:58.468275] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T19:20:58.654380] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-30T19:20:59.354710] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-30T19:20:59.454354] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-30T19:21:00.254337] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-30T19:21:00.965296] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T19:21:00.968396] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T19:21:00.976918] [INFO ] [REMOTE ] IH: Full fetch complete (4971 records). [2025-09-30T19:21:00.977109] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-30T19:21:01.059514] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-30T19:21:01.383232] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-30T19:21:01.383314] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-30T19:21:01.383473] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-30T19:21:01.383513] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-30T19:21:01.383927] [DEBUG] [LOCAL ] IH: Trimmed 4971 records to 3225 (keeping 200 days of data) [2025-09-30T19:21:01.403581] [DEBUG] [LOCAL ] IH: Primary data saved (3225 records). [2025-09-30T19:21:01.403763] [INFO ] [MAIN ] IH: Full history saved. [2025-09-30T19:21:01.403866] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IH took 17.7s. Estimated remaining: 2h 43m 42s. Rate: 7.8 symbols/min [2025-09-30T19:21:01.626104] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:01.637532] [DEBUG] [LOCAL ] IHD: Loaded 6922 existing records from primary storage. [2025-09-30T19:21:01.637804] [INFO ] [MAIN ] IHD: Loaded 6922 existing records. [2025-09-30T19:21:01.857354] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-30T19:21:01.857252] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:01.858826] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-30T19:21:01.859071] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-30T19:21:01.859381] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-30T19:21:01.859630] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-30T19:21:01.998569] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-30T19:21:02.306376] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:02.397983] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-30T19:21:02.654378] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-30T19:21:03.454336] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-30T19:21:03.740547] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T19:21:03.744679] [INFO ] [REMOTE ] IGD: Full fetch complete (29631 records). [2025-09-30T19:21:03.744782] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-30T19:21:04.159206] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-30T19:21:04.159325] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-30T19:21:04.159986] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-30T19:21:04.160053] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-30T19:21:04.161021] [DEBUG] [LOCAL ] IGD: Trimmed 29631 records to 19008 (keeping 200 days of data) [2025-09-30T19:21:04.254489] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-30T19:21:04.289784] [DEBUG] [LOCAL ] IGD: Primary data saved (19008 records). [2025-09-30T19:21:04.290004] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-30T19:21:04.290152] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGD took 46.5s. Estimated remaining: 2h 43m 29s. Rate: 7.8 symbols/min [2025-09-30T19:21:04.431587] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-30T19:21:04.450243] [INFO ] [REMOTE ] IGA: Full fetch complete (13690 records). [2025-09-30T19:21:04.473743] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-30T19:21:04.504469] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:04.791004] [DEBUG] [LOCAL ] IHG: Loaded 24500 existing records from primary storage. [2025-09-30T19:21:04.798186] [INFO ] [MAIN ] IHG: Loaded 24500 existing records. [2025-09-30T19:21:04.983935] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T19:21:05.055685] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-30T19:21:05.088903] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-30T19:21:05.094971] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-30T19:21:05.113189] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-30T19:21:05.119357] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-30T19:21:05.159737] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:05.160445] [DEBUG] [LOCAL ] IGA: Trimmed 13690 records to 9775 (keeping 200 days of data) [2025-09-30T19:21:05.160712] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-30T19:21:05.161141] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-30T19:21:05.161488] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-30T19:21:05.161558] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-30T19:21:05.579899] [DEBUG] [LOCAL ] IGA: Primary data saved (9775 records). [2025-09-30T19:21:05.595342] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-30T19:21:05.605733] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGA took 48.1s. Estimated remaining: 2h 43m 14s. Rate: 7.8 symbols/min [2025-09-30T19:21:05.776059] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:05.864885] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-30T19:21:05.869242] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:05.929944] [DEBUG] [LOCAL ] IHS: Loaded 38991 existing records from primary storage. [2025-09-30T19:21:05.930303] [INFO ] [MAIN ] IHS: Loaded 38991 existing records. [2025-09-30T19:21:06.142780] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:06.142997] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-30T19:21:06.143047] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-30T19:21:06.143291] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-30T19:21:06.143350] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-30T19:21:06.562216] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:06.636953] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T19:21:06.655569] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-30T19:21:06.660154] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T19:21:06.667513] [INFO ] [REMOTE ] IGR: Full fetch complete (45785 records). [2025-09-30T19:21:06.667704] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-30T19:21:07.079933] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-30T19:21:07.080015] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-30T19:21:07.080821] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-30T19:21:07.080899] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-30T19:21:07.082102] [DEBUG] [LOCAL ] IGR: Trimmed 45785 records to 30505 (keeping 200 days of data) [2025-09-30T19:21:07.271709] [DEBUG] [LOCAL ] IGR: Primary data saved (30505 records). [2025-09-30T19:21:07.271864] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-30T19:21:07.272463] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IGR took 29.1s. Estimated remaining: 2h 42m 59s. Rate: 7.8 symbols/min [2025-09-30T19:21:07.459526] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-30T19:21:07.463992] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:07.475935] [DEBUG] [LOCAL ] IIF: Loaded 5715 existing records from primary storage. [2025-09-30T19:21:07.476206] [INFO ] [MAIN ] IIF: Loaded 5715 existing records. [2025-09-30T19:21:07.681896] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:07.682337] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-30T19:21:07.682439] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-30T19:21:07.682686] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-30T19:21:07.682750] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-30T19:21:07.844138] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-30T19:21:08.077281] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:08.254387] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-30T19:21:09.044494] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-30T19:21:09.054315] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-30T19:21:09.143020] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-30T19:21:09.556034] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-30T19:21:09.854419] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-30T19:21:10.654564] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-30T19:21:10.989829] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-30T19:21:11.430428] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T19:21:11.454374] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-30T19:21:12.254390] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-30T19:21:12.308007] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T19:21:13.054317] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-30T19:21:13.307013] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T19:21:13.847436] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-30T19:21:13.854310] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-30T19:21:14.654361] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-30T19:21:14.995119] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T19:21:15.259487] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T19:21:15.454362] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-30T19:21:16.254357] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-30T19:21:16.616745] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-30T19:21:17.054382] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-30T19:21:17.264672] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T19:21:17.821361] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T19:21:17.854394] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-30T19:21:18.520877] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-30T19:21:18.654391] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-30T19:21:19.431693] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T19:21:19.454421] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-30T19:21:20.040356] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T19:21:20.254393] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-30T19:21:21.054373] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-30T19:21:21.700246] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T19:21:21.854347] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-30T19:21:22.397546] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-30T19:21:22.654366] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-30T19:21:23.460386] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-30T19:21:23.484220] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T19:21:23.905976] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T19:21:24.259628] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-30T19:21:24.263621] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-30T19:21:25.054448] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-30T19:21:25.479322] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T19:21:25.848624] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T19:21:25.854302] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-30T19:21:26.457261] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-30T19:21:26.654376] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-30T19:21:27.454328] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-30T19:21:27.613072] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T19:21:28.254366] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-30T19:21:28.363164] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T19:21:28.365390] [INFO ] [REMOTE ] IHD: Full fetch complete (11839 records). [2025-09-30T19:21:28.365462] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-30T19:21:28.758858] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-30T19:21:28.758952] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-30T19:21:28.759269] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-30T19:21:28.759316] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-30T19:21:28.759834] [DEBUG] [LOCAL ] IHD: Trimmed 11839 records to 6983 (keeping 200 days of data) [2025-09-30T19:21:28.803032] [DEBUG] [LOCAL ] IHD: Primary data saved (6983 records). [2025-09-30T19:21:28.803178] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-30T19:21:28.803266] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IHD took 27.4s. Estimated remaining: 2h 43m 8s. Rate: 7.8 symbols/min [2025-09-30T19:21:28.992362] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:29.011808] [DEBUG] [LOCAL ] IIIN: Loaded 16511 existing records from primary storage. [2025-09-30T19:21:29.012060] [INFO ] [MAIN ] IIIN: Loaded 16511 existing records. [2025-09-30T19:21:29.059913] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-30T19:21:29.216046] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:29.216260] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-30T19:21:29.216309] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-30T19:21:29.216537] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-30T19:21:29.216606] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-30T19:21:29.635274] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:29.642326] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T19:21:29.683959] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:21:29.854346] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-30T19:21:30.654379] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-30T19:21:30.999535] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-30T19:21:31.454362] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-30T19:21:31.769051] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-30T19:21:31.798728] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T19:21:32.254363] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-30T19:21:33.054416] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-30T19:21:33.690088] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-30T19:21:33.743730] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-30T19:21:33.854352] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-30T19:21:34.654361] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-30T19:21:35.213270] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-30T19:21:35.220472] [INFO ] [REMOTE ] IHS: Full fetch complete (51979 records). [2025-09-30T19:21:35.220593] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-30T19:21:35.347540] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T19:21:35.459454] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-30T19:21:35.689889] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-30T19:21:35.689979] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-30T19:21:35.690900] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-30T19:21:35.691016] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-30T19:21:35.692321] [DEBUG] [LOCAL ] IHS: Trimmed 51979 records to 39106 (keeping 200 days of data) [2025-09-30T19:21:35.918610] [DEBUG] [LOCAL ] IHS: Primary data saved (39106 records). [2025-09-30T19:21:35.918823] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-30T19:21:35.918957] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHS took 30.3s. Estimated remaining: 2h 42m 59s. Rate: 7.8 symbols/min [2025-09-30T19:21:36.037264] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-30T19:21:36.055031] [INFO ] [REMOTE ] IIF: Full fetch complete (9469 records). [2025-09-30T19:21:36.065438] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-30T19:21:36.202002] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:36.256369] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-30T19:21:36.408848] [DEBUG] [LOCAL ] IIM: Loaded 15934 existing records from primary storage. [2025-09-30T19:21:36.441274] [INFO ] [MAIN ] IIM: Loaded 15934 existing records. [2025-09-30T19:21:36.715300] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-30T19:21:36.732942] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-30T19:21:36.744631] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-30T19:21:36.753459] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-30T19:21:36.781620] [DEBUG] [LOCAL ] IIF: Trimmed 9469 records to 5721 (keeping 200 days of data) [2025-09-30T19:21:36.781247] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:36.782057] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-30T19:21:36.782528] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-30T19:21:36.782857] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-30T19:21:36.782928] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-30T19:21:36.942199] [DEBUG] [LOCAL ] IIF: Primary data saved (5721 records). [2025-09-30T19:21:36.948319] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-30T19:21:36.953625] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IIF took 29.7s. Estimated remaining: 2h 42m 44s. Rate: 7.8 symbols/min [2025-09-30T19:21:37.061631] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-30T19:21:37.339404] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:37.432954] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:37.456555] [DEBUG] [LOCAL ] IIPR: Loaded 29651 existing records from primary storage. [2025-09-30T19:21:37.456904] [INFO ] [MAIN ] IIPR: Loaded 29651 existing records. [2025-09-30T19:21:37.616287] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T19:21:37.681283] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:37.681514] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-30T19:21:37.681563] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-30T19:21:37.681939] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-30T19:21:37.682003] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-30T19:21:37.866816] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-30T19:21:38.071210] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:38.090853] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T19:21:38.654389] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-30T19:21:38.732595] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T19:21:39.454370] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-30T19:21:40.124042] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-30T19:21:40.254368] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-30T19:21:40.595987] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T19:21:41.054370] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-30T19:21:41.723453] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T19:21:41.854369] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-30T19:21:42.140808] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-30T19:21:42.654404] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-30T19:21:43.127923] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-30T19:21:43.132972] [INFO ] [REMOTE ] IHG: Full fetch complete (33728 records). [2025-09-30T19:21:43.133116] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-30T19:21:43.455904] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-30T19:21:43.573917] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-30T19:21:43.574027] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-30T19:21:43.574840] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-30T19:21:43.574906] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-30T19:21:43.575863] [DEBUG] [LOCAL ] IHG: Trimmed 33728 records to 24441 (keeping 200 days of data) [2025-09-30T19:21:43.688699] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T19:21:43.757592] [DEBUG] [LOCAL ] IHG: Primary data saved (24441 records). [2025-09-30T19:21:43.757774] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-30T19:21:43.757888] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IHG took 39.5s. Estimated remaining: 2h 42m 35s. Rate: 7.8 symbols/min [2025-09-30T19:21:43.943151] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:21:43.991622] [DEBUG] [LOCAL ] IMAX: Loaded 42742 existing records from primary storage. [2025-09-30T19:21:43.991963] [INFO ] [MAIN ] IMAX: Loaded 42742 existing records. [2025-09-30T19:21:44.186300] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:21:44.186533] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-30T19:21:44.186579] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-30T19:21:44.187025] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-30T19:21:44.187115] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-30T19:21:44.259470] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-30T19:21:44.606452] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:21:44.881597] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T19:21:45.054374] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-30T19:21:45.423606] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T19:21:45.854346] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-30T19:21:46.441471] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T19:21:46.462539] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-30T19:21:46.654354] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-30T19:21:47.454366] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-30T19:21:47.783094] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T19:21:48.254398] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-30T19:21:48.956240] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T19:21:49.054406] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-30T19:21:49.263031] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T19:21:49.854351] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-30T19:21:50.478470] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T19:21:50.654373] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-30T19:21:50.855461] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-30T19:21:51.454359] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-30T19:21:51.630706] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T19:21:52.254352] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-30T19:21:52.521844] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T19:21:53.054374] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-30T19:21:53.274847] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T19:21:53.854352] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-30T19:21:54.491444] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T19:21:54.654373] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-30T19:21:55.399675] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:21:55.454366] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-30T19:21:55.754234] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T19:21:56.254363] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-30T19:21:56.985929] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T19:21:57.054381] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-30T19:21:57.184242] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T19:21:57.854356] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-30T19:21:57.897483] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-30T19:21:58.654344] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-30T19:21:59.046944] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T19:21:59.454360] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-30T19:21:59.576092] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T19:22:00.254359] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-30T19:22:00.656610] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T19:22:01.054388] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-30T19:22:01.251814] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-30T19:22:01.256582] [INFO ] [REMOTE ] IIIN: Full fetch complete (24988 records). [2025-09-30T19:22:01.256793] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-30T19:22:01.710547] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-30T19:22:01.710734] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-30T19:22:01.711508] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-30T19:22:01.711590] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-30T19:22:01.725064] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-30T19:22:01.725199] [DEBUG] [LOCAL ] IIIN: Trimmed 24988 records to 16449 (keeping 200 days of data) [2025-09-30T19:22:01.840103] [DEBUG] [LOCAL ] IIIN: Primary data saved (16449 records). [2025-09-30T19:22:01.840265] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-30T19:22:01.840357] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIIN took 33.0s. Estimated remaining: 2h 42m 39s. Rate: 7.8 symbols/min [2025-09-30T19:22:01.863276] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-30T19:22:02.047558] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:02.104098] [DEBUG] [LOCAL ] INFA: Loaded 49743 existing records from primary storage. [2025-09-30T19:22:02.104557] [INFO ] [MAIN ] INFA: Loaded 49743 existing records. [2025-09-30T19:22:02.333884] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:02.334125] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-30T19:22:02.334175] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-30T19:22:02.334720] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-30T19:22:02.334781] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-30T19:22:02.659486] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-30T19:22:02.762921] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:03.391039] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T19:22:03.454365] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-30T19:22:03.905770] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:22:03.910275] [INFO ] [REMOTE ] IIM: Full fetch complete (25346 records). [2025-09-30T19:22:03.910427] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-30T19:22:04.259452] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-30T19:22:04.332993] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-30T19:22:04.333084] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-30T19:22:04.333700] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-30T19:22:04.333767] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-30T19:22:04.334566] [DEBUG] [LOCAL ] IIM: Trimmed 25346 records to 15962 (keeping 200 days of data) [2025-09-30T19:22:04.450607] [DEBUG] [LOCAL ] IIM: Primary data saved (15962 records). [2025-09-30T19:22:04.451097] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-30T19:22:04.451396] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIM took 28.5s. Estimated remaining: 2h 42m 26s. Rate: 7.8 symbols/min [2025-09-30T19:22:04.649159] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:04.670621] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-30T19:22:04.736583] [DEBUG] [LOCAL ] INFY: Loaded 53598 existing records from primary storage. [2025-09-30T19:22:04.736963] [INFO ] [MAIN ] INFY: Loaded 53598 existing records. [2025-09-30T19:22:04.939541] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:04.939845] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-30T19:22:04.939909] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-30T19:22:04.940512] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-30T19:22:04.940574] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-30T19:22:05.059517] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-30T19:22:05.354316] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:05.790868] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T19:22:05.854332] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-30T19:22:06.564287] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T19:22:06.654361] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-30T19:22:07.454368] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-30T19:22:07.535046] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:22:07.974810] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T19:22:08.254394] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-30T19:22:08.868540] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T19:22:09.054401] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-30T19:22:09.834888] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T19:22:09.854302] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-30T19:22:10.488806] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T19:22:10.654379] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-30T19:22:11.407102] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T19:22:11.416956] [INFO ] [REMOTE ] IMAX: Full fetch complete (59731 records). [2025-09-30T19:22:11.417121] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-30T19:22:11.463873] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-30T19:22:11.877441] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-30T19:22:11.877574] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-30T19:22:11.879241] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-30T19:22:11.879322] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-30T19:22:11.880910] [DEBUG] [LOCAL ] IMAX: Trimmed 59731 records to 42737 (keeping 200 days of data) [2025-09-30T19:22:12.150807] [DEBUG] [LOCAL ] IMAX: Primary data saved (42737 records). [2025-09-30T19:22:12.150953] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-30T19:22:12.151153] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IMAX took 28.4s. Estimated remaining: 2h 42m 18s. Rate: 7.8 symbols/min [2025-09-30T19:22:12.259839] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-30T19:22:12.355677] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:12.378045] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T19:22:12.440339] [DEBUG] [LOCAL ] ING: Loaded 50745 existing records from primary storage. [2025-09-30T19:22:12.440703] [INFO ] [MAIN ] ING: Loaded 50745 existing records. [2025-09-30T19:22:12.640282] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:12.640854] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-30T19:22:12.640978] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-30T19:22:12.642082] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-30T19:22:12.642324] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-30T19:22:12.753363] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-30T19:22:12.790929] [INFO ] [REMOTE ] IIPR: Full fetch complete (44441 records). [2025-09-30T19:22:12.796782] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-30T19:22:13.055619] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-30T19:22:13.403369] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:13.516819] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-30T19:22:13.516953] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-30T19:22:13.518316] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-30T19:22:13.518401] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-30T19:22:13.520758] [DEBUG] [LOCAL ] IIPR: Trimmed 44441 records to 29709 (keeping 200 days of data) [2025-09-30T19:22:13.659852] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T19:22:13.758265] [DEBUG] [LOCAL ] IIPR: Primary data saved (29709 records). [2025-09-30T19:22:13.758423] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-30T19:22:13.758555] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. IIPR took 36.8s. Estimated remaining: 2h 42m 3s. Rate: 7.8 symbols/min [2025-09-30T19:22:13.859442] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-30T19:22:13.948971] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:13.987247] [DEBUG] [LOCAL ] INGM: Loaded 28641 existing records from primary storage. [2025-09-30T19:22:13.987561] [INFO ] [MAIN ] INGM: Loaded 28641 existing records. [2025-09-30T19:22:14.183940] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:14.184178] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-30T19:22:14.184229] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-30T19:22:14.184547] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-30T19:22:14.184621] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-30T19:22:14.592543] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:14.623353] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T19:22:14.654385] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-30T19:22:15.279208] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:22:15.454378] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-30T19:22:16.254345] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-30T19:22:16.324533] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T19:22:17.022808] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T19:22:17.054386] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-30T19:22:17.799572] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:22:17.854346] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-30T19:22:18.654386] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-30T19:22:18.718713] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T19:22:19.454325] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-30T19:22:19.885201] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-30T19:22:20.254402] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-30T19:22:20.330310] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T19:22:21.054366] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-30T19:22:21.280012] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:22:21.854357] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-30T19:22:22.157353] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T19:22:22.401044] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T19:22:22.654402] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-30T19:22:23.069688] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T19:22:23.454377] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-30T19:22:24.254379] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-30T19:22:24.401743] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-30T19:22:24.900247] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T19:22:25.054380] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-30T19:22:25.457092] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T19:22:25.854355] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-30T19:22:26.654348] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-30T19:22:26.872740] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T19:22:26.901433] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-30T19:22:27.454421] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-30T19:22:28.088431] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-30T19:22:28.254375] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-30T19:22:28.867747] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T19:22:29.054373] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-30T19:22:29.854403] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-30T19:22:29.964449] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:22:30.413381] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T19:22:30.654416] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-30T19:22:31.454335] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-30T19:22:31.713926] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T19:22:31.901617] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T19:22:32.254408] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-30T19:22:32.842696] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T19:22:32.854685] [INFO ] [REMOTE ] INFA: Full fetch complete (71521 records). [2025-09-30T19:22:32.854865] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-30T19:22:33.060541] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-30T19:22:33.298521] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-30T19:22:33.298619] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-30T19:22:33.299732] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-30T19:22:33.299803] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-30T19:22:33.301476] [DEBUG] [LOCAL ] INFA: Trimmed 71521 records to 49666 (keeping 200 days of data) [2025-09-30T19:22:33.620437] [DEBUG] [LOCAL ] INFA: Primary data saved (49666 records). [2025-09-30T19:22:33.620581] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-30T19:22:33.620707] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. INFA took 31.8s. Estimated remaining: 2h 42m 10s. Rate: 7.8 symbols/min [2025-09-30T19:22:33.825196] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:33.861960] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-30T19:22:33.865102] [DEBUG] [LOCAL ] INGR: Loaded 33254 existing records from primary storage. [2025-09-30T19:22:33.865763] [INFO ] [MAIN ] INGR: Loaded 33254 existing records. [2025-09-30T19:22:34.059744] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:34.060085] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-30T19:22:34.060143] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-30T19:22:34.060830] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-30T19:22:34.060899] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-30T19:22:34.213920] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T19:22:34.552920] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:34.654376] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-30T19:22:34.788415] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T19:22:35.008358] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T19:22:35.454430] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-30T19:22:36.254418] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-30T19:22:36.613001] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T19:22:36.675940] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-30T19:22:37.054432] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-30T19:22:37.854374] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-30T19:22:38.016774] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T19:22:38.211088] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T19:22:38.654393] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-30T19:22:38.710024] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T19:22:39.454423] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-30T19:22:40.208017] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T19:22:40.226847] [INFO ] [REMOTE ] INFY: Full fetch complete (77544 records). [2025-09-30T19:22:40.227130] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-30T19:22:40.259550] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-30T19:22:40.697994] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-30T19:22:40.698107] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-30T19:22:40.699251] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-30T19:22:40.699338] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-30T19:22:40.701018] [DEBUG] [LOCAL ] INFY: Trimmed 77544 records to 53598 (keeping 200 days of data) [2025-09-30T19:22:41.057001] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-30T19:22:41.079464] [DEBUG] [LOCAL ] INFY: Primary data saved (53598 records). [2025-09-30T19:22:41.079833] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-30T19:22:41.080103] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INFY took 36.6s. Estimated remaining: 2h 42m 2s. Rate: 7.8 symbols/min [2025-09-30T19:22:41.156387] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T19:22:41.291551] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:41.341515] [DEBUG] [LOCAL ] INN: Loaded 41816 existing records from primary storage. [2025-09-30T19:22:41.341919] [INFO ] [MAIN ] INN: Loaded 41816 existing records. [2025-09-30T19:22:41.564682] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:41.564966] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-30T19:22:41.565037] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-30T19:22:41.565639] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-30T19:22:41.565752] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-30T19:22:41.856918] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-30T19:22:42.060722] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:42.170956] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-30T19:22:42.462359] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:22:42.469043] [INFO ] [REMOTE ] INGM: Full fetch complete (42471 records). [2025-09-30T19:22:42.469160] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-30T19:22:42.664285] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-30T19:22:42.897531] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-30T19:22:42.897623] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-30T19:22:42.898416] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-30T19:22:42.898479] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-30T19:22:42.899539] [DEBUG] [LOCAL ] INGM: Trimmed 42471 records to 28628 (keeping 200 days of data) [2025-09-30T19:22:43.088118] [DEBUG] [LOCAL ] INGM: Primary data saved (28628 records). [2025-09-30T19:22:43.088328] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-30T19:22:43.089251] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INGM took 29.3s. Estimated remaining: 2h 41m 47s. Rate: 7.8 symbols/min [2025-09-30T19:22:43.272699] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:43.272911] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-30T19:22:43.273037] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-30T19:22:43.273207] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-30T19:22:43.273276] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-30T19:22:43.273327] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-30T19:22:43.273361] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-30T19:22:43.463184] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-30T19:22:43.611196] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T19:22:43.718347] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:43.885554] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:22:44.254393] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-30T19:22:44.488457] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:22:44.488924] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-30T19:22:44.489095] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:22:44.489205] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-09-30T19:22:44.489271] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:22:44.489342] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-30T19:22:44.489408] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-30T19:22:44.489447] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-30T19:22:44.489486] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-30T19:22:44.489534] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INR took 1.4s. Estimated remaining: 2h 41m 33s. Rate: 7.8 symbols/min [2025-09-30T19:22:44.684381] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:44.743778] [DEBUG] [LOCAL ] INSP: Loaded 36932 existing records from primary storage. [2025-09-30T19:22:44.744114] [INFO ] [MAIN ] INSP: Loaded 36932 existing records. [2025-09-30T19:22:44.950052] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:44.950324] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-30T19:22:44.950378] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-30T19:22:44.950794] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-30T19:22:44.950854] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-30T19:22:45.056157] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-30T19:22:45.359284] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:45.390584] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T19:22:45.406529] [INFO ] [REMOTE ] ING: Full fetch complete (73622 records). [2025-09-30T19:22:45.406947] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-30T19:22:45.859980] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-30T19:22:45.885113] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-30T19:22:45.885195] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-30T19:22:45.886246] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-30T19:22:45.886316] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-30T19:22:45.888016] [DEBUG] [LOCAL ] ING: Trimmed 73622 records to 50722 (keeping 200 days of data) [2025-09-30T19:22:46.207661] [DEBUG] [LOCAL ] ING: Primary data saved (50722 records). [2025-09-30T19:22:46.207803] [INFO ] [MAIN ] ING: Full history saved. [2025-09-30T19:22:46.207886] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. ING took 34.1s. Estimated remaining: 2h 41m 18s. Rate: 7.8 symbols/min [2025-09-30T19:22:46.395994] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:22:46.439883] [DEBUG] [LOCAL ] INSW: Loaded 40136 existing records from primary storage. [2025-09-30T19:22:46.440273] [INFO ] [MAIN ] INSW: Loaded 40136 existing records. [2025-09-30T19:22:46.648575] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:22:46.649016] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-30T19:22:46.649228] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-30T19:22:46.649933] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-30T19:22:46.650045] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-30T19:22:46.655285] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-30T19:22:46.801106] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T19:22:47.090120] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:22:47.350717] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T19:22:47.454359] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-30T19:22:48.018618] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T19:22:48.254410] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-30T19:22:48.979617] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T19:22:49.054383] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-30T19:22:49.686481] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T19:22:49.854392] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-30T19:22:50.328815] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-30T19:22:50.654361] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-30T19:22:51.264554] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T19:22:51.454401] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-30T19:22:52.241098] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T19:22:52.254308] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-30T19:22:53.054436] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-30T19:22:53.854376] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-30T19:23:05.438295] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (11.58 seconds). [2025-09-30T19:23:05.445989] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-30T19:23:05.796422] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (12.74 seconds). [2025-09-30T19:23:05.804881] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-30T19:23:06.425537] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (14.17 seconds). [2025-09-30T19:23:06.435851] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-30T19:23:07.096867] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (15.64 seconds). [2025-09-30T19:23:07.105386] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-30T19:23:07.146281] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-30T19:23:07.153837] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-30T19:23:08.117757] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T19:23:08.127129] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-30T19:23:08.326044] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-09-30T19:23:08.333966] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-30T19:23:08.404382] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-30T19:23:08.416186] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-30T19:23:08.709455] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T19:23:08.719973] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-30T19:23:09.478381] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-30T19:23:09.507117] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-30T19:23:09.508773] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:23:09.517857] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-30T19:23:09.769428] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:23:09.779196] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-30T19:23:10.304631] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-30T19:23:10.315918] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-30T19:23:10.430457] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-30T19:23:10.438486] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-30T19:23:10.776244] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-30T19:23:10.783989] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-30T19:23:11.477716] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T19:23:11.487437] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-30T19:23:11.964864] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T19:23:11.975274] [INFO ] [REMOTE ] INGR: Full fetch complete (50065 records). [2025-09-30T19:23:11.975535] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-30T19:23:12.164084] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T19:23:12.269564] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-30T19:23:12.496468] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-30T19:23:12.506333] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-30T19:23:12.507444] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-30T19:23:12.507557] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-30T19:23:12.510732] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T19:23:12.521021] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-30T19:23:12.521183] [DEBUG] [LOCAL ] INGR: Trimmed 50065 records to 33275 (keeping 200 days of data) [2025-09-30T19:23:12.754444] [DEBUG] [LOCAL ] INGR: Primary data saved (33275 records). [2025-09-30T19:23:12.754674] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-30T19:23:12.754812] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INGR took 39.1s. Estimated remaining: 2h 41m 32s. Rate: 7.8 symbols/min [2025-09-30T19:23:12.955295] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:13.023010] [DEBUG] [LOCAL ] INVH: Loaded 53135 existing records from primary storage. [2025-09-30T19:23:13.023398] [INFO ] [MAIN ] INVH: Loaded 53135 existing records. [2025-09-30T19:23:13.256536] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T19:23:13.266422] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:13.275407] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-30T19:23:13.275522] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-30T19:23:13.276708] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-30T19:23:13.276822] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-30T19:23:13.276605] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-30T19:23:13.706436] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:13.706999] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-30T19:23:13.736683] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T19:23:13.747177] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-30T19:23:14.390610] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-30T19:23:14.403866] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-30T19:23:14.952625] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:23:14.962453] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-30T19:23:15.035126] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T19:23:15.044500] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-30T19:23:15.201384] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T19:23:15.212973] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-30T19:23:15.972105] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:23:15.982792] [INFO ] [REMOTE ] INSP: Full fetch complete (52837 records). [2025-09-30T19:23:15.982945] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-30T19:23:16.414133] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-30T19:23:16.414256] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-30T19:23:16.415142] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-30T19:23:16.415224] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-30T19:23:16.416734] [DEBUG] [LOCAL ] INSP: Trimmed 52837 records to 37045 (keeping 200 days of data) [2025-09-30T19:23:16.566194] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T19:23:16.583193] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-30T19:23:16.669748] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-30T19:23:16.709030] [INFO ] [REMOTE ] INN: Full fetch complete (57808 records). [2025-09-30T19:23:16.716725] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-30T19:23:16.914486] [DEBUG] [LOCAL ] INSP: Primary data saved (37045 records). [2025-09-30T19:23:16.921883] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-30T19:23:16.923208] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INSP took 32.4s. Estimated remaining: 2h 41m 20s. Rate: 7.8 symbols/min [2025-09-30T19:23:17.204767] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-30T19:23:17.295887] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-30T19:23:17.358316] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:17.434417] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-30T19:23:17.434506] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-30T19:23:17.435348] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-30T19:23:17.435417] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-30T19:23:17.436826] [DEBUG] [LOCAL ] INN: Trimmed 57808 records to 41730 (keeping 200 days of data) [2025-09-30T19:23:17.562088] [DEBUG] [LOCAL ] INVX: Loaded 29009 existing records from primary storage. [2025-09-30T19:23:17.566313] [INFO ] [MAIN ] INVX: Loaded 29009 existing records. [2025-09-30T19:23:17.775225] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:17.778329] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-30T19:23:17.778505] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-30T19:23:17.779034] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-30T19:23:17.779113] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-30T19:23:18.089049] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T19:23:18.150965] [INFO ] [REMOTE ] INSW: Full fetch complete (60605 records). [2025-09-30T19:23:18.175464] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-30T19:23:18.446620] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:18.453360] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-30T19:23:18.498408] [DEBUG] [LOCAL ] INN: Primary data saved (41730 records). [2025-09-30T19:23:18.504178] [INFO ] [MAIN ] INN: Full history saved. [2025-09-30T19:23:18.524503] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INN took 37.4s. Estimated remaining: 2h 41m 5s. Rate: 7.8 symbols/min [2025-09-30T19:23:18.896978] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:18.977273] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-30T19:23:18.977394] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-30T19:23:18.978585] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-30T19:23:18.978766] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-30T19:23:18.991392] [DEBUG] [LOCAL ] INSW: Trimmed 60605 records to 40060 (keeping 200 days of data) [2025-09-30T19:23:19.018540] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T19:23:19.083496] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-30T19:23:19.186513] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-30T19:23:19.194004] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-09-30T19:23:19.514566] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:19.515629] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-30T19:23:19.516307] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-30T19:23:19.519244] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-30T19:23:19.519578] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-30T19:23:19.980496] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:19.981020] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-30T19:23:19.980711] [DEBUG] [LOCAL ] INSW: Primary data saved (40060 records). [2025-09-30T19:23:19.982237] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-30T19:23:19.982365] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INSW took 33.8s. Estimated remaining: 2h 40m 51s. Rate: 7.8 symbols/min [2025-09-30T19:23:20.099250] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T19:23:20.108027] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-30T19:23:20.877070] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:23:20.889829] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-30T19:23:21.476189] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T19:23:21.484179] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-30T19:23:22.272814] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T19:23:22.285141] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-30T19:23:22.413763] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T19:23:22.420471] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-30T19:23:22.688596] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-30T19:23:22.700181] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-30T19:23:23.406257] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-30T19:23:23.454412] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-30T19:23:24.109778] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T19:23:24.254407] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-30T19:23:24.897364] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T19:23:25.054330] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-30T19:23:25.387906] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-30T19:23:25.854369] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-30T19:23:25.927043] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T19:23:26.318012] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T19:23:26.654566] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-30T19:23:27.454411] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-30T19:23:27.946557] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T19:23:28.259457] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-30T19:23:28.280813] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-30T19:23:29.003720] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T19:23:29.054381] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-30T19:23:29.252058] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T19:23:29.854402] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-30T19:23:30.654404] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-30T19:23:31.472987] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-30T19:23:31.485337] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-30T19:23:31.682714] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T19:23:31.751464] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T19:23:32.254343] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-30T19:23:33.054423] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-30T19:23:33.785137] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-30T19:23:33.797051] [INFO ] [REMOTE ] INVH: Full fetch complete (76726 records). [2025-09-30T19:23:33.797262] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-30T19:23:34.266322] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-30T19:23:34.266608] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-30T19:23:34.267729] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-30T19:23:34.268027] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-30T19:23:34.290192] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T19:23:34.288023] [DEBUG] [LOCAL ] INVH: Trimmed 76726 records to 53130 (keeping 200 days of data) [2025-09-30T19:23:34.297521] [INFO ] [REMOTE ] INVX: Full fetch complete (44239 records). [2025-09-30T19:23:34.297752] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-30T19:23:34.515160] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-09-30T19:23:34.578583] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-30T19:23:34.928473] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-30T19:23:34.929755] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-30T19:23:34.931481] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-30T19:23:34.931568] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-30T19:23:34.937222] [DEBUG] [LOCAL ] INVX: Trimmed 44239 records to 29027 (keeping 200 days of data) [2025-09-30T19:23:35.255526] [DEBUG] [LOCAL ] INVX: Primary data saved (29027 records). [2025-09-30T19:23:35.256150] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-30T19:23:35.256279] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVX took 18.3s. Estimated remaining: 2h 40m 52s. Rate: 7.8 symbols/min [2025-09-30T19:23:35.358601] [DEBUG] [LOCAL ] INVH: Primary data saved (53130 records). [2025-09-30T19:23:35.358793] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-30T19:23:35.358901] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. INVH took 22.6s. Estimated remaining: 2h 40m 35s. Rate: 7.8 symbols/min [2025-09-30T19:23:37.409533] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-30T19:23:37.422667] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-30T19:23:39.928769] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-30T19:23:39.941009] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-30T19:23:42.718347] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-30T19:23:42.731922] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-30T19:23:45.432968] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-30T19:23:45.445367] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-30T19:23:48.257443] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-30T19:23:48.271636] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-30T19:23:48.271875] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-30T19:23:48.707741] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-30T19:23:48.707843] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-30T19:23:48.708995] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-30T19:23:48.709107] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-30T19:23:48.711028] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-09-30T19:23:49.091577] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-09-30T19:23:49.091767] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-30T19:23:49.091867] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 30.6s. Estimated remaining: 2h 40m 34s. Rate: 7.8 symbols/min [2025-09-30T19:23:49.692980] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:49.814041] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:49.900528] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:49.942057] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:23:49.962699] [DEBUG] [LOCAL ] IPI: Loaded 21413 existing records from primary storage. [2025-09-30T19:23:49.963001] [INFO ] [MAIN ] IPI: Loaded 21413 existing records. [2025-09-30T19:23:50.125574] [DEBUG] [LOCAL ] IOT: Loaded 53470 existing records from primary storage. [2025-09-30T19:23:50.151189] [INFO ] [MAIN ] IOT: Loaded 53470 existing records. [2025-09-30T19:23:50.278987] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:50.348492] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-30T19:23:50.365267] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-30T19:23:50.373887] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-09-30T19:23:50.380045] [DEBUG] [LOCAL ] IP: Loaded 53313 existing records from primary storage. [2025-09-30T19:23:50.380559] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-30T19:23:50.380420] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-09-30T19:23:50.380807] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-30T19:23:50.386705] [INFO ] [MAIN ] IP: Loaded 53313 existing records. [2025-09-30T19:23:50.691032] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:50.815868] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-30T19:23:50.867012] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-30T19:23:51.034548] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-30T19:23:51.087879] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:51.079955] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:23:51.098019] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-30T19:23:51.111327] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-30T19:23:51.106068] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-30T19:23:51.088000] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-30T19:23:51.122851] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-30T19:23:51.133942] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-30T19:23:51.155380] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-30T19:23:51.155574] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-30T19:23:51.155696] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-30T19:23:51.805570] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:51.930184] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-30T19:23:52.503768] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:52.590123] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-30T19:23:52.584317] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:52.591471] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-30T19:23:52.589817] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:23:52.592836] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-30T19:23:53.167528] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T19:23:53.171804] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-30T19:23:54.059101] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-30T19:23:54.063424] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-30T19:23:54.123918] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T19:23:54.135288] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-30T19:23:54.356478] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T19:23:54.368471] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-30T19:23:54.439493] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T19:23:54.456959] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-30T19:23:54.770453] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-30T19:23:54.775075] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-30T19:23:55.690168] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T19:23:55.701297] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-30T19:23:55.744958] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-30T19:23:55.750790] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-30T19:23:55.837019] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T19:23:55.847936] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-30T19:23:56.193093] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T19:23:56.204068] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-30T19:23:56.524565] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-30T19:23:56.530233] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-30T19:23:56.940698] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-30T19:23:56.951830] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-30T19:23:57.483519] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-30T19:23:57.494976] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-30T19:23:57.542828] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-30T19:23:57.549318] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-30T19:23:58.003615] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T19:23:58.014361] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-30T19:23:58.695919] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T19:23:58.701159] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-30T19:23:58.876445] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T19:23:58.890391] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-30T19:23:58.927434] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T19:23:58.941239] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-30T19:23:59.641454] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-30T19:23:59.646447] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-30T19:23:59.984080] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T19:23:59.996772] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-30T19:24:00.547448] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T19:24:00.562336] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-30T19:24:00.673050] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T19:24:00.685165] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-30T19:24:00.849048] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-30T19:24:00.853946] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-30T19:24:01.672250] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:24:01.684331] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-30T19:24:02.038799] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-30T19:24:02.044870] [INFO ] [REMOTE ] IPI: Full fetch complete (29363 records). [2025-09-30T19:24:02.045034] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-30T19:24:02.317684] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T19:24:02.409911] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-30T19:24:02.488355] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-30T19:24:02.525779] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-30T19:24:02.601491] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-30T19:24:02.601613] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-30T19:24:02.602433] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-30T19:24:02.602502] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-30T19:24:02.603490] [DEBUG] [LOCAL ] IPI: Trimmed 29363 records to 21401 (keeping 200 days of data) [2025-09-30T19:24:02.739127] [DEBUG] [LOCAL ] IPI: Primary data saved (21401 records). [2025-09-30T19:24:02.739270] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-30T19:24:02.739355] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IPI took 13.6s. Estimated remaining: 2h 40m 33s. Rate: 7.8 symbols/min [2025-09-30T19:24:02.931294] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:02.952104] [DEBUG] [LOCAL ] IQI: Loaded 18003 existing records from primary storage. [2025-09-30T19:24:02.952419] [INFO ] [MAIN ] IQI: Loaded 18003 existing records. [2025-09-30T19:24:03.157899] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:03.158349] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-30T19:24:03.158463] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-30T19:24:03.159099] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-30T19:24:03.159241] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-30T19:24:03.327957] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:24:03.389578] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-30T19:24:03.628741] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:03.629086] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-30T19:24:03.879813] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T19:24:03.891899] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-30T19:24:04.422247] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-30T19:24:04.435023] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-30T19:24:04.601980] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T19:24:04.862785] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-30T19:24:05.054397] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-30T19:24:05.577967] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:24:05.854361] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-30T19:24:06.201501] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T19:24:06.408810] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-30T19:24:06.654412] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-30T19:24:07.454425] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-30T19:24:07.538576] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:24:08.254381] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-30T19:24:08.435293] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T19:24:09.054389] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-30T19:24:09.118450] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T19:24:09.681599] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T19:24:09.854422] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-30T19:24:10.654394] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-30T19:24:10.881133] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T19:24:11.201146] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-30T19:24:11.223454] [INFO ] [REMOTE ] IOT: Full fetch complete (77381 records). [2025-09-30T19:24:11.223722] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-30T19:24:11.459498] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-30T19:24:11.708320] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-30T19:24:11.708442] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-30T19:24:11.709560] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-30T19:24:11.709635] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-30T19:24:11.711350] [DEBUG] [LOCAL ] IOT: Trimmed 77381 records to 53470 (keeping 200 days of data) [2025-09-30T19:24:12.046667] [DEBUG] [LOCAL ] IOT: Primary data saved (53470 records). [2025-09-30T19:24:12.046905] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-30T19:24:12.047047] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IOT took 23.0s. Estimated remaining: 2h 40m 27s. Rate: 7.8 symbols/min [2025-09-30T19:24:12.239937] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:12.263872] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-30T19:24:12.291537] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T19:24:12.299726] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:24:12.312262] [INFO ] [REMOTE ] IPG: Full fetch complete (77254 records). [2025-09-30T19:24:12.312520] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-30T19:24:12.678680] [DEBUG] [LOCAL ] IQV: Loaded 50103 existing records from primary storage. [2025-09-30T19:24:12.687443] [INFO ] [MAIN ] IQV: Loaded 50103 existing records. [2025-09-30T19:24:12.911354] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-30T19:24:12.911833] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-30T19:24:12.918548] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-30T19:24:12.923820] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-30T19:24:13.000473] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:13.000886] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-30T19:24:13.000947] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-30T19:24:13.001025] [DEBUG] [LOCAL ] IPG: Trimmed 77254 records to 53330 (keeping 200 days of data) [2025-09-30T19:24:13.001740] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-30T19:24:13.001803] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-30T19:24:13.086620] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-30T19:24:13.529831] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:13.785795] [DEBUG] [LOCAL ] IPG: Primary data saved (53330 records). [2025-09-30T19:24:13.785965] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-30T19:24:13.788185] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IPG took 24.6s. Estimated remaining: 2h 40m 13s. Rate: 7.8 symbols/min [2025-09-30T19:24:13.862146] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-30T19:24:13.995684] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:14.056459] [DEBUG] [LOCAL ] IR: Loaded 52686 existing records from primary storage. [2025-09-30T19:24:14.056854] [INFO ] [MAIN ] IR: Loaded 52686 existing records. [2025-09-30T19:24:14.279554] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:14.280694] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-30T19:24:14.280844] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-30T19:24:14.282595] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-30T19:24:14.282705] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-30T19:24:14.454293] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T19:24:14.670961] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-30T19:24:14.708741] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-30T19:24:14.784105] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:14.784314] [INFO ] [REMOTE ] IP: Full fetch complete (77066 records). [2025-09-30T19:24:14.784695] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-30T19:24:15.216159] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-30T19:24:15.216262] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-30T19:24:15.217437] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-30T19:24:15.217539] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-30T19:24:15.219452] [DEBUG] [LOCAL ] IP: Trimmed 77066 records to 53313 (keeping 200 days of data) [2025-09-30T19:24:15.467275] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-30T19:24:15.478970] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T19:24:15.626284] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T19:24:15.658135] [DEBUG] [LOCAL ] IP: Primary data saved (53313 records). [2025-09-30T19:24:15.658345] [INFO ] [MAIN ] IP: Full history saved. [2025-09-30T19:24:15.659432] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IP took 26.5s. Estimated remaining: 2h 39m 59s. Rate: 7.8 symbols/min [2025-09-30T19:24:15.864240] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:15.926255] [DEBUG] [LOCAL ] IRM: Loaded 49362 existing records from primary storage. [2025-09-30T19:24:15.926675] [INFO ] [MAIN ] IRM: Loaded 49362 existing records. [2025-09-30T19:24:16.132239] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:16.132505] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-30T19:24:16.132561] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-30T19:24:16.133466] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-30T19:24:16.133535] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-30T19:24:16.259558] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-30T19:24:16.553921] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:17.054363] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-30T19:24:17.235787] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T19:24:17.289951] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T19:24:17.854380] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-30T19:24:18.565889] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-30T19:24:18.654398] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-30T19:24:19.454431] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-30T19:24:19.556076] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T19:24:20.254352] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-30T19:24:20.426022] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-30T19:24:21.054385] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-30T19:24:21.363129] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T19:24:21.362423] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-30T19:24:21.854390] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-30T19:24:22.496474] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T19:24:22.654410] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-30T19:24:23.454364] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-30T19:24:23.582554] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T19:24:23.912010] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T19:24:24.254382] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-30T19:24:25.054387] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-30T19:24:25.239400] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:24:25.280735] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T19:24:25.287238] [INFO ] [REMOTE ] IQI: Full fetch complete (27047 records). [2025-09-30T19:24:25.287382] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-30T19:24:25.719012] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-30T19:24:25.719308] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-30T19:24:25.719900] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-30T19:24:25.719972] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-30T19:24:25.720887] [DEBUG] [LOCAL ] IQI: Trimmed 27047 records to 18036 (keeping 200 days of data) [2025-09-30T19:24:25.850727] [DEBUG] [LOCAL ] IQI: Primary data saved (18036 records). [2025-09-30T19:24:25.850897] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-30T19:24:25.850990] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IQI took 23.1s. Estimated remaining: 2h 39m 54s. Rate: 7.8 symbols/min [2025-09-30T19:24:25.856354] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-30T19:24:26.070702] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:26.095558] [DEBUG] [LOCAL ] IRS: Loaded 21787 existing records from primary storage. [2025-09-30T19:24:26.095892] [INFO ] [MAIN ] IRS: Loaded 21787 existing records. [2025-09-30T19:24:26.300077] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:26.300363] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-30T19:24:26.300556] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-30T19:24:26.301451] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-30T19:24:26.301516] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-30T19:24:26.660142] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-30T19:24:26.674004] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-30T19:24:26.762791] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:27.454391] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-30T19:24:27.720595] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T19:24:28.254368] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-30T19:24:28.488821] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T19:24:28.812485] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-30T19:24:29.054340] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-30T19:24:29.854330] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-30T19:24:29.979401] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T19:24:30.457318] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T19:24:30.654412] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-30T19:24:31.454357] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-30T19:24:31.518281] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T19:24:31.591000] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T19:24:32.254383] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-30T19:24:33.054338] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-30T19:24:33.105490] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T19:24:33.854400] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-30T19:24:34.027011] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T19:24:34.113609] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T19:24:34.654388] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-30T19:24:35.219290] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-30T19:24:35.322672] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-30T19:24:35.454617] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-30T19:24:36.254416] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-30T19:24:36.516760] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T19:24:37.054361] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-30T19:24:37.854326] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-30T19:24:38.122914] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-30T19:24:38.661914] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-30T19:24:38.691981] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T19:24:38.991746] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T19:24:39.454369] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-30T19:24:40.254328] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-30T19:24:40.495684] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T19:24:41.060307] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-30T19:24:41.075588] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-30T19:24:41.341779] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-30T19:24:41.854374] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-30T19:24:42.441722] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T19:24:42.654350] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-30T19:24:43.454422] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-30T19:24:43.729574] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-30T19:24:44.254420] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-30T19:24:44.406531] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T19:24:44.550604] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T19:24:45.054382] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-30T19:24:45.850065] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T19:24:45.860620] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-30T19:24:45.863311] [INFO ] [REMOTE ] IR: Full fetch complete (76152 records). [2025-09-30T19:24:45.863583] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-30T19:24:46.305816] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T19:24:46.335179] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-30T19:24:46.335298] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-30T19:24:46.336817] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-30T19:24:46.336898] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-30T19:24:46.338406] [DEBUG] [LOCAL ] IR: Trimmed 76152 records to 52685 (keeping 200 days of data) [2025-09-30T19:24:46.660837] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-30T19:24:46.687551] [DEBUG] [LOCAL ] IR: Primary data saved (52685 records). [2025-09-30T19:24:46.687742] [INFO ] [MAIN ] IR: Full history saved. [2025-09-30T19:24:46.687844] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IR took 32.9s. Estimated remaining: 2h 40m 1s. Rate: 7.8 symbols/min [2025-09-30T19:24:46.873097] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:46.923894] [DEBUG] [LOCAL ] IRT: Loaded 50393 existing records from primary storage. [2025-09-30T19:24:46.924247] [INFO ] [MAIN ] IRT: Loaded 50393 existing records. [2025-09-30T19:24:47.128118] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:47.128756] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-30T19:24:47.128822] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-30T19:24:47.129976] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-30T19:24:47.130038] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-30T19:24:47.459443] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-30T19:24:47.531011] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:47.849882] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T19:24:47.860926] [INFO ] [REMOTE ] IRM: Full fetch complete (72239 records). [2025-09-30T19:24:47.861088] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-30T19:24:48.261524] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-30T19:24:48.306214] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-30T19:24:48.306876] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-30T19:24:48.322075] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-30T19:24:48.331904] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-30T19:24:48.353071] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-30T19:24:48.361764] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T19:24:48.373006] [DEBUG] [LOCAL ] IRM: Trimmed 72239 records to 49336 (keeping 200 days of data) [2025-09-30T19:24:48.702839] [DEBUG] [LOCAL ] IRM: Primary data saved (49336 records). [2025-09-30T19:24:48.702988] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-30T19:24:48.704612] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IRM took 33.0s. Estimated remaining: 2h 39m 47s. Rate: 7.8 symbols/min [2025-09-30T19:24:48.896811] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:48.916201] [DEBUG] [LOCAL ] ISD: Loaded 15526 existing records from primary storage. [2025-09-30T19:24:48.916515] [INFO ] [MAIN ] ISD: Loaded 15526 existing records. [2025-09-30T19:24:49.070157] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-30T19:24:49.116846] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:49.117110] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-30T19:24:49.117160] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-30T19:24:49.117724] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-30T19:24:49.117788] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-30T19:24:49.510339] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:49.686770] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T19:24:49.854323] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-30T19:24:50.654368] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-30T19:24:50.945496] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-30T19:24:50.956032] [INFO ] [REMOTE ] IQV: Full fetch complete (72214 records). [2025-09-30T19:24:50.956211] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-30T19:24:51.365045] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T19:24:51.433184] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-30T19:24:51.433286] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-30T19:24:51.434462] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-30T19:24:51.434538] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-30T19:24:51.436280] [DEBUG] [LOCAL ] IQV: Trimmed 72214 records to 50073 (keeping 200 days of data) [2025-09-30T19:24:51.495024] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-30T19:24:51.785958] [DEBUG] [LOCAL ] IQV: Primary data saved (50073 records). [2025-09-30T19:24:51.786113] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-30T19:24:51.786217] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IQV took 39.7s. Estimated remaining: 2h 39m 34s. Rate: 7.8 symbols/min [2025-09-30T19:24:51.992153] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:52.042509] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T19:24:52.061776] [INFO ] [REMOTE ] IRS: Full fetch complete (32168 records). [2025-09-30T19:24:52.063135] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-30T19:24:52.064048] [DEBUG] [LOCAL ] IT: Loaded 41834 existing records from primary storage. [2025-09-30T19:24:52.103691] [INFO ] [MAIN ] IT: Loaded 41834 existing records. [2025-09-30T19:24:52.258242] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-30T19:24:52.613157] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:52.613874] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-30T19:24:52.613957] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-30T19:24:52.644743] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-30T19:24:52.650057] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-30T19:24:52.784704] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-30T19:24:52.813580] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-30T19:24:52.841000] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-30T19:24:52.846326] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-30T19:24:52.869278] [DEBUG] [LOCAL ] IRS: Trimmed 32168 records to 21827 (keeping 200 days of data) [2025-09-30T19:24:53.248924] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T19:24:53.295499] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:53.297156] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-30T19:24:53.340119] [DEBUG] [LOCAL ] IRS: Primary data saved (21827 records). [2025-09-30T19:24:53.340323] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-30T19:24:53.340552] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IRS took 27.5s. Estimated remaining: 2h 39m 19s. Rate: 7.8 symbols/min [2025-09-30T19:24:53.441991] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T19:24:53.550638] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:24:53.596785] [DEBUG] [LOCAL ] ITGR: Loaded 31645 existing records from primary storage. [2025-09-30T19:24:53.597474] [INFO ] [MAIN ] ITGR: Loaded 31645 existing records. [2025-09-30T19:24:53.815237] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:24:53.815552] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-30T19:24:53.815632] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-30T19:24:53.815984] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-30T19:24:53.816069] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-30T19:24:53.859517] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-30T19:24:54.217194] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:24:54.463479] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T19:24:54.654397] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-30T19:24:55.242859] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T19:24:55.454392] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-30T19:24:55.829927] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T19:24:56.254411] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-30T19:24:56.607532] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T19:24:57.054372] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-30T19:24:57.854364] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-30T19:24:58.102622] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T19:24:58.515093] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T19:24:58.654389] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-30T19:24:58.903930] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-30T19:24:59.454358] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-30T19:24:59.840597] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T19:25:00.254344] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-30T19:25:00.291024] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T19:25:01.054403] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-30T19:25:01.480711] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T19:25:01.854409] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-30T19:25:02.532491] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T19:25:02.654353] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-30T19:25:03.454412] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-30T19:25:03.524797] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T19:25:03.806423] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T19:25:04.254385] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-30T19:25:04.857963] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T19:25:05.054380] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-30T19:25:05.721828] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T19:25:05.854373] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-30T19:25:06.035871] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T19:25:06.654404] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-30T19:25:07.035188] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T19:25:07.454470] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-30T19:25:08.182374] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-30T19:25:08.254372] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-30T19:25:08.703780] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T19:25:09.054402] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-30T19:25:09.854378] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-30T19:25:10.063492] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T19:25:10.394080] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T19:25:10.654352] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-30T19:25:11.089516] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T19:25:11.462269] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-30T19:25:11.467545] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T19:25:12.254427] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-30T19:25:13.041806] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T19:25:13.054392] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-30T19:25:13.149615] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:25:13.854503] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-30T19:25:14.130615] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-30T19:25:14.137700] [INFO ] [REMOTE ] ITGR: Full fetch complete (41618 records). [2025-09-30T19:25:14.137820] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-30T19:25:14.563766] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-30T19:25:14.563884] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-30T19:25:14.564610] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-30T19:25:14.564698] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-30T19:25:14.566107] [DEBUG] [LOCAL ] ITGR: Trimmed 41618 records to 31521 (keeping 200 days of data) [2025-09-30T19:25:14.666205] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-30T19:25:14.788933] [DEBUG] [LOCAL ] ITGR: Primary data saved (31521 records). [2025-09-30T19:25:14.789095] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-30T19:25:14.789217] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. ITGR took 21.4s. Estimated remaining: 2h 39m 27s. Rate: 7.8 symbols/min [2025-09-30T19:25:14.995934] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:15.008531] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-30T19:25:15.059176] [DEBUG] [LOCAL ] ITT: Loaded 32914 existing records from primary storage. [2025-09-30T19:25:15.059637] [INFO ] [MAIN ] ITT: Loaded 32914 existing records. [2025-09-30T19:25:15.272932] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:15.273146] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-30T19:25:15.273193] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-30T19:25:15.273819] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-30T19:25:15.273882] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-30T19:25:15.454624] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-30T19:25:15.746905] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:16.069561] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-30T19:25:16.254398] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-30T19:25:17.054414] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-30T19:25:17.129593] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-30T19:25:17.624169] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T19:25:17.635574] [INFO ] [REMOTE ] IRT: Full fetch complete (72539 records). [2025-09-30T19:25:17.635765] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-30T19:25:17.863858] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-30T19:25:18.055836] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-30T19:25:18.163687] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-30T19:25:18.163794] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-30T19:25:18.164858] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-30T19:25:18.164948] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-30T19:25:18.166546] [DEBUG] [LOCAL ] IRT: Trimmed 72539 records to 50402 (keeping 200 days of data) [2025-09-30T19:25:18.501832] [DEBUG] [LOCAL ] IRT: Primary data saved (50402 records). [2025-09-30T19:25:18.501986] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-30T19:25:18.502105] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. IRT took 31.8s. Estimated remaining: 2h 39m 15s. Rate: 7.8 symbols/min [2025-09-30T19:25:18.661702] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-30T19:25:18.700690] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:18.756089] [DEBUG] [LOCAL ] ITUB: Loaded 53318 existing records from primary storage. [2025-09-30T19:25:18.756638] [INFO ] [MAIN ] ITUB: Loaded 53318 existing records. [2025-09-30T19:25:18.961060] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:18.961322] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-30T19:25:18.961395] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-30T19:25:18.962624] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-30T19:25:18.962722] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-30T19:25:19.384698] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:19.454405] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-30T19:25:19.867584] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T19:25:20.069411] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T19:25:20.254375] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-30T19:25:21.054342] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-30T19:25:21.217849] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T19:25:21.260031] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T19:25:21.854593] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-30T19:25:22.654611] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-30T19:25:22.913500] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-30T19:25:22.924602] [INFO ] [REMOTE ] IT: Full fetch complete (55851 records). [2025-09-30T19:25:22.924895] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-30T19:25:23.334110] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-30T19:25:23.339492] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-30T19:25:23.341772] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-30T19:25:23.342463] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-30T19:25:23.346695] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-30T19:25:23.349539] [DEBUG] [LOCAL ] IT: Trimmed 55851 records to 41916 (keeping 200 days of data) [2025-09-30T19:25:23.472207] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-30T19:25:23.483460] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T19:25:23.677370] [DEBUG] [LOCAL ] IT: Primary data saved (41916 records). [2025-09-30T19:25:23.677512] [INFO ] [MAIN ] IT: Full history saved. [2025-09-30T19:25:23.677632] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. IT took 31.9s. Estimated remaining: 2h 39m 4s. Rate: 7.8 symbols/min [2025-09-30T19:25:23.863168] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:23.925392] [DEBUG] [LOCAL ] ITW: Loaded 45913 existing records from primary storage. [2025-09-30T19:25:23.925940] [INFO ] [MAIN ] ITW: Loaded 45913 existing records. [2025-09-30T19:25:24.146497] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:24.146776] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-30T19:25:24.146827] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-30T19:25:24.147822] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-30T19:25:24.147913] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-30T19:25:24.259886] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-30T19:25:24.567916] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:24.586371] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-30T19:25:25.054401] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-30T19:25:25.310836] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T19:25:25.314803] [INFO ] [REMOTE ] ISD: Full fetch complete (23940 records). [2025-09-30T19:25:25.314914] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-30T19:25:25.749295] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-30T19:25:25.749380] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-30T19:25:25.749896] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-30T19:25:25.749960] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-30T19:25:25.750676] [DEBUG] [LOCAL ] ISD: Trimmed 23940 records to 15486 (keeping 200 days of data) [2025-09-30T19:25:25.855937] [DEBUG] [LOCAL ] ISD: Primary data saved (15486 records). [2025-09-30T19:25:25.855696] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-30T19:25:25.856122] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-30T19:25:25.856323] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. ISD took 37.2s. Estimated remaining: 2h 38m 51s. Rate: 7.8 symbols/min [2025-09-30T19:25:26.046922] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:26.107073] [DEBUG] [LOCAL ] IVR: Loaded 47835 existing records from primary storage. [2025-09-30T19:25:26.107437] [INFO ] [MAIN ] IVR: Loaded 47835 existing records. [2025-09-30T19:25:26.307090] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:26.307339] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-30T19:25:26.307391] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-30T19:25:26.307962] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-30T19:25:26.308025] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-30T19:25:26.656274] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-30T19:25:26.765505] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:26.807561] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T19:25:27.454402] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-30T19:25:27.585168] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T19:25:27.669938] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T19:25:28.254412] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-30T19:25:28.966325] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T19:25:29.054445] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-30T19:25:29.854388] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-30T19:25:29.891072] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T19:25:30.654451] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-30T19:25:30.872763] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-30T19:25:31.124564] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T19:25:31.454386] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-30T19:25:32.254403] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-30T19:25:32.433497] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T19:25:33.054333] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-30T19:25:33.254245] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T19:25:33.854386] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-30T19:25:33.899800] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:25:34.654400] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-30T19:25:34.711030] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T19:25:35.310589] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T19:25:35.454374] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-30T19:25:36.196442] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:25:36.254369] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-30T19:25:36.929293] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-30T19:25:37.054436] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-30T19:25:37.854379] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-30T19:25:38.011963] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T19:25:38.654498] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-30T19:25:39.014467] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-30T19:25:39.067348] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T19:25:39.454383] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-30T19:25:40.254379] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-30T19:25:40.916623] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-30T19:25:40.954892] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-30T19:25:41.054441] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-30T19:25:41.854389] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-30T19:25:42.090665] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-30T19:25:42.110474] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-30T19:25:42.654371] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-30T19:25:43.454365] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-30T19:25:43.507803] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-30T19:25:44.254379] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-30T19:25:44.459493] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-30T19:25:45.054363] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-30T19:25:45.171895] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T19:25:45.605900] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T19:25:45.615445] [INFO ] [REMOTE ] ITT: Full fetch complete (46963 records). [2025-09-30T19:25:45.615680] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-30T19:25:45.859607] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-30T19:25:46.062062] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-30T19:25:46.062167] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-30T19:25:46.063042] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-30T19:25:46.063134] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-30T19:25:46.064359] [DEBUG] [LOCAL ] ITT: Trimmed 46963 records to 32807 (keeping 200 days of data) [2025-09-30T19:25:46.281879] [DEBUG] [LOCAL ] ITT: Primary data saved (32807 records). [2025-09-30T19:25:46.282036] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-30T19:25:46.282124] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITT took 31.5s. Estimated remaining: 2h 38m 57s. Rate: 7.8 symbols/min [2025-09-30T19:25:46.470070] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:46.513299] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T19:25:46.552737] [DEBUG] [LOCAL ] IVT: Loaded 30671 existing records from primary storage. [2025-09-30T19:25:46.553184] [INFO ] [MAIN ] IVT: Loaded 30671 existing records. [2025-09-30T19:25:46.662262] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-30T19:25:46.753128] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:46.753385] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-30T19:25:46.753442] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-30T19:25:46.754121] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-30T19:25:46.754196] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-30T19:25:47.156915] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:47.454356] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-30T19:25:47.584545] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T19:25:47.598013] [INFO ] [REMOTE ] ITUB: Full fetch complete (77175 records). [2025-09-30T19:25:47.598236] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-30T19:25:48.074084] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-30T19:25:48.074287] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-30T19:25:48.075754] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-30T19:25:48.099858] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-30T19:25:48.104989] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T19:25:48.120001] [DEBUG] [LOCAL ] ITUB: Trimmed 77175 records to 53327 (keeping 200 days of data) [2025-09-30T19:25:48.254428] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-30T19:25:48.461434] [DEBUG] [LOCAL ] ITUB: Primary data saved (53327 records). [2025-09-30T19:25:48.461589] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-30T19:25:48.461713] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITUB took 30.0s. Estimated remaining: 2h 38m 43s. Rate: 7.8 symbols/min [2025-09-30T19:25:48.646558] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:48.708294] [DEBUG] [LOCAL ] IVZ: Loaded 53127 existing records from primary storage. [2025-09-30T19:25:48.708708] [INFO ] [MAIN ] IVZ: Loaded 53127 existing records. [2025-09-30T19:25:48.916204] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:48.916514] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-30T19:25:48.916571] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-30T19:25:48.917177] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-30T19:25:48.917241] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-30T19:25:49.063963] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-30T19:25:49.301520] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-30T19:25:49.386218] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:49.646183] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T19:25:49.854394] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-30T19:25:50.654330] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-30T19:25:51.076030] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T19:25:51.121381] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T19:25:51.454369] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-30T19:25:52.254323] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-30T19:25:52.450752] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-30T19:25:52.956450] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-30T19:25:53.054320] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-30T19:25:53.633026] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T19:25:53.854403] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-30T19:25:54.654348] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-30T19:25:54.697129] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T19:25:55.454374] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-30T19:25:55.566866] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-30T19:25:56.254373] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-30T19:25:56.621488] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-09-30T19:25:56.635144] [INFO ] [REMOTE ] IVR: Full fetch complete (69057 records). [2025-09-30T19:25:56.635332] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-30T19:25:57.072161] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-30T19:25:57.105927] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-30T19:25:57.106111] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-30T19:25:57.107167] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-30T19:25:57.107343] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-30T19:25:57.109561] [DEBUG] [LOCAL ] IVR: Trimmed 69057 records to 47877 (keeping 200 days of data) [2025-09-30T19:25:57.226251] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-30T19:25:57.442166] [DEBUG] [LOCAL ] IVR: Primary data saved (47877 records). [2025-09-30T19:25:57.442324] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-30T19:25:57.442422] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. IVR took 31.6s. Estimated remaining: 2h 38m 37s. Rate: 7.8 symbols/min [2025-09-30T19:25:57.631149] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:25:57.652983] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T19:25:57.680514] [DEBUG] [LOCAL ] IX: Loaded 22541 existing records from primary storage. [2025-09-30T19:25:57.680800] [INFO ] [MAIN ] IX: Loaded 22541 existing records. [2025-09-30T19:25:57.862162] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-30T19:25:57.894133] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:25:57.895751] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-30T19:25:57.895845] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-30T19:25:57.896563] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-30T19:25:57.896729] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-30T19:25:58.333861] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:25:58.654430] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-30T19:25:58.967936] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-30T19:25:59.454386] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-30T19:25:59.708842] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-30T19:25:59.720930] [INFO ] [REMOTE ] ITW: Full fetch complete (66378 records). [2025-09-30T19:25:59.721098] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-30T19:26:00.085691] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T19:26:00.200751] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-30T19:26:00.200856] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-30T19:26:00.201864] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-30T19:26:00.201931] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-30T19:26:00.203438] [DEBUG] [LOCAL ] ITW: Trimmed 66378 records to 45869 (keeping 200 days of data) [2025-09-30T19:26:00.266369] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-30T19:26:00.514489] [DEBUG] [LOCAL ] ITW: Primary data saved (45869 records). [2025-09-30T19:26:00.514631] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-30T19:26:00.514754] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. ITW took 36.8s. Estimated remaining: 2h 38m 24s. Rate: 7.8 symbols/min [2025-09-30T19:26:00.705543] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:00.778053] [DEBUG] [LOCAL ] J: Loaded 40155 existing records from primary storage. [2025-09-30T19:26:00.778522] [INFO ] [MAIN ] J: Loaded 40155 existing records. [2025-09-30T19:26:00.991766] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:00.992149] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-30T19:26:00.992225] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-30T19:26:00.992788] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-30T19:26:00.992862] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-30T19:26:01.059457] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-30T19:26:01.436119] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-30T19:26:01.441576] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:01.730674] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T19:26:01.854380] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-30T19:26:01.897801] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T19:26:02.654337] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-30T19:26:02.913063] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-30T19:26:03.398082] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-30T19:26:03.454447] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-30T19:26:04.254500] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-30T19:26:05.054414] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-30T19:26:05.281911] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T19:26:05.555609] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T19:26:05.854323] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-30T19:26:05.935088] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-30T19:26:06.654404] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-30T19:26:06.989152] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T19:26:07.454404] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-30T19:26:07.736915] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T19:26:08.254396] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-30T19:26:08.808757] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-30T19:26:08.817465] [INFO ] [REMOTE ] IVT: Full fetch complete (45467 records). [2025-09-30T19:26:08.817694] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-30T19:26:09.055716] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-30T19:26:09.289171] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-30T19:26:09.289356] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-30T19:26:09.290433] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-30T19:26:09.290552] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-30T19:26:09.310108] [DEBUG] [LOCAL ] IVT: Trimmed 45467 records to 30715 (keeping 200 days of data) [2025-09-30T19:26:09.310764] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-30T19:26:09.521822] [DEBUG] [LOCAL ] IVT: Primary data saved (30715 records). [2025-09-30T19:26:09.521985] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-30T19:26:09.522078] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IVT took 23.2s. Estimated remaining: 2h 38m 18s. Rate: 7.8 symbols/min [2025-09-30T19:26:09.737253] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:09.802384] [DEBUG] [LOCAL ] JBGS: Loaded 42397 existing records from primary storage. [2025-09-30T19:26:09.802842] [INFO ] [MAIN ] JBGS: Loaded 42397 existing records. [2025-09-30T19:26:09.859585] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-30T19:26:10.020056] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:10.020359] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-30T19:26:10.020415] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-30T19:26:10.020866] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-30T19:26:10.020925] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-30T19:26:10.411454] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:10.654373] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-30T19:26:10.727949] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T19:26:11.108450] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T19:26:11.454413] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-30T19:26:11.748416] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T19:26:12.254370] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-30T19:26:13.054377] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-30T19:26:13.235791] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-30T19:26:13.711984] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-30T19:26:13.854344] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-30T19:26:13.930222] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-30T19:26:14.654397] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-30T19:26:15.333327] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T19:26:15.454328] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-30T19:26:15.841064] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T19:26:16.254411] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-30T19:26:16.753131] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T19:26:17.054415] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-30T19:26:17.605077] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T19:26:17.854356] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-30T19:26:18.032084] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T19:26:18.654403] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-30T19:26:19.385610] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T19:26:19.454401] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-30T19:26:20.195553] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-30T19:26:20.254350] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-30T19:26:20.684606] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-30T19:26:20.688898] [INFO ] [REMOTE ] IX: Full fetch complete (27194 records). [2025-09-30T19:26:20.689015] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-30T19:26:21.064200] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-30T19:26:21.096868] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-30T19:26:21.096949] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-30T19:26:21.097604] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-30T19:26:21.097712] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-30T19:26:21.098962] [DEBUG] [LOCAL ] IX: Trimmed 27194 records to 22541 (keeping 200 days of data) [2025-09-30T19:26:21.250203] [DEBUG] [LOCAL ] IX: Primary data saved (22541 records). [2025-09-30T19:26:21.250350] [INFO ] [MAIN ] IX: Full history saved. [2025-09-30T19:26:21.250452] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IX took 23.8s. Estimated remaining: 2h 38m 14s. Rate: 7.8 symbols/min [2025-09-30T19:26:21.502562] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:21.549744] [DEBUG] [LOCAL ] JBI: Loaded 43571 existing records from primary storage. [2025-09-30T19:26:21.550312] [INFO ] [MAIN ] JBI: Loaded 43571 existing records. [2025-09-30T19:26:21.751762] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:21.751983] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-30T19:26:21.752077] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-30T19:26:21.752547] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-30T19:26:21.752612] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-30T19:26:21.859543] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-30T19:26:22.208430] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:22.214139] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T19:26:22.635673] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-30T19:26:22.654327] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-30T19:26:23.454373] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-30T19:26:23.824375] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-30T19:26:24.254375] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-30T19:26:24.411528] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-30T19:26:24.605930] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T19:26:25.054360] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-30T19:26:25.856055] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-30T19:26:25.862783] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-30T19:26:26.548498] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T19:26:26.654379] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-30T19:26:27.464190] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-30T19:26:27.484209] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T19:26:28.155358] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T19:26:28.254361] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-30T19:26:29.054374] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-30T19:26:29.120599] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T19:26:29.133377] [INFO ] [REMOTE ] IVZ: Full fetch complete (76767 records). [2025-09-30T19:26:29.133570] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-30T19:26:29.595732] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-30T19:26:29.595872] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-30T19:26:29.597363] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-30T19:26:29.597524] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-30T19:26:29.599637] [DEBUG] [LOCAL ] IVZ: Trimmed 76767 records to 53127 (keeping 200 days of data) [2025-09-30T19:26:29.734175] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T19:26:29.870526] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-30T19:26:29.996112] [DEBUG] [LOCAL ] IVZ: Primary data saved (53127 records). [2025-09-30T19:26:29.996277] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-30T19:26:29.996365] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. IVZ took 41.5s. Estimated remaining: 2h 38m 8s. Rate: 7.8 symbols/min [2025-09-30T19:26:30.201085] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:30.236102] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T19:26:30.297373] [DEBUG] [LOCAL ] JBL: Loaded 48388 existing records from primary storage. [2025-09-30T19:26:30.297773] [INFO ] [MAIN ] JBL: Loaded 48388 existing records. [2025-09-30T19:26:30.517060] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:30.517270] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-30T19:26:30.517350] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-30T19:26:30.517936] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-30T19:26:30.518012] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-30T19:26:30.665872] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-30T19:26:30.944475] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:31.095707] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T19:26:31.454425] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-30T19:26:32.259537] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-30T19:26:32.279400] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T19:26:33.054384] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-30T19:26:33.117789] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:26:33.854362] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-30T19:26:33.900851] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:26:34.194329] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T19:26:34.654366] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-30T19:26:35.408675] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T19:26:35.454381] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-30T19:26:35.846136] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-30T19:26:36.254347] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-30T19:26:37.033430] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T19:26:37.054384] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-30T19:26:37.439180] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T19:26:37.854362] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-30T19:26:38.616354] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T19:26:38.654333] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-30T19:26:39.454364] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-30T19:26:39.760521] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-30T19:26:40.259525] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-30T19:26:40.274020] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-30T19:26:40.283779] [INFO ] [REMOTE ] JBGS: Full fetch complete (59155 records). [2025-09-30T19:26:40.283947] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-30T19:26:40.720105] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-30T19:26:40.720290] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-30T19:26:40.721233] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-30T19:26:40.721333] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-30T19:26:40.722872] [DEBUG] [LOCAL ] JBGS: Trimmed 59155 records to 42396 (keeping 200 days of data) [2025-09-30T19:26:40.861961] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T19:26:41.035852] [DEBUG] [LOCAL ] JBGS: Primary data saved (42396 records). [2025-09-30T19:26:41.035998] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-30T19:26:41.036097] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. JBGS took 31.5s. Estimated remaining: 2h 38m 4s. Rate: 7.8 symbols/min [2025-09-30T19:26:41.059492] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-30T19:26:41.222432] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:41.260246] [DEBUG] [LOCAL ] JBND: Loaded 25760 existing records from primary storage. [2025-09-30T19:26:41.260634] [INFO ] [MAIN ] JBND: Loaded 25760 existing records. [2025-09-30T19:26:41.530546] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:41.530970] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-30T19:26:41.531047] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-30T19:26:41.531483] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-30T19:26:41.531554] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-30T19:26:41.859772] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-30T19:26:41.867874] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-30T19:26:42.098191] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:42.654358] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-30T19:26:42.926185] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T19:26:43.454541] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T19:26:43.454618] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-30T19:26:43.465041] [INFO ] [REMOTE ] J: Full fetch complete (59075 records). [2025-09-30T19:26:43.465168] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-30T19:26:43.904609] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-30T19:26:43.904773] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-30T19:26:43.905824] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-30T19:26:43.905892] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-30T19:26:43.907170] [DEBUG] [LOCAL ] J: Trimmed 59075 records to 40135 (keeping 200 days of data) [2025-09-30T19:26:44.174437] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T19:26:44.218831] [DEBUG] [LOCAL ] J: Primary data saved (40135 records). [2025-09-30T19:26:44.218970] [INFO ] [MAIN ] J: Full history saved. [2025-09-30T19:26:44.219057] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. J took 43.7s. Estimated remaining: 2h 37m 51s. Rate: 7.8 symbols/min [2025-09-30T19:26:44.259565] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-30T19:26:44.418758] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:44.418984] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-30T19:26:44.419030] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-30T19:26:44.419170] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-30T19:26:44.419214] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-30T19:26:44.419262] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-30T19:26:44.419297] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-30T19:26:44.822726] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:45.054338] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-30T19:26:45.255919] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:26:45.256290] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-30T19:26:45.256383] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:26:45.256430] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-09-30T19:26:45.256661] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:26:45.256862] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-30T19:26:45.256983] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-30T19:26:45.257165] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-30T19:26:45.262471] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-30T19:26:45.268721] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBS took 1.0s. Estimated remaining: 2h 37m 36s. Rate: 7.8 symbols/min [2025-09-30T19:26:45.269998] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:26:45.481026] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:45.481317] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-30T19:26:45.491737] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-30T19:26:45.505991] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-30T19:26:45.509002] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-30T19:26:45.509272] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-30T19:26:45.509378] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-30T19:26:45.545117] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-30T19:26:45.859565] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-30T19:26:45.921282] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:46.654389] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-30T19:26:46.881962] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:26:46.882300] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-30T19:26:46.882436] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:26:46.882537] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-09-30T19:26:46.882631] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:26:46.882742] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-30T19:26:46.882819] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-30T19:26:46.882873] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-30T19:26:46.882937] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-30T19:26:46.883061] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBTM took 1.6s. Estimated remaining: 2h 37m 22s. Rate: 7.8 symbols/min [2025-09-30T19:26:47.073789] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:47.083804] [DEBUG] [LOCAL ] JCE: Loaded 6576 existing records from primary storage. [2025-09-30T19:26:47.084027] [INFO ] [MAIN ] JCE: Loaded 6576 existing records. [2025-09-30T19:26:47.275914] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:47.276146] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-30T19:26:47.276193] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-30T19:26:47.276503] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-30T19:26:47.276563] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-30T19:26:47.456533] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-30T19:26:47.652259] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:47.690303] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T19:26:48.254337] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-30T19:26:48.471173] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T19:26:49.054387] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-30T19:26:49.670270] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-30T19:26:49.681191] [INFO ] [REMOTE ] JBI: Full fetch complete (64483 records). [2025-09-30T19:26:49.681427] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-30T19:26:49.863273] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-30T19:26:50.141606] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-30T19:26:50.141732] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-30T19:26:50.142623] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-30T19:26:50.142711] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-30T19:26:50.144135] [DEBUG] [LOCAL ] JBI: Trimmed 64483 records to 43584 (keeping 200 days of data) [2025-09-30T19:26:50.412217] [DEBUG] [LOCAL ] JBI: Primary data saved (43584 records). [2025-09-30T19:26:50.412358] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-30T19:26:50.414672] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBI took 29.2s. Estimated remaining: 2h 37m 10s. Rate: 7.8 symbols/min [2025-09-30T19:26:50.603357] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:26:50.663378] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-30T19:26:50.698859] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:26:50.710298] [DEBUG] [LOCAL ] JCI: Loaded 53544 existing records from primary storage. [2025-09-30T19:26:50.710985] [INFO ] [MAIN ] JCI: Loaded 53544 existing records. [2025-09-30T19:26:50.796058] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-30T19:26:50.922909] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:26:50.923144] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-30T19:26:50.923194] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-30T19:26:50.923892] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-30T19:26:50.923971] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-30T19:26:51.315912] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:26:51.394966] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T19:26:51.454382] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-30T19:26:52.254379] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-30T19:26:52.877761] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:26:53.054351] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-30T19:26:53.709560] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T19:26:53.854385] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-30T19:26:54.286775] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T19:26:54.458925] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-30T19:26:54.654357] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-30T19:26:55.424397] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-30T19:26:55.454340] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-30T19:26:56.254408] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-30T19:26:56.465442] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T19:26:57.054358] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-30T19:26:57.854386] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-30T19:26:57.905448] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-30T19:26:58.047863] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T19:26:58.654398] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-30T19:26:59.454383] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-30T19:26:59.608013] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-30T19:26:59.938800] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T19:26:59.947983] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-30T19:27:00.254405] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-30T19:27:00.981021] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-30T19:27:01.054397] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-30T19:27:01.854382] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-30T19:27:02.576891] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T19:27:02.644359] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T19:27:02.654794] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-30T19:27:03.454338] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-30T19:27:03.571437] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-30T19:27:04.254395] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-30T19:27:05.054359] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-30T19:27:05.365168] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-30T19:27:05.532235] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-30T19:27:05.532549] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T19:27:05.854381] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-30T19:27:06.654400] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-30T19:27:07.427533] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:27:07.439019] [INFO ] [REMOTE ] JBL: Full fetch complete (70255 records). [2025-09-30T19:27:07.439181] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-30T19:27:07.460562] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-30T19:27:07.880535] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-30T19:27:07.880675] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-30T19:27:07.881863] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-30T19:27:07.881944] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-30T19:27:07.883439] [DEBUG] [LOCAL ] JBL: Trimmed 70255 records to 48383 (keeping 200 days of data) [2025-09-30T19:27:08.139133] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:27:08.149424] [INFO ] [REMOTE ] JBND: Full fetch complete (33987 records). [2025-09-30T19:27:08.150440] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-30T19:27:08.257532] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-30T19:27:08.603311] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-30T19:27:08.603935] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-30T19:27:08.604732] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-30T19:27:08.606771] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-30T19:27:08.635362] [DEBUG] [LOCAL ] JBND: Trimmed 33987 records to 25895 (keeping 200 days of data) [2025-09-30T19:27:08.734828] [DEBUG] [LOCAL ] JBL: Primary data saved (48383 records). [2025-09-30T19:27:08.762627] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-30T19:27:08.763789] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JBL took 38.8s. Estimated remaining: 2h 37m 14s. Rate: 7.8 symbols/min [2025-09-30T19:27:08.982351] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:09.018358] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T19:27:09.060230] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-30T19:27:09.090429] [DEBUG] [LOCAL ] JEF: Loaded 49996 existing records from primary storage. [2025-09-30T19:27:09.092240] [INFO ] [MAIN ] JEF: Loaded 49996 existing records. [2025-09-30T19:27:09.132548] [DEBUG] [LOCAL ] JBND: Primary data saved (25895 records). [2025-09-30T19:27:09.169236] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-30T19:27:09.178198] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JBND took 28.1s. Estimated remaining: 2h 36m 58s. Rate: 7.8 symbols/min [2025-09-30T19:27:09.428520] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:09.433576] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-30T19:27:09.434003] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-30T19:27:09.444601] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-30T19:27:09.455290] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-30T19:27:09.565158] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:09.839456] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-30T19:27:09.842544] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-30T19:27:09.893206] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-30T19:27:09.972354] [DEBUG] [LOCAL ] JELD: Loaded 46097 existing records from primary storage. [2025-09-30T19:27:10.004992] [INFO ] [MAIN ] JELD: Loaded 46097 existing records. [2025-09-30T19:27:10.140873] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:10.302503] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:10.302753] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-30T19:27:10.302808] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-30T19:27:10.303212] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-30T19:27:10.303272] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-30T19:27:10.639512] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-30T19:27:10.657370] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-30T19:27:10.739751] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:11.454379] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-30T19:27:12.254375] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-30T19:27:12.506667] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-30T19:27:12.803702] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T19:27:12.807379] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-30T19:27:12.815398] [INFO ] [REMOTE ] JCE: Full fetch complete (9304 records). [2025-09-30T19:27:12.815476] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-30T19:27:13.063443] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-30T19:27:13.199690] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-30T19:27:13.199806] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-30T19:27:13.200061] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-30T19:27:13.200107] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-30T19:27:13.200607] [DEBUG] [LOCAL ] JCE: Trimmed 9304 records to 6688 (keeping 200 days of data) [2025-09-30T19:27:13.241557] [DEBUG] [LOCAL ] JCE: Primary data saved (6688 records). [2025-09-30T19:27:13.241710] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-30T19:27:13.241827] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JCE took 26.4s. Estimated remaining: 2h 36m 46s. Rate: 7.8 symbols/min [2025-09-30T19:27:13.435638] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:13.449673] [DEBUG] [LOCAL ] JEQ: Loaded 8974 existing records from primary storage. [2025-09-30T19:27:13.449899] [INFO ] [MAIN ] JEQ: Loaded 8974 existing records. [2025-09-30T19:27:13.648283] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:13.648508] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-30T19:27:13.648593] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-30T19:27:13.648912] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-30T19:27:13.648978] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-30T19:27:13.859606] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-30T19:27:14.045964] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:14.654411] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-30T19:27:14.895502] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:27:15.105323] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-30T19:27:15.384945] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T19:27:15.454457] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-30T19:27:16.254392] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-30T19:27:17.031988] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:27:17.054341] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-30T19:27:17.854328] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-30T19:27:18.116483] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-30T19:27:18.394878] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T19:27:18.654379] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-30T19:27:18.946966] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-30T19:27:19.454920] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-30T19:27:19.949617] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T19:27:20.039814] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-30T19:27:20.254365] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-30T19:27:21.054398] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-30T19:27:21.854326] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-30T19:27:21.939436] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T19:27:22.501716] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-30T19:27:22.538115] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T19:27:22.654376] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-30T19:27:23.454418] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-30T19:27:24.151706] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T19:27:24.254376] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-30T19:27:24.920478] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-30T19:27:25.054357] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-30T19:27:25.854336] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-30T19:27:26.069102] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T19:27:26.490740] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T19:27:26.625962] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T19:27:26.654374] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-30T19:27:27.454387] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-30T19:27:28.254399] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-30T19:27:28.524683] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T19:27:28.537612] [INFO ] [REMOTE ] JCI: Full fetch complete (77412 records). [2025-09-30T19:27:28.537842] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-30T19:27:28.989742] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-30T19:27:28.990017] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-30T19:27:28.991065] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-30T19:27:28.991211] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-30T19:27:29.024548] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T19:27:29.022850] [DEBUG] [LOCAL ] JCI: Trimmed 77412 records to 53543 (keeping 200 days of data) [2025-09-30T19:27:29.097411] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-30T19:27:29.401254] [DEBUG] [LOCAL ] JCI: Primary data saved (53543 records). [2025-09-30T19:27:29.401406] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-30T19:27:29.402366] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JCI took 39.0s. Estimated remaining: 2h 36m 48s. Rate: 7.8 symbols/min [2025-09-30T19:27:29.584583] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:29.619182] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T19:27:29.656583] [DEBUG] [LOCAL ] JFR: Loaded 30591 existing records from primary storage. [2025-09-30T19:27:29.657061] [INFO ] [MAIN ] JFR: Loaded 30591 existing records. [2025-09-30T19:27:29.850827] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:29.851069] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-30T19:27:29.851118] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-30T19:27:29.851511] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-30T19:27:29.851583] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-30T19:27:29.862948] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-30T19:27:30.259197] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:30.638194] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T19:27:30.654328] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-30T19:27:31.454324] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-30T19:27:31.740464] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T19:27:31.971942] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-30T19:27:32.191535] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-30T19:27:32.254378] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-30T19:27:33.054354] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-30T19:27:33.807970] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T19:27:33.854352] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-30T19:27:34.054204] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-30T19:27:34.292037] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-30T19:27:34.654386] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-30T19:27:35.454379] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-30T19:27:36.254361] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-30T19:27:36.522795] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T19:27:37.050949] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T19:27:37.060428] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-30T19:27:37.389922] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T19:27:37.568589] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-30T19:27:37.854364] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-30T19:27:38.654357] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-30T19:27:39.454386] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-30T19:27:39.540101] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-30T19:27:39.550624] [INFO ] [REMOTE ] JELD: Full fetch complete (63881 records). [2025-09-30T19:27:39.550841] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-30T19:27:39.790154] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-30T19:27:39.996821] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-30T19:27:39.996914] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-30T19:27:39.997785] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-30T19:27:39.997852] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-30T19:27:39.999247] [DEBUG] [LOCAL ] JELD: Trimmed 63881 records to 46062 (keeping 200 days of data) [2025-09-30T19:27:40.257935] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-30T19:27:40.269533] [DEBUG] [LOCAL ] JELD: Primary data saved (46062 records). [2025-09-30T19:27:40.269627] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-30T19:27:40.269739] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JELD took 31.1s. Estimated remaining: 2h 36m 43s. Rate: 7.8 symbols/min [2025-09-30T19:27:40.445507] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:40.459386] [DEBUG] [LOCAL ] JGH: Loaded 10966 existing records from primary storage. [2025-09-30T19:27:40.459626] [INFO ] [MAIN ] JGH: Loaded 10966 existing records. [2025-09-30T19:27:40.649274] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:40.649633] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-30T19:27:40.649809] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-30T19:27:40.650269] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-30T19:27:40.650385] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-30T19:27:40.840335] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:27:41.067011] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-30T19:27:41.073622] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:41.522804] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T19:27:41.594717] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-30T19:27:41.597371] [INFO ] [REMOTE ] JEQ: Full fetch complete (11758 records). [2025-09-30T19:27:41.597464] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-30T19:27:41.859478] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-30T19:27:41.979015] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-30T19:27:41.979096] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-30T19:27:41.979392] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-30T19:27:41.979456] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-30T19:27:41.980074] [DEBUG] [LOCAL ] JEQ: Trimmed 11758 records to 8895 (keeping 200 days of data) [2025-09-30T19:27:42.036207] [DEBUG] [LOCAL ] JEQ: Primary data saved (8895 records). [2025-09-30T19:27:42.036343] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-30T19:27:42.036425] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JEQ took 28.8s. Estimated remaining: 2h 36m 29s. Rate: 7.8 symbols/min [2025-09-30T19:27:42.213876] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:42.273762] [DEBUG] [LOCAL ] JHG: Loaded 47709 existing records from primary storage. [2025-09-30T19:27:42.274085] [INFO ] [MAIN ] JHG: Loaded 47709 existing records. [2025-09-30T19:27:42.462926] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:42.463176] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-30T19:27:42.463244] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-30T19:27:42.463758] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-30T19:27:42.463820] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-30T19:27:42.659496] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-30T19:27:42.871873] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:43.287803] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-30T19:27:43.454334] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-30T19:27:43.494252] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-30T19:27:44.254410] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-30T19:27:45.054367] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-30T19:27:45.297083] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-30T19:27:45.308896] [INFO ] [REMOTE ] JEF: Full fetch complete (72925 records). [2025-09-30T19:27:45.309073] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-30T19:27:45.858131] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-30T19:27:45.861795] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-30T19:27:45.862282] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-30T19:27:45.867709] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-30T19:27:45.864872] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T19:27:45.877194] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-30T19:27:45.880703] [DEBUG] [LOCAL ] JEF: Trimmed 72925 records to 50008 (keeping 200 days of data) [2025-09-30T19:27:46.030038] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T19:27:46.295113] [DEBUG] [LOCAL ] JEF: Primary data saved (50008 records). [2025-09-30T19:27:46.295275] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-30T19:27:46.295395] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JEF took 37.5s. Estimated remaining: 2h 36m 18s. Rate: 7.8 symbols/min [2025-09-30T19:27:46.529703] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:27:46.536386] [DEBUG] [LOCAL ] JHI: Loaded 3586 existing records from primary storage. [2025-09-30T19:27:46.536613] [INFO ] [MAIN ] JHI: Loaded 3586 existing records. [2025-09-30T19:27:46.659537] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-30T19:27:46.740147] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:27:46.740548] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-30T19:27:46.740602] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-30T19:27:46.740856] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-30T19:27:46.740918] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-30T19:27:46.843135] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T19:27:47.147978] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:27:47.454360] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-30T19:27:48.048567] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T19:27:48.263778] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-30T19:27:48.271362] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T19:27:48.841679] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-30T19:27:49.054400] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-30T19:27:49.854327] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-30T19:27:50.279833] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T19:27:50.654373] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-30T19:27:51.166378] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-30T19:27:51.461671] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-30T19:27:51.468095] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:27:52.120007] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T19:27:52.254403] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-30T19:27:53.032942] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-30T19:27:53.054368] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-30T19:27:53.830157] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T19:27:53.854364] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-30T19:27:54.654415] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-30T19:27:55.127255] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T19:27:55.171386] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T19:27:55.454366] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-30T19:27:56.031260] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-30T19:27:56.254370] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-30T19:27:56.847715] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T19:27:57.054369] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-30T19:27:57.539961] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T19:27:57.854364] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-30T19:27:58.654362] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-30T19:27:59.416292] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-30T19:27:59.454339] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-30T19:27:59.671939] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T19:27:59.983946] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-30T19:28:00.254401] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-30T19:28:01.054334] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-30T19:28:01.135454] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-30T19:28:01.854374] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-30T19:28:02.418118] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-30T19:28:02.422455] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T19:28:02.654362] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-30T19:28:03.148496] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-30T19:28:03.454401] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-30T19:28:04.254342] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-30T19:28:04.423981] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T19:28:05.054420] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-30T19:28:05.854417] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-30T19:28:05.972403] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-30T19:28:05.975875] [INFO ] [REMOTE ] JGH: Full fetch complete (14981 records). [2025-09-30T19:28:05.976047] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-30T19:28:06.154349] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-30T19:28:06.448347] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-30T19:28:06.448434] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-30T19:28:06.448867] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-30T19:28:06.448934] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-30T19:28:06.449617] [DEBUG] [LOCAL ] JGH: Trimmed 14981 records to 11028 (keeping 200 days of data) [2025-09-30T19:28:06.489556] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-30T19:28:06.529021] [DEBUG] [LOCAL ] JGH: Primary data saved (11028 records). [2025-09-30T19:28:06.529157] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-30T19:28:06.529241] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JGH took 26.3s. Estimated remaining: 2h 36m 24s. Rate: 7.8 symbols/min [2025-09-30T19:28:06.659503] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-30T19:28:06.763038] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:06.768078] [DEBUG] [LOCAL ] JHS: Loaded 2826 existing records from primary storage. [2025-09-30T19:28:06.768894] [INFO ] [MAIN ] JHS: Loaded 2826 existing records. [2025-09-30T19:28:06.981293] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:06.981540] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-30T19:28:06.981589] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-30T19:28:06.981795] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-30T19:28:06.981857] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-30T19:28:07.393464] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:07.454449] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-30T19:28:08.254442] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-30T19:28:08.338561] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T19:28:08.589735] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-30T19:28:08.969025] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T19:28:08.977016] [INFO ] [REMOTE ] JFR: Full fetch complete (48259 records). [2025-09-30T19:28:08.977176] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-30T19:28:09.059491] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-30T19:28:09.402211] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-30T19:28:09.402321] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-30T19:28:09.403183] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-30T19:28:09.403251] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-30T19:28:09.404320] [DEBUG] [LOCAL ] JFR: Trimmed 48259 records to 30656 (keeping 200 days of data) [2025-09-30T19:28:09.606413] [DEBUG] [LOCAL ] JFR: Primary data saved (30656 records). [2025-09-30T19:28:09.606570] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-30T19:28:09.607781] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JFR took 40.2s. Estimated remaining: 2h 36m 11s. Rate: 7.8 symbols/min [2025-09-30T19:28:09.735270] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-30T19:28:09.815116] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:09.854373] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-30T19:28:09.877027] [DEBUG] [LOCAL ] JHX: Loaded 51295 existing records from primary storage. [2025-09-30T19:28:09.877458] [INFO ] [MAIN ] JHX: Loaded 51295 existing records. [2025-09-30T19:28:10.078210] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:10.078448] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-30T19:28:10.078495] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-30T19:28:10.079216] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-30T19:28:10.079285] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-30T19:28:10.485803] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:10.563930] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-30T19:28:10.566028] [INFO ] [REMOTE ] JHI: Full fetch complete (5300 records). [2025-09-30T19:28:10.566119] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-30T19:28:10.659540] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-30T19:28:10.961900] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-30T19:28:10.961994] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-30T19:28:10.962195] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-30T19:28:10.962243] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-30T19:28:10.962718] [DEBUG] [LOCAL ] JHI: Trimmed 5300 records to 3583 (keeping 200 days of data) [2025-09-30T19:28:10.986782] [DEBUG] [LOCAL ] JHI: Primary data saved (3583 records). [2025-09-30T19:28:10.986917] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-30T19:28:10.987009] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JHI took 24.7s. Estimated remaining: 2h 35m 57s. Rate: 7.8 symbols/min [2025-09-30T19:28:11.175965] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:11.197728] [DEBUG] [LOCAL ] JILL: Loaded 16701 existing records from primary storage. [2025-09-30T19:28:11.197972] [INFO ] [MAIN ] JILL: Loaded 16701 existing records. [2025-09-30T19:28:11.428475] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:11.428763] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-30T19:28:11.428820] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-30T19:28:11.429111] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-30T19:28:11.429171] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-30T19:28:11.461130] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-30T19:28:11.804631] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:12.089972] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T19:28:12.254431] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-30T19:28:12.394990] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T19:28:13.054423] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-30T19:28:13.315769] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T19:28:13.718815] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T19:28:13.854369] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-30T19:28:14.654342] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-30T19:28:14.793945] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T19:28:15.454347] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-30T19:28:15.516382] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T19:28:16.254371] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-30T19:28:16.301295] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T19:28:17.054357] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-30T19:28:17.084484] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T19:28:17.854363] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-30T19:28:18.343520] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-30T19:28:18.654368] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-30T19:28:18.690294] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T19:28:19.454327] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-30T19:28:19.862252] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-30T19:28:20.165364] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-30T19:28:20.254434] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-30T19:28:21.054391] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-30T19:28:21.267323] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T19:28:21.515869] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T19:28:21.854357] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-30T19:28:22.654381] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-30T19:28:23.138824] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-30T19:28:23.303152] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T19:28:23.314100] [INFO ] [REMOTE ] JHG: Full fetch complete (68304 records). [2025-09-30T19:28:23.314246] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-30T19:28:23.459534] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-30T19:28:23.779862] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-30T19:28:23.779964] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-30T19:28:23.781014] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-30T19:28:23.781087] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-30T19:28:23.782730] [DEBUG] [LOCAL ] JHG: Trimmed 68304 records to 47675 (keeping 200 days of data) [2025-09-30T19:28:24.100136] [DEBUG] [LOCAL ] JHG: Primary data saved (47675 records). [2025-09-30T19:28:24.100302] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-30T19:28:24.100413] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHG took 42.1s. Estimated remaining: 2h 35m 55s. Rate: 7.8 symbols/min [2025-09-30T19:28:24.256719] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-30T19:28:24.292353] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:24.341280] [DEBUG] [LOCAL ] JKS: Loaded 40106 existing records from primary storage. [2025-09-30T19:28:24.341594] [INFO ] [MAIN ] JKS: Loaded 40106 existing records. [2025-09-30T19:28:24.542526] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T19:28:24.549069] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:24.552954] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-30T19:28:24.553407] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-30T19:28:24.554251] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-30T19:28:24.554312] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-30T19:28:25.043561] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:25.054328] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-30T19:28:25.854324] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-30T19:28:25.982942] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-30T19:28:26.339222] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T19:28:26.654337] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-30T19:28:26.964095] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-30T19:28:27.454407] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-30T19:28:28.175393] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T19:28:28.189881] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-30T19:28:28.254363] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-30T19:28:29.054366] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-30T19:28:29.251622] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T19:28:29.612332] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-30T19:28:29.854373] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-30T19:28:30.654339] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-30T19:28:30.921674] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T19:28:30.925971] [INFO ] [REMOTE ] JILL: Full fetch complete (22898 records). [2025-09-30T19:28:30.926102] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-30T19:28:31.341442] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-30T19:28:31.341537] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-30T19:28:31.342098] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-30T19:28:31.342163] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-30T19:28:31.343189] [DEBUG] [LOCAL ] JILL: Trimmed 22898 records to 16637 (keeping 200 days of data) [2025-09-30T19:28:31.448609] [DEBUG] [LOCAL ] JILL: Primary data saved (16637 records). [2025-09-30T19:28:31.448790] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-30T19:28:31.448890] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JILL took 20.5s. Estimated remaining: 2h 35m 47s. Rate: 7.8 symbols/min [2025-09-30T19:28:31.454312] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-30T19:28:32.221566] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T19:28:32.254315] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-30T19:28:32.655966] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T19:28:33.054370] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-30T19:28:33.384534] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T19:28:33.854358] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-30T19:28:34.654365] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-30T19:28:34.731826] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:28:35.235957] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-30T19:28:35.295021] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T19:28:35.454359] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-30T19:28:36.254387] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-30T19:28:37.054458] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-30T19:28:37.411689] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-30T19:28:37.520051] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T19:28:37.854360] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-30T19:28:37.960932] [DEBUG] [REMOTE ] JKS: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-30T19:28:37.961298] [WARN ] [REMOTE ] JKS: No data returned for month 2025-05 [2025-09-30T19:28:37.961394] [FATAL] [REMOTE ] JKS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:28:37.961481] [FATAL] [MAIN ] JKS: Failed to fetch primary data. [2025-09-30T19:28:37.961544] [WARN ] [MAIN ] JKS: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:28:37.961615] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-30T19:28:37.961716] [DEBUG] [LOCAL ] JKS: No primary data file found to delete. [2025-09-30T19:28:37.961765] [INFO ] [LOCAL ] JKS: Starting deletion of derivative data. [2025-09-30T19:28:37.962390] [DEBUG] [LOCAL ] JKS: Deleted derivative data file. [2025-09-30T19:28:37.962482] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JKS took 13.9s. Estimated remaining: 2h 35m 38s. Rate: 7.8 symbols/min [2025-09-30T19:28:38.102207] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T19:28:38.654443] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-30T19:28:39.301276] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-30T19:28:39.302857] [INFO ] [REMOTE ] JHS: Full fetch complete (4443 records). [2025-09-30T19:28:39.302945] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-30T19:28:39.461086] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-30T19:28:39.692417] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-30T19:28:39.692512] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-30T19:28:39.692710] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-30T19:28:39.692772] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-30T19:28:39.693181] [DEBUG] [LOCAL ] JHS: Trimmed 4443 records to 2831 (keeping 200 days of data) [2025-09-30T19:28:39.712008] [DEBUG] [LOCAL ] JHS: Primary data saved (2831 records). [2025-09-30T19:28:39.712133] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-30T19:28:39.712217] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JHS took 33.2s. Estimated remaining: 2h 35m 24s. Rate: 7.8 symbols/min [2025-09-30T19:28:41.443198] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-30T19:28:41.454529] [INFO ] [REMOTE ] JHX: Full fetch complete (58231 records). [2025-09-30T19:28:41.454723] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-30T19:28:41.899859] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-30T19:28:41.899959] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-30T19:28:41.900903] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-30T19:28:41.900972] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-30T19:28:41.902342] [DEBUG] [LOCAL ] JHX: Trimmed 58231 records to 51603 (keeping 200 days of data) [2025-09-30T19:28:42.223716] [DEBUG] [LOCAL ] JHX: Primary data saved (51603 records). [2025-09-30T19:28:42.223865] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-30T19:28:42.224687] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JHX took 32.6s. Estimated remaining: 2h 35m 11s. Rate: 7.8 symbols/min [2025-09-30T19:28:42.906715] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:42.904863] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:42.985257] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:43.008737] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-30T19:28:43.013360] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-30T19:28:43.013110] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:43.016440] [DEBUG] [LOCAL ] JLS: Loaded 4105 existing records from primary storage. [2025-09-30T19:28:43.016870] [INFO ] [MAIN ] JLS: Loaded 4105 existing records. [2025-09-30T19:28:43.016622] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-30T19:28:43.017473] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-30T19:28:43.022878] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-30T19:28:43.023065] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-30T19:28:43.336804] [DEBUG] [LOCAL ] JLL: Loaded 31761 existing records from primary storage. [2025-09-30T19:28:43.431321] [INFO ] [MAIN ] JLL: Loaded 31761 existing records. [2025-09-30T19:28:43.506008] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:43.536510] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-30T19:28:43.620565] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-30T19:28:43.637729] [DEBUG] [LOCAL ] JMIA: Loaded 50591 existing records from primary storage. [2025-09-30T19:28:43.677426] [INFO ] [MAIN ] JMIA: Loaded 50591 existing records. [2025-09-30T19:28:43.696448] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-30T19:28:43.748450] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-30T19:28:43.929900] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:43.991470] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-30T19:28:44.171875] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:44.182622] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-30T19:28:44.187865] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-30T19:28:44.216343] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-30T19:28:44.261781] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-30T19:28:44.272797] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:44.300754] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-30T19:28:44.349995] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-30T19:28:44.446023] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-30T19:28:44.508938] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-30T19:28:44.696254] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T19:28:44.729426] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-30T19:28:44.946834] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:44.981743] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-30T19:28:45.317856] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T19:28:45.317742] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:45.323484] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-30T19:28:45.324083] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-30T19:28:45.411371] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:28:45.411705] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-30T19:28:45.643457] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T19:28:45.644984] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-30T19:28:45.965106] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-30T19:28:45.967011] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-30T19:28:46.186206] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-30T19:28:46.301689] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-30T19:28:46.654343] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-30T19:28:46.751708] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T19:28:47.059208] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T19:28:47.206123] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-30T19:28:47.454408] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-30T19:28:47.875373] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-30T19:28:48.254375] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-30T19:28:49.054413] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-30T19:28:49.749107] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T19:28:49.854394] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-30T19:28:50.326608] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T19:28:50.654376] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-30T19:28:51.454332] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-30T19:28:51.568669] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-30T19:28:51.951378] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-30T19:28:52.025016] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T19:28:52.254356] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-30T19:28:52.889384] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-30T19:28:53.054381] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-30T19:28:53.854368] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-30T19:28:54.163468] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T19:28:54.654405] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-30T19:28:55.454361] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-30T19:28:55.566459] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T19:28:55.795140] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-30T19:28:55.957753] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-30T19:28:56.254359] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-30T19:28:56.725958] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-30T19:28:57.054370] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-30T19:28:57.469416] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-30T19:28:57.854398] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-30T19:28:58.482722] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-30T19:28:58.483716] [INFO ] [REMOTE ] JMM: Full fetch complete (2284 records). [2025-09-30T19:28:58.483790] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-30T19:28:58.666469] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-30T19:28:58.681233] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-30T19:28:58.682533] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:28:58.682605] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:28:58.682700] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-30T19:28:58.682795] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-30T19:28:58.682854] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-30T19:28:58.682915] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-30T19:28:58.683009] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JMM took 16.5s. Estimated remaining: 2h 35m 12s. Rate: 7.8 symbols/min [2025-09-30T19:28:58.865076] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:28:58.925260] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-30T19:28:58.925669] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-09-30T19:28:59.122034] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:28:59.122330] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-30T19:28:59.122387] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-30T19:28:59.123449] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-30T19:28:59.123508] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-30T19:28:59.429428] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-30T19:28:59.457605] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-30T19:28:59.517173] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:00.254418] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-30T19:29:00.763570] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T19:29:00.943287] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T19:29:01.054446] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-30T19:29:01.854421] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-30T19:29:02.654396] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-30T19:29:03.446687] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-30T19:29:03.457593] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-30T19:29:03.545720] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T19:29:03.998453] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-30T19:29:04.031412] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-30T19:29:04.254359] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-30T19:29:04.695935] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-30T19:29:05.054401] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-30T19:29:05.614781] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T19:29:05.854379] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-30T19:29:06.654404] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-30T19:29:07.277844] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-30T19:29:07.279474] [INFO ] [REMOTE ] JLS: Full fetch complete (5838 records). [2025-09-30T19:29:07.279550] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-30T19:29:07.464697] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-30T19:29:07.738869] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-30T19:29:07.739002] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-30T19:29:07.739207] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-30T19:29:07.739290] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-30T19:29:07.740085] [DEBUG] [LOCAL ] JLS: Trimmed 5838 records to 4126 (keeping 200 days of data) [2025-09-30T19:29:07.792100] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T19:29:07.807810] [DEBUG] [LOCAL ] JLS: Primary data saved (4126 records). [2025-09-30T19:29:07.807916] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-30T19:29:07.807995] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JLS took 25.5s. Estimated remaining: 2h 35m 6s. Rate: 7.8 symbols/min [2025-09-30T19:29:07.997502] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:29:08.060055] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-09-30T19:29:08.060456] [INFO ] [MAIN ] JOBY: Loaded 53799 existing records. [2025-09-30T19:29:08.253170] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:29:08.253380] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-30T19:29:08.253432] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-30T19:29:08.253878] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-30T19:29:08.253940] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-30T19:29:08.265455] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-30T19:29:08.670944] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:08.981957] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T19:29:09.054383] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-30T19:29:09.854407] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-30T19:29:10.528089] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-30T19:29:10.654388] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-30T19:29:11.454363] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-30T19:29:11.558092] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T19:29:11.654668] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-30T19:29:11.728554] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-30T19:29:12.254421] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-30T19:29:13.054378] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-30T19:29:13.558696] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-30T19:29:13.854355] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-30T19:29:14.115078] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T19:29:14.122105] [INFO ] [REMOTE ] JLL: Full fetch complete (44798 records). [2025-09-30T19:29:14.122255] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-30T19:29:14.536974] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-30T19:29:14.537095] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-30T19:29:14.537851] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-30T19:29:14.537926] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-30T19:29:14.540071] [DEBUG] [LOCAL ] JLL: Trimmed 44798 records to 31661 (keeping 200 days of data) [2025-09-30T19:29:14.654731] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-30T19:29:14.752366] [DEBUG] [LOCAL ] JLL: Primary data saved (31661 records). [2025-09-30T19:29:14.752671] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-30T19:29:14.753095] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JLL took 32.5s. Estimated remaining: 2h 34m 58s. Rate: 7.8 symbols/min [2025-09-30T19:29:14.962366] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:29:14.980605] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-30T19:29:15.015677] [DEBUG] [LOCAL ] JOE: Loaded 24232 existing records from primary storage. [2025-09-30T19:29:15.016012] [INFO ] [MAIN ] JOE: Loaded 24232 existing records. [2025-09-30T19:29:15.205307] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:29:15.205554] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-30T19:29:15.205602] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-30T19:29:15.206010] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-30T19:29:15.206087] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-30T19:29:15.465982] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-30T19:29:15.613405] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:15.655662] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T19:29:16.254368] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-30T19:29:16.514800] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T19:29:17.054362] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-30T19:29:17.438593] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T19:29:17.854376] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-30T19:29:17.954694] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-30T19:29:18.654355] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-30T19:29:19.053994] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-30T19:29:19.454409] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-30T19:29:19.596606] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T19:29:20.158376] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-30T19:29:20.254366] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-30T19:29:21.054374] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-30T19:29:21.320069] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T19:29:21.576835] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-30T19:29:21.588943] [INFO ] [REMOTE ] JMIA: Full fetch complete (73256 records). [2025-09-30T19:29:21.589168] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-30T19:29:21.859836] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-30T19:29:22.035134] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-30T19:29:22.035262] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-30T19:29:22.036629] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-30T19:29:22.036726] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-30T19:29:22.038395] [DEBUG] [LOCAL ] JMIA: Trimmed 73256 records to 50631 (keeping 200 days of data) [2025-09-30T19:29:22.354004] [DEBUG] [LOCAL ] JMIA: Primary data saved (50631 records). [2025-09-30T19:29:22.354154] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-30T19:29:22.354327] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JMIA took 40.1s. Estimated remaining: 2h 34m 50s. Rate: 7.8 symbols/min [2025-09-30T19:29:22.547767] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:29:22.558207] [DEBUG] [LOCAL ] JOF: Loaded 7056 existing records from primary storage. [2025-09-30T19:29:22.558428] [INFO ] [MAIN ] JOF: Loaded 7056 existing records. [2025-09-30T19:29:22.660313] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-30T19:29:22.746132] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:29:22.746349] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-30T19:29:22.746400] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-30T19:29:22.746631] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-30T19:29:22.746721] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-30T19:29:23.142968] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:23.159956] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T19:29:23.458882] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-30T19:29:23.462883] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-30T19:29:24.254422] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-30T19:29:24.612342] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T19:29:24.741917] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-30T19:29:25.054357] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-30T19:29:25.715435] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-30T19:29:25.854352] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-30T19:29:26.650965] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-30T19:29:26.661634] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-30T19:29:26.679303] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T19:29:27.454374] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-30T19:29:27.871025] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T19:29:28.254378] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-30T19:29:28.827782] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-30T19:29:29.054329] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-30T19:29:29.524870] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-30T19:29:29.854360] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-30T19:29:30.654367] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-30T19:29:31.454381] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-30T19:29:31.651203] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-30T19:29:31.753243] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T19:29:32.203472] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-30T19:29:32.205629] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-30T19:29:32.254329] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-30T19:29:33.054348] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-30T19:29:33.854363] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-30T19:29:34.654338] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-30T19:29:34.679681] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-30T19:29:34.810276] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-30T19:29:34.935883] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-30T19:29:35.454361] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-30T19:29:35.836302] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-30T19:29:36.254400] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-30T19:29:37.054360] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-30T19:29:37.645396] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-30T19:29:37.797007] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-30T19:29:37.809376] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-09-30T19:29:37.809546] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-30T19:29:37.859541] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-30T19:29:38.235735] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-30T19:29:38.235839] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-30T19:29:38.236925] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-30T19:29:38.236996] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-30T19:29:38.238774] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-09-30T19:29:38.592849] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-09-30T19:29:38.593001] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-30T19:29:38.594889] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JNJ took 39.9s. Estimated remaining: 2h 34m 51s. Rate: 7.8 symbols/min [2025-09-30T19:29:38.662305] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-30T19:29:38.818326] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-30T19:29:38.823058] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:29:38.876446] [DEBUG] [LOCAL ] JPC: Loaded 37088 existing records from primary storage. [2025-09-30T19:29:38.876876] [INFO ] [MAIN ] JPC: Loaded 37088 existing records. [2025-09-30T19:29:39.099904] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:29:39.102080] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-30T19:29:39.102298] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-30T19:29:39.107227] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-30T19:29:39.108042] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-30T19:29:39.108303] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T19:29:39.101900] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-30T19:29:39.459505] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-30T19:29:39.489588] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:40.254374] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-30T19:29:40.779815] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-30T19:29:40.784984] [INFO ] [REMOTE ] JOE: Full fetch complete (36101 records). [2025-09-30T19:29:40.785103] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-30T19:29:41.063942] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-30T19:29:41.202188] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-30T19:29:41.202277] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-30T19:29:41.203002] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-30T19:29:41.203098] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-30T19:29:41.204184] [DEBUG] [LOCAL ] JOE: Trimmed 36101 records to 24183 (keeping 200 days of data) [2025-09-30T19:29:41.355413] [DEBUG] [LOCAL ] JOE: Primary data saved (24183 records). [2025-09-30T19:29:41.355611] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-30T19:29:41.355784] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOE took 26.6s. Estimated remaining: 2h 34m 38s. Rate: 7.8 symbols/min [2025-09-30T19:29:41.541154] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:29:41.599000] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-30T19:29:41.599366] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-09-30T19:29:41.726195] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-30T19:29:41.819773] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:29:41.820300] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-30T19:29:41.820449] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-30T19:29:41.829351] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-30T19:29:41.829462] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-30T19:29:41.866172] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-30T19:29:41.918983] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-30T19:29:42.262070] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:42.470263] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-30T19:29:42.654366] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-30T19:29:43.454382] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-30T19:29:44.137833] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T19:29:44.254361] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-30T19:29:44.296103] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T19:29:44.298775] [INFO ] [REMOTE ] JOF: Full fetch complete (9526 records). [2025-09-30T19:29:44.298867] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-30T19:29:44.737263] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-30T19:29:44.737363] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-30T19:29:44.737617] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-30T19:29:44.737689] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-30T19:29:44.738228] [DEBUG] [LOCAL ] JOF: Trimmed 9526 records to 7020 (keeping 200 days of data) [2025-09-30T19:29:44.780529] [DEBUG] [LOCAL ] JOF: Primary data saved (7020 records). [2025-09-30T19:29:44.780667] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-30T19:29:44.780807] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOF took 22.4s. Estimated remaining: 2h 34m 26s. Rate: 7.8 symbols/min [2025-09-30T19:29:44.959124] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:29:44.993496] [DEBUG] [LOCAL ] JQC: Loaded 33913 existing records from primary storage. [2025-09-30T19:29:44.993804] [INFO ] [MAIN ] JQC: Loaded 33913 existing records. [2025-09-30T19:29:45.059783] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-30T19:29:45.182217] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:29:45.182472] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-30T19:29:45.182519] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-30T19:29:45.182852] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-30T19:29:45.182911] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-30T19:29:45.566493] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:29:45.854388] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-30T19:29:46.493293] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-30T19:29:46.607236] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T19:29:46.654407] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-30T19:29:46.860580] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:29:47.454378] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-30T19:29:48.254361] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-30T19:29:48.978213] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-30T19:29:49.054332] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-30T19:29:49.423365] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-30T19:29:49.601289] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-30T19:29:49.854372] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-30T19:29:50.654370] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-30T19:29:51.005700] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-30T19:29:51.173738] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-30T19:29:51.454357] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-30T19:29:51.878321] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-30T19:29:52.254406] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-30T19:29:52.873992] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-30T19:29:53.054432] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-30T19:29:53.701741] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-30T19:29:53.854342] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-30T19:29:54.654327] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-30T19:29:54.861466] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T19:29:55.220842] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T19:29:55.454364] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-30T19:29:55.503387] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-30T19:29:56.254365] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-30T19:29:56.830058] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-30T19:29:57.054389] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-30T19:29:57.854335] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-30T19:29:57.927627] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-30T19:29:58.335864] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-30T19:29:58.654356] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-30T19:29:59.454381] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-30T19:30:00.254440] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-30T19:30:00.645814] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-09-30T19:30:00.658755] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-30T19:30:00.658972] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-30T19:30:00.968061] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T19:30:01.056834] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-30T19:30:01.152732] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-30T19:30:01.152836] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-30T19:30:01.153919] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-30T19:30:01.154003] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-30T19:30:01.155707] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53799 (keeping 200 days of data) [2025-09-30T19:30:01.281066] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-30T19:30:01.567373] [DEBUG] [LOCAL ] JOBY: Primary data saved (53799 records). [2025-09-30T19:30:01.567516] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-30T19:30:01.567632] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JOBY took 53.8s. Estimated remaining: 2h 34m 28s. Rate: 7.8 symbols/min [2025-09-30T19:30:01.771549] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:01.810680] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T19:30:01.837576] [DEBUG] [LOCAL ] JRI: Loaded 14768 existing records from primary storage. [2025-09-30T19:30:01.837912] [INFO ] [MAIN ] JRI: Loaded 14768 existing records. [2025-09-30T19:30:01.859713] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-30T19:30:02.061383] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:02.061765] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-30T19:30:02.061900] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-30T19:30:02.062452] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-30T19:30:02.062516] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-30T19:30:02.471320] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T19:30:02.514957] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:02.654371] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-30T19:30:03.454367] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-30T19:30:03.662084] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-30T19:30:04.254350] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-30T19:30:04.328454] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-30T19:30:05.060600] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-30T19:30:05.075791] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T19:30:05.436697] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-30T19:30:05.854376] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-30T19:30:06.654412] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-30T19:30:07.136329] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T19:30:07.143559] [INFO ] [REMOTE ] JQC: Full fetch complete (48957 records). [2025-09-30T19:30:07.143755] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-30T19:30:07.459454] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-30T19:30:07.565960] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-30T19:30:07.566132] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-30T19:30:07.567043] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-30T19:30:07.567187] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-30T19:30:07.568870] [DEBUG] [LOCAL ] JQC: Trimmed 48957 records to 34076 (keeping 200 days of data) [2025-09-30T19:30:07.700120] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-30T19:30:07.835413] [DEBUG] [LOCAL ] JQC: Primary data saved (34076 records). [2025-09-30T19:30:07.835610] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-30T19:30:07.835822] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JQC took 23.1s. Estimated remaining: 2h 34m 18s. Rate: 7.8 symbols/min [2025-09-30T19:30:08.027591] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:08.044510] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-30T19:30:08.053201] [INFO ] [REMOTE ] JPC: Full fetch complete (55708 records). [2025-09-30T19:30:08.053320] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-30T19:30:08.160593] [DEBUG] [LOCAL ] JRS: Loaded 11178 existing records from primary storage. [2025-09-30T19:30:08.172718] [INFO ] [MAIN ] JRS: Loaded 11178 existing records. [2025-09-30T19:30:08.272793] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-30T19:30:08.578672] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:08.629381] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-30T19:30:08.646844] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-30T19:30:08.664500] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-30T19:30:08.663855] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T19:30:08.685548] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-30T19:30:08.853534] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-30T19:30:08.871491] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-30T19:30:08.884741] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-30T19:30:08.890618] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-30T19:30:08.954459] [DEBUG] [LOCAL ] JPC: Trimmed 55708 records to 37115 (keeping 200 days of data) [2025-09-30T19:30:09.072774] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-30T19:30:09.291168] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:09.413092] [DEBUG] [LOCAL ] JPC: Primary data saved (37115 records). [2025-09-30T19:30:09.413251] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-30T19:30:09.414738] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JPC took 30.8s. Estimated remaining: 2h 34m 4s. Rate: 7.8 symbols/min [2025-09-30T19:30:09.609934] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:09.664703] [DEBUG] [LOCAL ] JXN: Loaded 45731 existing records from primary storage. [2025-09-30T19:30:09.665034] [INFO ] [MAIN ] JXN: Loaded 45731 existing records. [2025-09-30T19:30:09.863874] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:09.855810] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-30T19:30:09.865286] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-30T19:30:09.865354] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-30T19:30:09.865703] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-30T19:30:09.865764] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-30T19:30:10.173752] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T19:30:10.287905] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:10.654376] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-30T19:30:10.874324] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-30T19:30:10.895146] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-30T19:30:11.454366] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-30T19:30:12.216632] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T19:30:12.254323] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-30T19:30:13.054386] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-30T19:30:13.742399] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-30T19:30:13.781818] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T19:30:13.800522] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T19:30:13.854335] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-30T19:30:14.622401] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-30T19:30:14.654340] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-30T19:30:15.454406] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-30T19:30:16.226315] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-30T19:30:16.254371] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-30T19:30:16.899098] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T19:30:17.054370] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-30T19:30:17.188374] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-30T19:30:17.200280] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-09-30T19:30:17.200460] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-30T19:30:17.614910] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-30T19:30:17.615033] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-30T19:30:17.616418] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-30T19:30:17.616492] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-30T19:30:17.618751] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-09-30T19:30:17.855865] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-30T19:30:17.882071] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T19:30:18.011680] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-09-30T19:30:18.011860] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-30T19:30:18.011958] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JPM took 36.7s. Estimated remaining: 2h 33m 58s. Rate: 7.8 symbols/min [2025-09-30T19:30:18.211295] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:18.263888] [DEBUG] [LOCAL ] K: Loaded 49924 existing records from primary storage. [2025-09-30T19:30:18.264273] [INFO ] [MAIN ] K: Loaded 49924 existing records. [2025-09-30T19:30:18.460588] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:18.460938] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-30T19:30:18.460993] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-30T19:30:18.461502] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-30T19:30:18.461736] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-30T19:30:18.658746] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-30T19:30:18.792168] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T19:30:18.889774] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:19.454364] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-30T19:30:19.753870] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-30T19:30:20.254366] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-30T19:30:20.319003] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-30T19:30:21.050969] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T19:30:21.054217] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-30T19:30:21.854357] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-30T19:30:21.891448] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-30T19:30:21.896216] [INFO ] [REMOTE ] JRI: Full fetch complete (23192 records). [2025-09-30T19:30:21.896319] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-30T19:30:22.303078] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-30T19:30:22.303166] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-30T19:30:22.303693] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-30T19:30:22.303771] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-30T19:30:22.304578] [DEBUG] [LOCAL ] JRI: Trimmed 23192 records to 14806 (keeping 200 days of data) [2025-09-30T19:30:22.410991] [DEBUG] [LOCAL ] JRI: Primary data saved (14806 records). [2025-09-30T19:30:22.411142] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-30T19:30:22.411271] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JRI took 20.8s. Estimated remaining: 2h 33m 47s. Rate: 7.8 symbols/min [2025-09-30T19:30:22.610076] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:22.621880] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T19:30:22.636545] [DEBUG] [LOCAL ] KAI: Loaded 13338 existing records from primary storage. [2025-09-30T19:30:22.636877] [INFO ] [MAIN ] KAI: Loaded 13338 existing records. [2025-09-30T19:30:22.659541] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-30T19:30:22.836684] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:22.837073] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-30T19:30:22.837147] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-30T19:30:22.837397] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-30T19:30:22.837458] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-30T19:30:23.272963] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:23.454362] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-30T19:30:23.613750] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T19:30:24.254382] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-30T19:30:24.337496] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T19:30:25.054415] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-30T19:30:25.167220] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T19:30:25.854336] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-30T19:30:25.893046] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T19:30:26.626898] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-30T19:30:26.654400] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-30T19:30:27.297792] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T19:30:27.300903] [INFO ] [REMOTE ] JRS: Full fetch complete (16148 records). [2025-09-30T19:30:27.300982] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-30T19:30:27.459632] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-30T19:30:27.704265] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-30T19:30:27.704356] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-30T19:30:27.704871] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-30T19:30:27.704936] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-30T19:30:27.705698] [DEBUG] [LOCAL ] JRS: Trimmed 16148 records to 11261 (keeping 200 days of data) [2025-09-30T19:30:27.772662] [DEBUG] [LOCAL ] JRS: Primary data saved (11261 records). [2025-09-30T19:30:27.772814] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-30T19:30:27.772905] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JRS took 19.9s. Estimated remaining: 2h 33m 37s. Rate: 7.8 symbols/min [2025-09-30T19:30:27.960371] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:28.003989] [DEBUG] [LOCAL ] KAR: Loaded 39817 existing records from primary storage. [2025-09-30T19:30:28.004301] [INFO ] [MAIN ] KAR: Loaded 39817 existing records. [2025-09-30T19:30:28.192992] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:28.193227] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-30T19:30:28.193277] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-30T19:30:28.193696] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-30T19:30:28.193757] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-30T19:30:28.259926] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-30T19:30:28.586517] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:29.054334] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-30T19:30:29.272885] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T19:30:29.854321] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-30T19:30:29.918374] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T19:30:30.028210] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T19:30:30.654356] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-30T19:30:31.454359] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-30T19:30:31.522886] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-30T19:30:32.254349] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-30T19:30:32.441692] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:30:32.995946] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T19:30:33.054353] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-30T19:30:33.798936] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:30:33.854373] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-30T19:30:34.178032] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T19:30:34.654329] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-30T19:30:34.861176] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-30T19:30:35.454325] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-30T19:30:35.779377] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-30T19:30:36.254407] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-30T19:30:36.617039] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-30T19:30:37.054386] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-30T19:30:37.593987] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-30T19:30:37.854415] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-30T19:30:38.654416] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-30T19:30:38.738786] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:30:39.454334] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-30T19:30:39.597945] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-30T19:30:39.676466] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T19:30:40.254361] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-30T19:30:40.891492] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T19:30:41.054412] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-30T19:30:41.860198] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-30T19:30:41.886151] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T19:30:42.589064] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T19:30:42.634211] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T19:30:42.654341] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-30T19:30:43.454410] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-30T19:30:44.192587] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T19:30:44.254348] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-30T19:30:44.949803] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T19:30:45.054337] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-30T19:30:45.211628] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T19:30:45.854423] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-30T19:30:46.234929] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-30T19:30:46.654405] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-30T19:30:47.358095] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T19:30:47.454348] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-30T19:30:48.254332] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-30T19:30:48.347954] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:30:48.450035] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T19:30:49.054404] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-30T19:30:49.800102] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-30T19:30:49.854353] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-30T19:30:49.965320] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T19:30:49.968477] [INFO ] [REMOTE ] KAI: Full fetch complete (18876 records). [2025-09-30T19:30:49.968566] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-30T19:30:50.394567] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-30T19:30:50.394682] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-30T19:30:50.395161] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-30T19:30:50.395211] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-30T19:30:50.395997] [DEBUG] [LOCAL ] KAI: Trimmed 18876 records to 13286 (keeping 200 days of data) [2025-09-30T19:30:50.486787] [DEBUG] [LOCAL ] KAI: Primary data saved (13286 records). [2025-09-30T19:30:50.487009] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-30T19:30:50.487124] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAI took 28.1s. Estimated remaining: 2h 33m 44s. Rate: 7.8 symbols/min [2025-09-30T19:30:50.663765] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-30T19:30:50.698718] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:50.729318] [DEBUG] [LOCAL ] KB: Loaded 24026 existing records from primary storage. [2025-09-30T19:30:50.729757] [INFO ] [MAIN ] KB: Loaded 24026 existing records. [2025-09-30T19:30:50.911926] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:50.912279] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-30T19:30:50.912335] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-30T19:30:50.912761] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-30T19:30:50.912823] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-30T19:30:51.295881] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:51.454393] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-30T19:30:51.682625] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-30T19:30:51.692451] [INFO ] [REMOTE ] JXN: Full fetch complete (65297 records). [2025-09-30T19:30:51.692636] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-30T19:30:52.118020] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-30T19:30:52.118230] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-30T19:30:52.119324] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-30T19:30:52.119410] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-30T19:30:52.121003] [DEBUG] [LOCAL ] JXN: Trimmed 65297 records to 45657 (keeping 200 days of data) [2025-09-30T19:30:52.254621] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-30T19:30:52.410060] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-30T19:30:52.448280] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T19:30:52.505499] [DEBUG] [LOCAL ] JXN: Primary data saved (45657 records). [2025-09-30T19:30:52.505661] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-30T19:30:52.506257] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. JXN took 43.1s. Estimated remaining: 2h 33m 31s. Rate: 7.8 symbols/min [2025-09-30T19:30:52.695740] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:30:52.724599] [DEBUG] [LOCAL ] KBDC: Loaded 20926 existing records from primary storage. [2025-09-30T19:30:52.724939] [INFO ] [MAIN ] KBDC: Loaded 20926 existing records. [2025-09-30T19:30:52.924065] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:30:52.924299] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-30T19:30:52.924353] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-30T19:30:52.924859] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-30T19:30:52.924922] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-30T19:30:53.059525] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-30T19:30:53.318750] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:30:53.854398] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-30T19:30:53.984813] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T19:30:54.223148] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T19:30:54.654390] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-30T19:30:54.697311] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-30T19:30:55.454384] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-30T19:30:56.254343] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-30T19:30:56.533792] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T19:30:56.582203] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T19:30:57.054357] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-30T19:30:57.199185] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-30T19:30:57.854367] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-30T19:30:58.654376] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-30T19:30:58.871791] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T19:30:58.937541] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-30T19:30:59.454372] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-30T19:30:59.473781] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-30T19:31:00.254366] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-30T19:31:00.625125] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T19:31:01.054366] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-30T19:31:01.642335] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:31:01.854413] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-30T19:31:02.654435] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-30T19:31:02.757060] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-30T19:31:03.004757] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T19:31:03.454370] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-30T19:31:04.254374] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-30T19:31:04.880886] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-30T19:31:04.892864] [INFO ] [REMOTE ] K: Full fetch complete (72028 records). [2025-09-30T19:31:04.893040] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-30T19:31:05.054800] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-30T19:31:05.148619] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-30T19:31:05.367712] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-30T19:31:05.367936] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-30T19:31:05.369080] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-30T19:31:05.369167] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-30T19:31:05.396698] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T19:31:05.396873] [DEBUG] [LOCAL ] K: Trimmed 72028 records to 49962 (keeping 200 days of data) [2025-09-30T19:31:05.407582] [INFO ] [REMOTE ] KAR: Full fetch complete (56767 records). [2025-09-30T19:31:05.407806] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-30T19:31:05.859932] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-30T19:31:05.975937] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-30T19:31:05.976323] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-30T19:31:05.977425] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-30T19:31:05.978342] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-30T19:31:05.981595] [DEBUG] [LOCAL ] KAR: Trimmed 56767 records to 39860 (keeping 200 days of data) [2025-09-30T19:31:06.381222] [DEBUG] [LOCAL ] KAR: Primary data saved (39860 records). [2025-09-30T19:31:06.387419] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-30T19:31:06.387630] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. KAR took 38.6s. Estimated remaining: 2h 33m 29s. Rate: 7.8 symbols/min [2025-09-30T19:31:06.654236] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:06.680782] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-30T19:31:06.679788] [DEBUG] [LOCAL ] K: Primary data saved (49962 records). [2025-09-30T19:31:06.686637] [INFO ] [MAIN ] K: Full history saved. [2025-09-30T19:31:06.692630] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. K took 48.7s. Estimated remaining: 2h 33m 14s. Rate: 7.8 symbols/min [2025-09-30T19:31:06.698921] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-30T19:31:06.724940] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T19:31:06.905765] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:06.916942] [DEBUG] [LOCAL ] KBR: No existing data file found in primary storage. [2025-09-30T19:31:06.917025] [WARN ] [MAIN ] KBR: No existing data found, performing full refresh instead. [2025-09-30T19:31:06.917156] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-30T19:31:06.917199] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-30T19:31:06.917242] [DEBUG] [LOCAL ] KBR: No primary data file found to delete. [2025-09-30T19:31:06.917274] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-30T19:31:07.078299] [DEBUG] [LOCAL ] KBH: Loaded 48938 existing records from primary storage. [2025-09-30T19:31:07.109032] [INFO ] [MAIN ] KBH: Loaded 48938 existing records. [2025-09-30T19:31:07.471571] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-30T19:31:07.551420] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:31:07.559667] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:07.561222] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-30T19:31:07.561709] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-30T19:31:07.562229] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-30T19:31:07.562291] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-30T19:31:07.968531] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:07.985334] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-30T19:31:08.254340] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-30T19:31:08.504774] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-30T19:31:09.054368] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-30T19:31:09.856390] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-30T19:31:09.860097] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-30T19:31:10.654380] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-30T19:31:10.724523] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T19:31:11.134213] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-30T19:31:11.454381] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-30T19:31:12.031631] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T19:31:12.254332] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-30T19:31:12.412528] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T19:31:13.054333] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-30T19:31:13.077450] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T19:31:13.854371] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-30T19:31:14.486449] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-30T19:31:14.493474] [INFO ] [REMOTE ] KBDC: Full fetch complete (28708 records). [2025-09-30T19:31:14.493635] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-30T19:31:14.659444] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-30T19:31:14.925974] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-30T19:31:14.926094] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-30T19:31:14.926796] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-30T19:31:14.926860] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-30T19:31:14.927634] [DEBUG] [LOCAL ] KBDC: Trimmed 28708 records to 21049 (keeping 200 days of data) [2025-09-30T19:31:15.041006] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-30T19:31:15.048588] [INFO ] [REMOTE ] KB: Full fetch complete (34123 records). [2025-09-30T19:31:15.051203] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-30T19:31:15.435665] [DEBUG] [LOCAL ] KBDC: Primary data saved (21049 records). [2025-09-30T19:31:15.451250] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-30T19:31:15.476124] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 23.0s. Estimated remaining: 2h 33m 7s. Rate: 7.8 symbols/min [2025-09-30T19:31:15.456512] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-30T19:31:15.592700] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-30T19:31:15.609843] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-30T19:31:15.633324] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-30T19:31:15.633436] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-30T19:31:15.682099] [DEBUG] [LOCAL ] KB: Trimmed 34123 records to 24012 (keeping 200 days of data) [2025-09-30T19:31:15.735526] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:15.921993] [DEBUG] [LOCAL ] KB: Primary data saved (24012 records). [2025-09-30T19:31:15.921895] [DEBUG] [LOCAL ] KD: Loaded 52300 existing records from primary storage. [2025-09-30T19:31:15.922147] [INFO ] [MAIN ] KB: Full history saved. [2025-09-30T19:31:15.922265] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KB took 25.4s. Estimated remaining: 2h 32m 52s. Rate: 7.8 symbols/min [2025-09-30T19:31:15.922697] [INFO ] [MAIN ] KD: Loaded 52300 existing records. [2025-09-30T19:31:16.271308] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:31:16.303167] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-30T19:31:16.335289] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-30T19:31:16.339843] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:16.339963] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-30T19:31:16.340284] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-30T19:31:16.471062] [DEBUG] [LOCAL ] KEN: Loaded 4731 existing records from primary storage. [2025-09-30T19:31:16.497837] [INFO ] [MAIN ] KEN: Loaded 4731 existing records. [2025-09-30T19:31:16.890019] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:31:16.895716] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-30T19:31:16.895860] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-30T19:31:16.995390] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:16.984292] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-30T19:31:17.006734] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-30T19:31:17.010901] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-30T19:31:17.044780] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-30T19:31:17.125395] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-30T19:31:17.436666] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-30T19:31:17.470835] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:17.854355] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-30T19:31:18.467328] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T19:31:18.511455] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:31:18.654373] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-30T19:31:19.454366] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-30T19:31:19.548241] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:31:20.254388] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-30T19:31:20.377112] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-30T19:31:20.732520] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-30T19:31:21.000806] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:31:21.054391] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-30T19:31:21.854376] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-30T19:31:22.654358] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-30T19:31:22.817015] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-30T19:31:23.454320] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-30T19:31:23.658471] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T19:31:24.254350] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-30T19:31:24.333374] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:31:25.054351] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-30T19:31:25.306812] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T19:31:25.854377] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-30T19:31:26.014504] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-30T19:31:26.427000] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T19:31:26.654380] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-30T19:31:26.869076] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T19:31:27.454363] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-30T19:31:28.254366] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-30T19:31:28.430929] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-30T19:31:29.054355] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-30T19:31:29.214300] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T19:31:29.862954] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-30T19:31:29.869169] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T19:31:30.414866] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-30T19:31:30.654353] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-30T19:31:31.454324] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-30T19:31:31.672665] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-30T19:31:31.919731] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T19:31:32.259442] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-30T19:31:32.276577] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T19:31:33.054368] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-30T19:31:33.854339] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-30T19:31:33.986396] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T19:31:34.654368] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-30T19:31:35.258825] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T19:31:35.270723] [INFO ] [REMOTE ] KBH: Full fetch complete (70774 records). [2025-09-30T19:31:35.270933] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-30T19:31:35.454724] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-30T19:31:35.693961] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-30T19:31:35.694188] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-30T19:31:35.695255] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-30T19:31:35.695344] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-30T19:31:35.727674] [DEBUG] [LOCAL ] KBH: Trimmed 70774 records to 48913 (keeping 200 days of data) [2025-09-30T19:31:35.729828] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-30T19:31:36.053908] [DEBUG] [LOCAL ] KBH: Primary data saved (48913 records). [2025-09-30T19:31:36.054060] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-30T19:31:36.054207] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KBH took 29.7s. Estimated remaining: 2h 32m 57s. Rate: 7.8 symbols/min [2025-09-30T19:31:36.259997] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:36.255235] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-30T19:31:36.296585] [DEBUG] [LOCAL ] KEP: Loaded 30817 existing records from primary storage. [2025-09-30T19:31:36.300298] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-30T19:31:36.300801] [INFO ] [MAIN ] KEP: Loaded 30817 existing records. [2025-09-30T19:31:36.506234] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T19:31:36.527599] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:31:36.537441] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-30T19:31:36.537527] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-30T19:31:36.538343] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-30T19:31:36.538411] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-30T19:31:36.944702] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:37.054374] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-30T19:31:37.854364] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-30T19:31:38.010167] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T19:31:38.654394] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-30T19:31:38.756974] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T19:31:38.767470] [INFO ] [REMOTE ] KBR: Full fetch complete (69904 records). [2025-09-30T19:31:38.767627] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-30T19:31:39.022412] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T19:31:39.289232] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-30T19:31:39.289314] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-30T19:31:39.290416] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-30T19:31:39.290485] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-30T19:31:39.292053] [DEBUG] [LOCAL ] KBR: Trimmed 69904 records to 48052 (keeping 200 days of data) [2025-09-30T19:31:39.487860] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-30T19:31:39.640075] [DEBUG] [LOCAL ] KBR: Primary data saved (48052 records). [2025-09-30T19:31:39.640434] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-30T19:31:39.640985] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KBR took 32.9s. Estimated remaining: 2h 32m 45s. Rate: 7.8 symbols/min [2025-09-30T19:31:39.904079] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:39.954192] [DEBUG] [LOCAL ] KEX: Loaded 38072 existing records from primary storage. [2025-09-30T19:31:39.954555] [INFO ] [MAIN ] KEX: Loaded 38072 existing records. [2025-09-30T19:31:40.099554] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T19:31:40.177185] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:31:40.178077] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-30T19:31:40.178198] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-30T19:31:40.179299] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-30T19:31:40.179362] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-30T19:31:40.259483] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-30T19:31:40.605141] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:40.639249] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-30T19:31:41.054331] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-30T19:31:41.415497] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-30T19:31:41.854336] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-30T19:31:42.547957] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T19:31:42.654376] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-30T19:31:42.996590] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-30T19:31:43.454402] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-30T19:31:44.191941] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T19:31:44.203701] [INFO ] [REMOTE ] KD: Full fetch complete (75655 records). [2025-09-30T19:31:44.203886] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-30T19:31:44.263034] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-30T19:31:44.629156] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-30T19:31:44.629328] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-30T19:31:44.630316] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-30T19:31:44.630407] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-30T19:31:44.631989] [DEBUG] [LOCAL ] KD: Trimmed 75655 records to 52305 (keeping 200 days of data) [2025-09-30T19:31:44.955910] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-30T19:31:44.996344] [DEBUG] [LOCAL ] KD: Primary data saved (52305 records). [2025-09-30T19:31:45.011236] [INFO ] [MAIN ] KD: Full history saved. [2025-09-30T19:31:45.012803] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KD took 29.5s. Estimated remaining: 2h 32m 35s. Rate: 7.8 symbols/min [2025-09-30T19:31:45.019814] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T19:31:45.059509] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-30T19:31:45.225401] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:45.225626] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-30T19:31:45.225716] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-30T19:31:45.225865] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-30T19:31:45.225936] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-30T19:31:45.226060] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-30T19:31:45.226150] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-30T19:31:45.609576] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:45.780837] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T19:31:45.854388] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-30T19:31:46.577850] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-30T19:31:46.654403] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-30T19:31:47.454398] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-30T19:31:48.009854] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-30T19:31:48.051006] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-30T19:31:48.254364] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-30T19:31:49.054393] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-30T19:31:49.371877] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-30T19:31:49.854401] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-30T19:31:50.538447] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-30T19:31:50.540324] [INFO ] [REMOTE ] KEN: Full fetch complete (5951 records). [2025-09-30T19:31:50.540456] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-30T19:31:50.660428] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-30T19:31:50.969752] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-30T19:31:50.969859] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-30T19:31:50.970062] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-30T19:31:50.970351] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-30T19:31:50.970990] [DEBUG] [LOCAL ] KEN: Trimmed 5951 records to 4740 (keeping 200 days of data) [2025-09-30T19:31:51.001384] [DEBUG] [LOCAL ] KEN: Primary data saved (4740 records). [2025-09-30T19:31:51.001628] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-30T19:31:51.001762] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KEN took 35.1s. Estimated remaining: 2h 32m 26s. Rate: 7.8 symbols/min [2025-09-30T19:31:51.164290] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-30T19:31:51.240745] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:31:51.295833] [DEBUG] [LOCAL ] KEYS: Loaded 43195 existing records from primary storage. [2025-09-30T19:31:51.296207] [INFO ] [MAIN ] KEYS: Loaded 43195 existing records. [2025-09-30T19:31:51.464410] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-30T19:31:51.500586] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:31:51.501162] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-30T19:31:51.501223] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-30T19:31:51.501787] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-30T19:31:51.501850] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-30T19:31:51.908463] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:31:52.251713] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T19:31:52.259781] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-30T19:31:53.054375] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-30T19:31:53.343215] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-30T19:31:53.393559] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T19:31:53.854388] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-30T19:31:54.542722] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T19:31:54.654372] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-30T19:31:55.441446] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:31:55.456308] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-30T19:31:55.934664] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T19:31:56.254432] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-30T19:31:56.391187] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-30T19:31:57.054384] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-30T19:31:57.449513] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T19:31:57.854358] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-30T19:31:58.354211] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T19:31:58.654384] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-30T19:31:59.454327] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-30T19:31:59.574462] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T19:32:00.186535] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:32:00.254362] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-30T19:32:00.935681] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T19:32:01.054410] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-30T19:32:01.854337] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-30T19:32:02.101260] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-30T19:32:02.654371] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-30T19:32:02.689807] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T19:32:03.289979] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T19:32:03.454425] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-30T19:32:04.196391] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T19:32:04.254350] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-30T19:32:04.989725] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:32:05.054407] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-30T19:32:05.768161] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T19:32:05.854369] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-30T19:32:06.514292] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-30T19:32:06.524417] [INFO ] [REMOTE ] KEX: Full fetch complete (55688 records). [2025-09-30T19:32:06.524591] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-30T19:32:06.659555] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-30T19:32:06.961465] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-30T19:32:06.961562] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-30T19:32:06.962472] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-30T19:32:06.962540] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-30T19:32:06.963930] [DEBUG] [LOCAL ] KEX: Trimmed 55688 records to 38053 (keeping 200 days of data) [2025-09-30T19:32:07.208513] [DEBUG] [LOCAL ] KEX: Primary data saved (38053 records). [2025-09-30T19:32:07.208718] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-30T19:32:07.208872] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEX took 27.6s. Estimated remaining: 2h 32m 27s. Rate: 7.8 symbols/min [2025-09-30T19:32:07.372350] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T19:32:07.432724] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:07.438685] [DEBUG] [LOCAL ] KF: Loaded 2467 existing records from primary storage. [2025-09-30T19:32:07.438957] [INFO ] [MAIN ] KF: Loaded 2467 existing records. [2025-09-30T19:32:07.460246] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-30T19:32:07.634828] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:07.635066] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-30T19:32:07.635114] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-30T19:32:07.635304] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-30T19:32:07.635363] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-30T19:32:08.053086] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:08.254347] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-30T19:32:08.553251] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-30T19:32:08.736022] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-30T19:32:08.753805] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-30T19:32:09.054371] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-30T19:32:09.854386] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-30T19:32:10.654373] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-30T19:32:10.756717] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-30T19:32:11.145307] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T19:32:11.260531] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:32:11.267689] [INFO ] [REMOTE ] KEP: Full fetch complete (41659 records). [2025-09-30T19:32:11.267828] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-30T19:32:11.462478] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-30T19:32:11.703286] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-30T19:32:11.703389] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-30T19:32:11.704388] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-30T19:32:11.704465] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-30T19:32:11.706044] [DEBUG] [LOCAL ] KEP: Trimmed 41659 records to 30960 (keeping 200 days of data) [2025-09-30T19:32:11.909831] [DEBUG] [LOCAL ] KEP: Primary data saved (30960 records). [2025-09-30T19:32:11.910020] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-30T19:32:11.910195] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KEP took 35.9s. Estimated remaining: 2h 32m 16s. Rate: 7.8 symbols/min [2025-09-30T19:32:12.099427] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:12.125577] [DEBUG] [LOCAL ] KFRC: Loaded 19512 existing records from primary storage. [2025-09-30T19:32:12.125873] [INFO ] [MAIN ] KFRC: Loaded 19512 existing records. [2025-09-30T19:32:12.259442] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-30T19:32:12.330962] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:12.331220] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-30T19:32:12.331291] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-30T19:32:12.331578] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-30T19:32:12.331638] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-30T19:32:12.731623] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:13.054373] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-30T19:32:13.513216] [DEBUG] [REMOTE ] KF: Error fetching primary data for 2025-02: Server request status code is 503. [2025-09-30T19:32:13.513575] [WARN ] [REMOTE ] KF: No data returned for month 2025-02 [2025-09-30T19:32:13.513699] [FATAL] [REMOTE ] KF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:32:13.513828] [FATAL] [MAIN ] KF: Failed to fetch primary data. [2025-09-30T19:32:13.513899] [WARN ] [MAIN ] KF: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:32:13.513956] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-30T19:32:13.514013] [DEBUG] [LOCAL ] KF: No primary data file found to delete. [2025-09-30T19:32:13.514048] [INFO ] [LOCAL ] KF: Starting deletion of derivative data. [2025-09-30T19:32:13.514415] [DEBUG] [LOCAL ] KF: Deleted derivative data file. [2025-09-30T19:32:13.514544] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KF took 6.3s. Estimated remaining: 2h 32m 2s. Rate: 7.8 symbols/min [2025-09-30T19:32:13.705985] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:13.717680] [DEBUG] [LOCAL ] KFS: Loaded 8440 existing records from primary storage. [2025-09-30T19:32:13.717919] [INFO ] [MAIN ] KFS: Loaded 8440 existing records. [2025-09-30T19:32:13.887570] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-30T19:32:13.925402] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:13.926639] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-30T19:32:13.926748] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-30T19:32:13.927128] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-30T19:32:13.927256] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-30T19:32:14.265697] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-30T19:32:14.369515] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:14.654338] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-30T19:32:14.869332] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-30T19:32:15.029555] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T19:32:15.454427] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-30T19:32:16.041440] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-30T19:32:16.069047] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T19:32:16.254360] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-30T19:32:16.825390] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-30T19:32:17.054349] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-30T19:32:17.854360] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-30T19:32:18.486397] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-30T19:32:18.654337] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-30T19:32:18.893600] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-30T19:32:19.454368] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-30T19:32:19.586111] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T19:32:20.065906] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-30T19:32:20.254364] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-30T19:32:21.054354] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-30T19:32:21.854340] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-30T19:32:22.208419] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T19:32:22.220038] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-09-30T19:32:22.220227] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-30T19:32:22.442273] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T19:32:22.443812] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:32:22.444009] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:32:22.444355] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-30T19:32:22.444539] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-30T19:32:22.444599] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-30T19:32:22.444681] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-30T19:32:22.444800] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KEY took 37.4s. Estimated remaining: 2h 31m 56s. Rate: 7.8 symbols/min [2025-09-30T19:32:22.532483] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-30T19:32:22.643201] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:22.657984] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-30T19:32:22.687261] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T19:32:22.725633] [DEBUG] [LOCAL ] KFY: Loaded 30178 existing records from primary storage. [2025-09-30T19:32:22.725956] [INFO ] [MAIN ] KFY: Loaded 30178 existing records. [2025-09-30T19:32:22.930091] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:22.930336] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-30T19:32:22.930386] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-30T19:32:22.930846] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-30T19:32:22.930908] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-30T19:32:23.335865] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:23.341887] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T19:32:23.454355] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-30T19:32:24.254361] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-30T19:32:24.409465] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-30T19:32:25.040869] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-30T19:32:25.054500] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-30T19:32:25.854359] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-30T19:32:26.109848] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T19:32:26.654366] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-30T19:32:26.666985] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T19:32:27.454351] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-30T19:32:27.984319] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-30T19:32:28.254351] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-30T19:32:28.417703] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-30T19:32:29.054350] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-30T19:32:29.591828] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T19:32:29.854389] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-30T19:32:30.048269] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-30T19:32:30.614259] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T19:32:30.654414] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-30T19:32:31.454345] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-30T19:32:31.837036] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T19:32:32.254407] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-30T19:32:33.061700] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-30T19:32:33.067955] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T19:32:33.078537] [INFO ] [REMOTE ] KEYS: Full fetch complete (62920 records). [2025-09-30T19:32:33.078715] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-30T19:32:33.544102] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-30T19:32:33.544388] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-30T19:32:33.545541] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-30T19:32:33.545722] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-30T19:32:33.547861] [DEBUG] [LOCAL ] KEYS: Trimmed 62920 records to 43162 (keeping 200 days of data) [2025-09-30T19:32:33.685492] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T19:32:33.854450] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-30T19:32:33.897999] [DEBUG] [LOCAL ] KEYS: Primary data saved (43162 records). [2025-09-30T19:32:33.898248] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-30T19:32:33.898490] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KEYS took 42.9s. Estimated remaining: 2h 31m 52s. Rate: 7.8 symbols/min [2025-09-30T19:32:34.084082] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-30T19:32:34.111392] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:34.186460] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-30T19:32:34.186958] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-09-30T19:32:34.386184] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:34.386502] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-30T19:32:34.386558] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-30T19:32:34.387413] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-30T19:32:34.387490] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-30T19:32:34.665492] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-30T19:32:34.786198] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:35.057914] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T19:32:35.454460] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-30T19:32:35.636174] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T19:32:36.254399] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-30T19:32:36.672287] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-30T19:32:36.798867] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-30T19:32:36.801586] [INFO ] [REMOTE ] KFS: Full fetch complete (10559 records). [2025-09-30T19:32:36.801722] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-30T19:32:37.059883] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-30T19:32:37.203060] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-30T19:32:37.203179] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-30T19:32:37.203556] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-30T19:32:37.203676] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-30T19:32:37.204235] [DEBUG] [LOCAL ] KFS: Trimmed 10559 records to 8472 (keeping 200 days of data) [2025-09-30T19:32:37.257248] [DEBUG] [LOCAL ] KFS: Primary data saved (8472 records). [2025-09-30T19:32:37.257407] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-30T19:32:37.257532] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 23.7s. Estimated remaining: 2h 31m 40s. Rate: 7.8 symbols/min [2025-09-30T19:32:37.440513] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:37.495049] [DEBUG] [LOCAL ] KGS: Loaded 45714 existing records from primary storage. [2025-09-30T19:32:37.495403] [INFO ] [MAIN ] KGS: Loaded 45714 existing records. [2025-09-30T19:32:37.682146] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:37.682372] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-30T19:32:37.682419] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-30T19:32:37.682812] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-30T19:32:37.682872] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-30T19:32:37.869787] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-30T19:32:38.109825] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:38.654453] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-30T19:32:38.966762] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T19:32:38.994506] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-30T19:32:39.454394] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-30T19:32:40.186166] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T19:32:40.254327] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-30T19:32:40.615812] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T19:32:41.054414] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-30T19:32:41.828000] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-30T19:32:41.854325] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-30T19:32:42.337100] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T19:32:42.343058] [INFO ] [REMOTE ] KFRC: Full fetch complete (25562 records). [2025-09-30T19:32:42.343208] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-30T19:32:42.657031] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-30T19:32:42.745860] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-30T19:32:42.745944] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-30T19:32:42.746531] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-30T19:32:42.747620] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-30T19:32:42.748489] [DEBUG] [LOCAL ] KFRC: Trimmed 25562 records to 19559 (keeping 200 days of data) [2025-09-30T19:32:42.880010] [DEBUG] [LOCAL ] KFRC: Primary data saved (19559 records). [2025-09-30T19:32:42.880425] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-30T19:32:42.880668] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFRC took 31.0s. Estimated remaining: 2h 31m 30s. Rate: 7.8 symbols/min [2025-09-30T19:32:43.074029] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:43.155721] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T19:32:43.223825] [DEBUG] [LOCAL ] KIM: Loaded 53047 existing records from primary storage. [2025-09-30T19:32:43.224219] [INFO ] [MAIN ] KIM: Loaded 53047 existing records. [2025-09-30T19:32:43.436854] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:43.437112] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-30T19:32:43.437163] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-30T19:32:43.437750] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-30T19:32:43.437812] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-30T19:32:43.461443] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-30T19:32:43.885577] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:44.086187] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:32:44.254366] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-30T19:32:45.054388] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-30T19:32:45.492887] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-30T19:32:45.854412] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-30T19:32:45.942735] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-30T19:32:46.397673] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T19:32:46.654393] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-30T19:32:47.052194] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-30T19:32:47.454390] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-30T19:32:48.002348] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-30T19:32:48.254434] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-30T19:32:49.054329] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-30T19:32:49.098482] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:32:49.854605] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-30T19:32:49.859752] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:32:50.436744] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T19:32:50.654410] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-30T19:32:51.028360] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T19:32:51.454366] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-30T19:32:52.254347] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-30T19:32:52.308474] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-30T19:32:53.054370] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-30T19:32:53.313487] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-30T19:32:53.749608] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-30T19:32:53.854373] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-30T19:32:54.537828] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:32:54.545435] [INFO ] [REMOTE ] KFY: Full fetch complete (43493 records). [2025-09-30T19:32:54.545598] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-30T19:32:54.660047] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-30T19:32:54.980145] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-30T19:32:54.980258] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-30T19:32:54.981358] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-30T19:32:54.981447] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-30T19:32:54.982699] [DEBUG] [LOCAL ] KFY: Trimmed 43493 records to 30083 (keeping 200 days of data) [2025-09-30T19:32:55.136632] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-30T19:32:55.225695] [DEBUG] [LOCAL ] KFY: Primary data saved (30083 records). [2025-09-30T19:32:55.225869] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-30T19:32:55.226552] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KFY took 32.8s. Estimated remaining: 2h 31m 27s. Rate: 7.8 symbols/min [2025-09-30T19:32:55.422475] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:32:55.450430] [DEBUG] [LOCAL ] KIO: Loaded 21347 existing records from primary storage. [2025-09-30T19:32:55.450732] [INFO ] [MAIN ] KIO: Loaded 21347 existing records. [2025-09-30T19:32:55.463120] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-30T19:32:55.676962] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:32:55.677211] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-30T19:32:55.677260] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-30T19:32:55.677453] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-30T19:32:55.677513] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-30T19:32:56.086322] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:32:56.254397] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-30T19:32:56.573872] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T19:32:56.952807] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T19:32:57.054371] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-30T19:32:57.854375] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-30T19:32:57.998763] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-30T19:32:58.654362] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-30T19:32:58.848098] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T19:32:59.454354] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-30T19:32:59.556958] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T19:33:00.001208] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T19:33:00.254364] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-30T19:33:01.054401] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-30T19:33:01.302107] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T19:33:01.706740] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T19:33:01.854320] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-30T19:33:02.206041] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-30T19:33:02.217285] [INFO ] [REMOTE ] KGS: Full fetch complete (66333 records). [2025-09-30T19:33:02.217469] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-30T19:33:02.638475] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-30T19:33:02.638565] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-30T19:33:02.639461] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-30T19:33:02.639531] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-30T19:33:02.640982] [DEBUG] [LOCAL ] KGS: Trimmed 66333 records to 45721 (keeping 200 days of data) [2025-09-30T19:33:02.696840] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-30T19:33:02.943945] [DEBUG] [LOCAL ] KGS: Primary data saved (45721 records). [2025-09-30T19:33:02.944119] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-30T19:33:02.944225] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGS took 25.7s. Estimated remaining: 2h 31m 19s. Rate: 7.8 symbols/min [2025-09-30T19:33:03.125551] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:03.186450] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-09-30T19:33:03.186956] [INFO ] [MAIN ] KKR: Loaded 53500 existing records. [2025-09-30T19:33:03.386888] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:03.387232] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-30T19:33:03.387289] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-30T19:33:03.387750] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-30T19:33:03.387815] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-30T19:33:03.461203] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-30T19:33:03.820877] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:03.856619] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-30T19:33:03.885398] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T19:33:04.254376] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-30T19:33:05.054442] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-30T19:33:05.445105] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-30T19:33:05.854357] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-30T19:33:05.905751] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-30T19:33:06.591726] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-30T19:33:06.654363] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-30T19:33:07.454342] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-30T19:33:07.615882] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-30T19:33:08.254379] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-30T19:33:08.473194] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T19:33:09.054414] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-30T19:33:09.380346] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T19:33:09.391855] [INFO ] [REMOTE ] KIM: Full fetch complete (76824 records). [2025-09-30T19:33:09.392026] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-30T19:33:09.859715] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-30T19:33:09.855461] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-30T19:33:09.859871] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-30T19:33:09.861290] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-30T19:33:09.862418] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-30T19:33:09.864990] [DEBUG] [LOCAL ] KIM: Trimmed 76824 records to 53046 (keeping 200 days of data) [2025-09-30T19:33:09.995145] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T19:33:10.246988] [DEBUG] [LOCAL ] KIM: Primary data saved (53046 records). [2025-09-30T19:33:10.247138] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-30T19:33:10.247224] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIM took 27.4s. Estimated remaining: 2h 31m 11s. Rate: 7.8 symbols/min [2025-09-30T19:33:10.424884] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:10.433606] [DEBUG] [LOCAL ] KKRS: Loaded 5769 existing records from primary storage. [2025-09-30T19:33:10.433971] [INFO ] [MAIN ] KKRS: Loaded 5769 existing records. [2025-09-30T19:33:10.580141] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:33:10.660380] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-30T19:33:10.666422] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:10.666722] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-30T19:33:10.666797] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-30T19:33:10.667988] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-30T19:33:10.668051] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-30T19:33:11.027632] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:11.454381] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-30T19:33:12.082809] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-30T19:33:12.254366] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-30T19:33:12.768334] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-30T19:33:13.054365] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-30T19:33:13.310492] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-30T19:33:13.698348] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-30T19:33:13.854320] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-30T19:33:13.962377] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-30T19:33:13.974246] [INFO ] [REMOTE ] KGC: Full fetch complete (77696 records). [2025-09-30T19:33:13.974425] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-30T19:33:14.393841] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-30T19:33:14.393947] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-30T19:33:14.394955] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-30T19:33:14.395022] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-30T19:33:14.396566] [DEBUG] [LOCAL ] KGC: Trimmed 77696 records to 53699 (keeping 200 days of data) [2025-09-30T19:33:14.654343] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-30T19:33:14.767489] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-09-30T19:33:14.767684] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-30T19:33:14.767797] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KGC took 40.9s. Estimated remaining: 2h 31m 0s. Rate: 7.8 symbols/min [2025-09-30T19:33:14.955399] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-30T19:33:14.974175] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:14.974469] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-30T19:33:14.978942] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-30T19:33:14.979914] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-30T19:33:14.979969] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-30T19:33:14.980019] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-30T19:33:14.980051] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-30T19:33:15.359154] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:15.454369] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-30T19:33:16.013242] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-30T19:33:16.254358] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-30T19:33:16.415831] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:33:16.416239] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-30T19:33:16.416351] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:33:16.416419] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-09-30T19:33:16.416585] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:33:16.416784] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-30T19:33:16.416850] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-30T19:33:16.416886] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-30T19:33:16.417005] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-30T19:33:16.417075] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KKRT took 1.6s. Estimated remaining: 2h 30m 47s. Rate: 7.8 symbols/min [2025-09-30T19:33:16.614272] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:16.614459] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-30T19:33:16.614514] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-30T19:33:16.614629] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-30T19:33:16.614722] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-30T19:33:16.614908] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-30T19:33:16.615041] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-30T19:33:16.873452] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-30T19:33:17.058219] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-30T19:33:17.061555] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:17.469155] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-30T19:33:17.854364] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-30T19:33:18.654358] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-30T19:33:19.454360] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-30T19:33:19.701985] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T19:33:19.823905] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-30T19:33:19.823719] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T19:33:20.254362] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-30T19:33:20.979806] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-30T19:33:21.054347] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-30T19:33:21.762424] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-30T19:33:21.854356] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-30T19:33:22.623232] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T19:33:22.654320] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-30T19:33:23.252677] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-30T19:33:23.454356] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-30T19:33:23.656504] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:33:23.656913] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-30T19:33:23.657013] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:33:23.657084] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-09-30T19:33:23.657151] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:33:23.657227] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-30T19:33:23.657294] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-30T19:33:23.657333] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-30T19:33:23.657375] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-30T19:33:23.657426] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KLAR took 7.2s. Estimated remaining: 2h 30m 39s. Rate: 7.8 symbols/min [2025-09-30T19:33:23.839043] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:23.878781] [DEBUG] [LOCAL ] KLC: Loaded 36594 existing records from primary storage. [2025-09-30T19:33:23.879099] [INFO ] [MAIN ] KLC: Loaded 36594 existing records. [2025-09-30T19:33:24.071454] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:24.071711] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-30T19:33:24.071775] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-30T19:33:24.072195] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-30T19:33:24.072258] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-30T19:33:24.260170] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-30T19:33:24.476463] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:25.054369] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-30T19:33:25.854372] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-30T19:33:26.154140] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-30T19:33:26.183567] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-30T19:33:26.420352] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-30T19:33:26.654357] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-30T19:33:27.454324] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-30T19:33:27.749964] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-30T19:33:28.088613] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-30T19:33:28.254404] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-30T19:33:29.054354] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-30T19:33:29.688524] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T19:33:29.854375] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-30T19:33:30.192323] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T19:33:30.197454] [INFO ] [REMOTE ] KIO: Full fetch complete (31084 records). [2025-09-30T19:33:30.197608] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-30T19:33:30.606569] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-30T19:33:30.606700] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-30T19:33:30.607400] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-30T19:33:30.607449] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-30T19:33:30.608441] [DEBUG] [LOCAL ] KIO: Trimmed 31084 records to 21369 (keeping 200 days of data) [2025-09-30T19:33:30.667115] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-30T19:33:30.759662] [DEBUG] [LOCAL ] KIO: Primary data saved (21369 records). [2025-09-30T19:33:30.759812] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-30T19:33:30.759900] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KIO took 35.5s. Estimated remaining: 2h 30m 30s. Rate: 7.8 symbols/min [2025-09-30T19:33:31.454352] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-30T19:33:31.653529] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-30T19:33:31.934367] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-30T19:33:32.091914] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T19:33:32.093457] [INFO ] [REMOTE ] KKRS: Full fetch complete (7924 records). [2025-09-30T19:33:32.093529] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-30T19:33:32.259461] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-30T19:33:32.501012] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-30T19:33:32.501088] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-30T19:33:32.501287] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-30T19:33:32.501325] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-30T19:33:32.501757] [DEBUG] [LOCAL ] KKRS: Trimmed 7924 records to 5689 (keeping 200 days of data) [2025-09-30T19:33:32.538312] [DEBUG] [LOCAL ] KKRS: Primary data saved (5689 records). [2025-09-30T19:33:32.538470] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-30T19:33:32.538570] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KKRS took 22.3s. Estimated remaining: 2h 30m 17s. Rate: 7.8 symbols/min [2025-09-30T19:33:33.054321] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-30T19:33:33.450889] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T19:33:33.854390] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-30T19:33:34.977415] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-30T19:33:34.989447] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-30T19:33:35.250540] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-30T19:33:35.454371] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-30T19:33:36.563570] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-30T19:33:36.572806] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-30T19:33:36.855140] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-30T19:33:36.866798] [INFO ] [REMOTE ] KKR: Full fetch complete (77443 records). [2025-09-30T19:33:36.866988] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-30T19:33:37.307755] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-30T19:33:37.307968] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-30T19:33:37.309113] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-30T19:33:37.309198] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-30T19:33:37.311023] [DEBUG] [LOCAL ] KKR: Trimmed 77443 records to 53500 (keeping 200 days of data) [2025-09-30T19:33:37.675445] [DEBUG] [LOCAL ] KKR: Primary data saved (53500 records). [2025-09-30T19:33:37.675597] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-30T19:33:37.675750] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KKR took 34.7s. Estimated remaining: 2h 30m 7s. Rate: 7.8 symbols/min [2025-09-30T19:33:38.130029] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T19:33:38.138814] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-30T19:33:39.534552] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T19:33:39.542325] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-30T19:33:40.869846] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T19:33:40.880360] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-30T19:33:42.354211] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-30T19:33:42.363460] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-30T19:33:43.617413] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:33:43.625621] [INFO ] [REMOTE ] KLC: Full fetch complete (50683 records). [2025-09-30T19:33:43.625825] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-30T19:33:44.031999] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-30T19:33:44.032083] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-30T19:33:44.032976] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-30T19:33:44.033085] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-30T19:33:44.034286] [DEBUG] [LOCAL ] KLC: Trimmed 50683 records to 36676 (keeping 200 days of data) [2025-09-30T19:33:44.257317] [DEBUG] [LOCAL ] KLC: Primary data saved (36676 records). [2025-09-30T19:33:44.257476] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-30T19:33:44.257568] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KLC took 20.6s. Estimated remaining: 2h 29m 58s. Rate: 7.8 symbols/min [2025-09-30T19:33:45.033536] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:45.123510] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:45.126716] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:45.155578] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:45.163353] [DEBUG] [LOCAL ] KMPB: Loaded 3626 existing records from primary storage. [2025-09-30T19:33:45.163918] [INFO ] [MAIN ] KMPB: Loaded 3626 existing records. [2025-09-30T19:33:45.406706] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:45.433897] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-30T19:33:45.435200] [DEBUG] [LOCAL ] KMPR: Loaded 38685 existing records from primary storage. [2025-09-30T19:33:45.435569] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-30T19:33:45.436556] [DEBUG] [LOCAL ] KMT: Loaded 42985 existing records from primary storage. [2025-09-30T19:33:45.453414] [INFO ] [MAIN ] KMT: Loaded 42985 existing records. [2025-09-30T19:33:45.453086] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-30T19:33:45.453629] [INFO ] [MAIN ] KMPR: Loaded 38685 existing records. [2025-09-30T19:33:45.459141] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-09-30T19:33:45.459284] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-30T19:33:45.585755] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-30T19:33:46.253941] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:46.321121] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:46.328185] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-30T19:33:46.327805] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:46.343105] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-30T19:33:46.335522] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-30T19:33:46.335583] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-30T19:33:46.354427] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-30T19:33:46.354326] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-30T19:33:46.374664] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-30T19:33:46.399976] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-30T19:33:46.400104] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-30T19:33:46.415694] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-30T19:33:46.415601] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-30T19:33:46.494771] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-30T19:33:46.857342] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:46.946171] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-30T19:33:47.641750] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:47.642337] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-30T19:33:47.826249] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:47.829518] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-30T19:33:47.822925] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-30T19:33:47.834933] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-30T19:33:47.832581] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:47.835903] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-30T19:33:48.278189] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-30T19:33:48.279448] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-30T19:33:48.660095] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-30T19:33:48.661622] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-30T19:33:48.684397] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T19:33:48.690320] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-30T19:33:49.256688] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-30T19:33:49.257522] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T19:33:49.266768] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-30T19:33:49.269236] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-30T19:33:49.836969] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-30T19:33:49.842499] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T19:33:49.850365] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-30T19:33:49.857372] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-30T19:33:49.862154] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-30T19:33:49.863702] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-30T19:33:50.315464] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T19:33:50.654349] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-30T19:33:50.720691] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:33:51.176195] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T19:33:51.275044] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-30T19:33:51.454410] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-30T19:33:52.038591] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-30T19:33:52.254365] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-30T19:33:52.391295] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-30T19:33:52.756697] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-30T19:33:53.054409] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-30T19:33:53.854395] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-30T19:33:54.451044] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T19:33:54.654377] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-30T19:33:55.012981] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-30T19:33:55.416363] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T19:33:55.454394] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-30T19:33:56.254407] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-30T19:33:56.528035] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-30T19:33:56.738783] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-30T19:33:56.740383] [INFO ] [REMOTE ] KMPB: Full fetch complete (5112 records). [2025-09-30T19:33:56.740480] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-30T19:33:57.059461] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-30T19:33:57.137176] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-30T19:33:57.137263] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-30T19:33:57.137440] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-30T19:33:57.137514] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-30T19:33:57.137954] [DEBUG] [LOCAL ] KMPB: Trimmed 5112 records to 3749 (keeping 200 days of data) [2025-09-30T19:33:57.162397] [DEBUG] [LOCAL ] KMPB: Primary data saved (3749 records). [2025-09-30T19:33:57.162520] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-30T19:33:57.162688] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 12.9s. Estimated remaining: 2h 29m 55s. Rate: 7.8 symbols/min [2025-09-30T19:33:57.346802] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:33:57.405905] [DEBUG] [LOCAL ] KMX: Loaded 53147 existing records from primary storage. [2025-09-30T19:33:57.406301] [INFO ] [MAIN ] KMX: Loaded 53147 existing records. [2025-09-30T19:33:57.603446] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:33:57.603721] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-30T19:33:57.603778] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-30T19:33:57.604163] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-30T19:33:57.604224] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-30T19:33:57.859622] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-30T19:33:58.012366] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:33:58.659801] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-30T19:33:58.678348] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T19:33:59.454371] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-30T19:33:59.861419] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-30T19:34:00.254324] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-30T19:34:00.364909] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T19:34:01.033783] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:34:01.054318] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-30T19:34:01.847463] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T19:34:01.857097] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-30T19:34:02.454365] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T19:34:02.654359] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-30T19:34:03.454397] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-30T19:34:03.901740] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-30T19:34:04.254336] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-30T19:34:04.293816] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-30T19:34:05.054362] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-30T19:34:05.106964] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:34:05.854382] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-30T19:34:06.297403] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-30T19:34:06.654350] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-30T19:34:06.991204] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-30T19:34:07.001544] [INFO ] [REMOTE ] KMPR: Full fetch complete (51246 records). [2025-09-30T19:34:07.001807] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-30T19:34:07.391809] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T19:34:07.468086] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-30T19:34:07.488042] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-30T19:34:07.488118] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-30T19:34:07.489083] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-30T19:34:07.489269] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-30T19:34:07.490608] [DEBUG] [LOCAL ] KMPR: Trimmed 51246 records to 38781 (keeping 200 days of data) [2025-09-30T19:34:07.750899] [DEBUG] [LOCAL ] KMPR: Primary data saved (38781 records). [2025-09-30T19:34:07.751054] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-30T19:34:07.751224] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMPR took 23.5s. Estimated remaining: 2h 29m 50s. Rate: 7.8 symbols/min [2025-09-30T19:34:07.939373] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:07.983617] [DEBUG] [LOCAL ] KN: Loaded 38615 existing records from primary storage. [2025-09-30T19:34:07.984021] [INFO ] [MAIN ] KN: Loaded 38615 existing records. [2025-09-30T19:34:08.177466] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:34:08.177731] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-30T19:34:08.177788] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-30T19:34:08.178088] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-30T19:34:08.178192] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-30T19:34:08.261454] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-30T19:34:08.596961] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:08.875972] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-30T19:34:09.054376] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-30T19:34:09.189091] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T19:34:09.688432] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:34:09.854323] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-30T19:34:10.654624] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-30T19:34:10.661504] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T19:34:10.940400] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:34:11.454378] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-30T19:34:12.113976] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T19:34:12.254413] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-30T19:34:12.793206] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-30T19:34:13.054354] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-30T19:34:13.854384] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-30T19:34:14.386035] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-30T19:34:14.432245] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T19:34:14.654355] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-30T19:34:15.454359] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-30T19:34:15.544244] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-30T19:34:15.665420] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-30T19:34:16.254383] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-30T19:34:17.054372] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-30T19:34:17.400045] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-30T19:34:17.854400] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-30T19:34:18.054096] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-30T19:34:18.654336] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-30T19:34:19.041197] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T19:34:19.454365] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-30T19:34:19.630873] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-30T19:34:19.640346] [INFO ] [REMOTE ] KMT: Full fetch complete (62064 records). [2025-09-30T19:34:19.640497] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-30T19:34:20.053420] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-30T19:34:20.053504] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-30T19:34:20.054446] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-30T19:34:20.054514] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-30T19:34:20.055851] [DEBUG] [LOCAL ] KMT: Trimmed 62064 records to 42940 (keeping 200 days of data) [2025-09-30T19:34:20.277004] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-30T19:34:20.337270] [DEBUG] [LOCAL ] KMT: Primary data saved (42940 records). [2025-09-30T19:34:20.337425] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-30T19:34:20.337566] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMT took 36.1s. Estimated remaining: 2h 29m 47s. Rate: 7.8 symbols/min [2025-09-30T19:34:20.525457] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:20.561887] [DEBUG] [LOCAL ] KNF: Loaded 35771 existing records from primary storage. [2025-09-30T19:34:20.562238] [INFO ] [MAIN ] KNF: Loaded 35771 existing records. [2025-09-30T19:34:20.762803] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:34:20.763317] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-30T19:34:20.763430] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-30T19:34:20.763865] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-30T19:34:20.764046] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-30T19:34:20.907925] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-30T19:34:21.012289] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-09-30T19:34:21.039706] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-30T19:34:21.382569] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:21.397152] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-30T19:34:21.587948] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-30T19:34:21.708155] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-30T19:34:21.708291] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-30T19:34:21.709320] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-30T19:34:21.709419] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-30T19:34:21.711363] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 53693 (keeping 200 days of data) [2025-09-30T19:34:21.739458] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T19:34:21.854552] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-30T19:34:22.105159] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-09-30T19:34:22.105319] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-30T19:34:22.106462] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMI took 37.8s. Estimated remaining: 2h 29m 34s. Rate: 7.8 symbols/min [2025-09-30T19:34:22.294228] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:22.308637] [DEBUG] [LOCAL ] KNOP: Loaded 10275 existing records from primary storage. [2025-09-30T19:34:22.308950] [INFO ] [MAIN ] KNOP: Loaded 10275 existing records. [2025-09-30T19:34:22.525111] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:34:22.525365] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-30T19:34:22.525425] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-30T19:34:22.525605] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-30T19:34:22.525710] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-30T19:34:22.658032] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-30T19:34:22.925575] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:22.971534] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T19:34:23.298776] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-30T19:34:23.454362] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-30T19:34:24.254333] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-30T19:34:24.295819] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-30T19:34:24.422597] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-30T19:34:25.054376] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-30T19:34:25.854351] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-30T19:34:25.927846] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T19:34:26.654314] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-30T19:34:27.075437] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-30T19:34:27.109464] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-30T19:34:27.403826] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-30T19:34:27.454345] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-30T19:34:28.192096] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T19:34:28.254366] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-30T19:34:29.046505] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-30T19:34:29.054307] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-30T19:34:29.854357] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-30T19:34:29.966002] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T19:34:30.654370] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-30T19:34:31.160928] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T19:34:31.454380] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-30T19:34:32.075185] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-30T19:34:32.089485] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-30T19:34:32.254393] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-30T19:34:33.054383] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-30T19:34:33.854364] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-30T19:34:34.140846] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-30T19:34:34.177794] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T19:34:34.597699] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T19:34:34.654391] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-30T19:34:35.454362] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-30T19:34:36.254341] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-30T19:34:36.723676] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-30T19:34:36.737443] [INFO ] [REMOTE ] KMX: Full fetch complete (75999 records). [2025-09-30T19:34:36.737633] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-30T19:34:37.115733] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-30T19:34:37.125277] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T19:34:37.269710] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-30T19:34:37.269810] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-30T19:34:37.270926] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-30T19:34:37.271008] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-30T19:34:37.272525] [DEBUG] [LOCAL ] KMX: Trimmed 75999 records to 53148 (keeping 200 days of data) [2025-09-30T19:34:37.624996] [DEBUG] [LOCAL ] KMX: Primary data saved (53148 records). [2025-09-30T19:34:37.625195] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-30T19:34:37.625383] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KMX took 40.5s. Estimated remaining: 2h 29m 34s. Rate: 7.8 symbols/min [2025-09-30T19:34:37.816061] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:37.841900] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-30T19:34:37.851160] [INFO ] [REMOTE ] KN: Full fetch complete (56378 records). [2025-09-30T19:34:37.851348] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-30T19:34:37.857262] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-30T19:34:37.994620] [DEBUG] [LOCAL ] KNSL: Loaded 18116 existing records from primary storage. [2025-09-30T19:34:38.039351] [INFO ] [MAIN ] KNSL: Loaded 18116 existing records. [2025-09-30T19:34:38.312100] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T19:34:38.533452] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:34:38.548336] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-30T19:34:38.548525] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-30T19:34:38.548636] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-30T19:34:38.548830] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-30T19:34:38.549936] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-30T19:34:38.550030] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-30T19:34:38.549855] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-30T19:34:38.555317] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-30T19:34:38.659761] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-30T19:34:38.665855] [DEBUG] [LOCAL ] KN: Trimmed 56378 records to 38575 (keeping 200 days of data) [2025-09-30T19:34:39.065302] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:39.217716] [DEBUG] [LOCAL ] KN: Primary data saved (38575 records). [2025-09-30T19:34:39.217875] [INFO ] [MAIN ] KN: Full history saved. [2025-09-30T19:34:39.217977] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KN took 31.5s. Estimated remaining: 2h 29m 20s. Rate: 7.8 symbols/min [2025-09-30T19:34:39.365600] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T19:34:39.396094] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:34:39.453618] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:39.454332] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-30T19:34:39.498210] [DEBUG] [LOCAL ] KNTK: Loaded 46082 existing records from primary storage. [2025-09-30T19:34:39.498530] [INFO ] [MAIN ] KNTK: Loaded 46082 existing records. [2025-09-30T19:34:39.703161] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:34:39.703423] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-30T19:34:39.703479] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-30T19:34:39.703942] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-30T19:34:39.704009] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-30T19:34:40.168322] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:40.254353] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-30T19:34:40.782788] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T19:34:41.054345] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-30T19:34:41.801275] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T19:34:41.854367] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-30T19:34:42.269788] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:34:42.654404] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-30T19:34:42.942625] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T19:34:43.454336] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-30T19:34:43.778991] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T19:34:44.254376] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-30T19:34:44.392037] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T19:34:44.396715] [INFO ] [REMOTE ] KNOP: Full fetch complete (14801 records). [2025-09-30T19:34:44.396815] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-30T19:34:44.815584] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-30T19:34:44.815936] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-30T19:34:44.816283] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-30T19:34:44.816327] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-30T19:34:44.816858] [DEBUG] [LOCAL ] KNOP: Trimmed 14801 records to 10406 (keeping 200 days of data) [2025-09-30T19:34:44.879507] [DEBUG] [LOCAL ] KNOP: Primary data saved (10406 records). [2025-09-30T19:34:44.879675] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-30T19:34:44.879813] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNOP took 22.8s. Estimated remaining: 2h 29m 11s. Rate: 7.8 symbols/min [2025-09-30T19:34:45.056221] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-30T19:34:45.057912] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:45.122911] [DEBUG] [LOCAL ] KNX: Loaded 52588 existing records from primary storage. [2025-09-30T19:34:45.123339] [INFO ] [MAIN ] KNX: Loaded 52588 existing records. [2025-09-30T19:34:45.311441] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:34:45.311676] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-30T19:34:45.311757] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-30T19:34:45.313113] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-30T19:34:45.313175] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-30T19:34:45.706075] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:45.782220] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-30T19:34:45.854364] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-30T19:34:46.495467] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T19:34:46.654368] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-30T19:34:47.089359] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-30T19:34:47.454413] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-30T19:34:47.748741] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:34:48.254340] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-30T19:34:48.459458] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-30T19:34:49.054356] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-30T19:34:49.854389] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-30T19:34:49.966010] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T19:34:50.500997] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T19:34:50.654426] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-30T19:34:51.447146] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-30T19:34:51.460889] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-30T19:34:51.999336] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T19:34:52.254358] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-30T19:34:53.039506] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-30T19:34:53.048184] [INFO ] [REMOTE ] KNF: Full fetch complete (50702 records). [2025-09-30T19:34:53.048318] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-30T19:34:53.060560] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-30T19:34:53.469792] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-30T19:34:53.517831] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-30T19:34:53.517911] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-30T19:34:53.518811] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-30T19:34:53.518878] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-30T19:34:53.521333] [DEBUG] [LOCAL ] KNF: Trimmed 50702 records to 35821 (keeping 200 days of data) [2025-09-30T19:34:53.750026] [DEBUG] [LOCAL ] KNF: Primary data saved (35821 records). [2025-09-30T19:34:53.750213] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-30T19:34:53.750346] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNF took 33.4s. Estimated remaining: 2h 29m 4s. Rate: 7.8 symbols/min [2025-09-30T19:34:53.859485] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-30T19:34:53.948028] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:34:53.948270] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-30T19:34:53.948338] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-30T19:34:53.948452] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-30T19:34:53.948494] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-30T19:34:53.948596] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-30T19:34:53.948669] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-30T19:34:54.330004] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:34:54.493566] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-30T19:34:54.654369] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-30T19:34:55.454332] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-30T19:34:55.539714] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:34:56.254398] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-30T19:34:57.054390] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-30T19:34:57.191791] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-30T19:34:57.265858] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-30T19:34:57.388336] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T19:34:57.854335] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-30T19:34:58.071616] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-30T19:34:58.654377] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-30T19:34:59.454356] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-30T19:34:59.622154] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-30T19:35:00.254409] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-30T19:35:01.054379] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-30T19:35:01.213879] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T19:35:01.237164] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T19:35:01.306624] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-30T19:35:01.854358] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-30T19:35:02.654329] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-30T19:35:02.742592] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-30T19:35:03.454394] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-30T19:35:03.627941] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T19:35:04.254413] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-30T19:35:04.928927] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-30T19:35:04.972638] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T19:35:05.054377] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-30T19:35:05.424402] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-30T19:35:05.854384] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-30T19:35:06.654354] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-30T19:35:06.679112] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-30T19:35:07.371157] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-30T19:35:07.454360] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-30T19:35:08.254330] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-30T19:35:08.409485] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-30T19:35:09.054390] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-30T19:35:09.755129] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T19:35:09.854374] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-30T19:35:10.112918] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-30T19:35:10.654358] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-30T19:35:10.786199] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-30T19:35:10.797458] [INFO ] [REMOTE ] KNTK: Full fetch complete (64461 records). [2025-09-30T19:35:10.797624] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-30T19:35:11.228593] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-30T19:35:11.228731] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-30T19:35:11.229690] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-30T19:35:11.229755] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-30T19:35:11.231837] [DEBUG] [LOCAL ] KNTK: Trimmed 64461 records to 46115 (keeping 200 days of data) [2025-09-30T19:35:11.454988] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-30T19:35:11.564114] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-30T19:35:11.595482] [DEBUG] [LOCAL ] KNTK: Primary data saved (46115 records). [2025-09-30T19:35:11.596595] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T19:35:11.596146] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-30T19:35:11.600570] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNTK took 32.4s. Estimated remaining: 2h 29m 6s. Rate: 7.8 symbols/min [2025-09-30T19:35:11.647147] [INFO ] [REMOTE ] KNSL: Full fetch complete (26572 records). [2025-09-30T19:35:11.674921] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-30T19:35:11.952204] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:12.218580] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-30T19:35:12.218714] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-30T19:35:12.219319] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-30T19:35:12.219390] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-30T19:35:12.232927] [DEBUG] [LOCAL ] KNSL: Trimmed 26572 records to 18106 (keeping 200 days of data) [2025-09-30T19:35:12.234080] [DEBUG] [LOCAL ] KODK: Loaded 43409 existing records from primary storage. [2025-09-30T19:35:12.234751] [INFO ] [MAIN ] KODK: Loaded 43409 existing records. [2025-09-30T19:35:12.309585] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-30T19:35:12.540706] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:12.542156] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-30T19:35:12.543120] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-30T19:35:12.546034] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-30T19:35:12.546923] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-30T19:35:12.995425] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:13.005622] [DEBUG] [LOCAL ] KNSL: Primary data saved (18106 records). [2025-09-30T19:35:13.005818] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-30T19:35:13.005939] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNSL took 35.4s. Estimated remaining: 2h 28m 52s. Rate: 7.8 symbols/min [2025-09-30T19:35:13.059800] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-30T19:35:13.207437] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:13.238401] [DEBUG] [LOCAL ] KOF: Loaded 25940 existing records from primary storage. [2025-09-30T19:35:13.238700] [INFO ] [MAIN ] KOF: Loaded 25940 existing records. [2025-09-30T19:35:13.433696] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:13.433904] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-30T19:35:13.433953] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-30T19:35:13.434412] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-30T19:35:13.434474] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-30T19:35:13.861265] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:13.861826] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-30T19:35:13.899280] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-30T19:35:14.273008] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-30T19:35:14.284785] [INFO ] [REMOTE ] KNX: Full fetch complete (75769 records). [2025-09-30T19:35:14.285015] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-30T19:35:14.663574] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-30T19:35:14.728879] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-30T19:35:14.729004] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-30T19:35:14.730122] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-30T19:35:14.730205] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-30T19:35:14.764525] [DEBUG] [LOCAL ] KNX: Trimmed 75769 records to 52592 (keeping 200 days of data) [2025-09-30T19:35:14.766078] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-30T19:35:14.895962] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-30T19:35:15.158794] [DEBUG] [LOCAL ] KNX: Primary data saved (52592 records). [2025-09-30T19:35:15.158940] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-30T19:35:15.159789] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KNX took 30.3s. Estimated remaining: 2h 28m 39s. Rate: 7.8 symbols/min [2025-09-30T19:35:15.378014] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:15.398802] [DEBUG] [LOCAL ] KOP: Loaded 17654 existing records from primary storage. [2025-09-30T19:35:15.399086] [INFO ] [MAIN ] KOP: Loaded 17654 existing records. [2025-09-30T19:35:15.459689] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-30T19:35:15.594071] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:15.594287] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-30T19:35:15.594337] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-30T19:35:15.594891] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-30T19:35:15.594954] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-30T19:35:15.981617] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:16.254362] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-30T19:35:16.674059] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-30T19:35:16.910240] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-30T19:35:17.054419] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-30T19:35:17.854377] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-30T19:35:17.916890] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T19:35:17.981401] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T19:35:18.654368] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-30T19:35:19.454355] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-30T19:35:20.256326] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-30T19:35:20.280671] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-30T19:35:20.580667] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-30T19:35:20.676254] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-09-30T19:35:21.054356] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-30T19:35:21.313052] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-30T19:35:21.854361] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-30T19:35:22.654404] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-30T19:35:22.824088] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T19:35:23.454383] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-30T19:35:23.600028] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-30T19:35:24.259224] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-30T19:35:24.264378] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T19:35:24.387584] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-30T19:35:25.054351] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-30T19:35:25.854361] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-30T19:35:26.357220] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-30T19:35:26.654331] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-30T19:35:26.756962] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-30T19:35:26.767485] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-09-30T19:35:26.767671] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-30T19:35:26.998435] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-30T19:35:26.999391] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:35:26.999522] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:35:26.999763] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-30T19:35:26.999925] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-30T19:35:27.000019] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-30T19:35:27.000131] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-30T19:35:27.000348] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KO took 33.2s. Estimated remaining: 2h 28m 36s. Rate: 7.8 symbols/min [2025-09-30T19:35:27.148624] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T19:35:27.222579] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:27.228712] [DEBUG] [LOCAL ] KORE: Loaded 1992 existing records from primary storage. [2025-09-30T19:35:27.228954] [INFO ] [MAIN ] KORE: Loaded 1992 existing records. [2025-09-30T19:35:27.451459] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:27.451737] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-30T19:35:27.451832] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-30T19:35:27.452056] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-30T19:35:27.452119] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-30T19:35:27.465628] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-30T19:35:27.872499] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:27.886124] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-30T19:35:28.254361] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-30T19:35:28.832809] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-30T19:35:28.939045] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-30T19:35:29.054403] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-30T19:35:29.854363] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-30T19:35:30.122296] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T19:35:30.654411] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-30T19:35:31.311225] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T19:35:31.454409] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-30T19:35:31.955930] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T19:35:32.254363] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-30T19:35:32.538343] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T19:35:33.054400] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-30T19:35:33.462031] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T19:35:33.854383] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-30T19:35:33.898831] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-30T19:35:34.654452] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-30T19:35:35.234991] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T19:35:35.454391] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-30T19:35:35.510055] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:35:35.927552] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-30T19:35:36.254381] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-30T19:35:37.054401] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-30T19:35:37.854370] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-30T19:35:37.993392] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-30T19:35:38.352094] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T19:35:38.445775] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-30T19:35:38.654376] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-30T19:35:39.411178] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-30T19:35:39.454426] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-30T19:35:39.812610] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-30T19:35:40.254366] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-30T19:35:41.054388] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-30T19:35:41.854343] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-30T19:35:42.010829] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-30T19:35:42.020034] [INFO ] [REMOTE ] KODK: Full fetch complete (63450 records). [2025-09-30T19:35:42.020153] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-30T19:35:42.381839] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T19:35:42.518581] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T19:35:42.518786] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-30T19:35:42.520461] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-30T19:35:42.521568] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-30T19:35:42.521709] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-30T19:35:42.523272] [DEBUG] [LOCAL ] KODK: Trimmed 63450 records to 43436 (keeping 200 days of data) [2025-09-30T19:35:42.692158] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-30T19:35:42.791369] [DEBUG] [LOCAL ] KODK: Primary data saved (43436 records). [2025-09-30T19:35:42.791504] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-30T19:35:42.791593] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KODK took 31.2s. Estimated remaining: 2h 28m 36s. Rate: 7.8 symbols/min [2025-09-30T19:35:42.988684] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:43.042489] [DEBUG] [LOCAL ] KOS: Loaded 53047 existing records from primary storage. [2025-09-30T19:35:43.042882] [INFO ] [MAIN ] KOS: Loaded 53047 existing records. [2025-09-30T19:35:43.238935] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:43.239206] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-30T19:35:43.239268] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-30T19:35:43.240458] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-30T19:35:43.240520] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-30T19:35:43.463273] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-30T19:35:43.692260] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:43.833808] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-30T19:35:43.839292] [INFO ] [REMOTE ] KOP: Full fetch complete (25432 records). [2025-09-30T19:35:43.839456] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-30T19:35:44.266386] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-30T19:35:44.429316] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-30T19:35:44.429422] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-30T19:35:44.430236] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-30T19:35:44.430306] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-30T19:35:44.431302] [DEBUG] [LOCAL ] KOP: Trimmed 25432 records to 17616 (keeping 200 days of data) [2025-09-30T19:35:44.602719] [DEBUG] [LOCAL ] KOP: Primary data saved (17616 records). [2025-09-30T19:35:44.602983] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-30T19:35:44.603281] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOP took 29.4s. Estimated remaining: 2h 28m 22s. Rate: 7.8 symbols/min [2025-09-30T19:35:44.706148] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-30T19:35:44.772549] [INFO ] [REMOTE ] KOF: Full fetch complete (37069 records). [2025-09-30T19:35:44.784439] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-30T19:35:45.059712] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-30T19:35:45.054467] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:45.403337] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-30T19:35:45.403431] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-30T19:35:45.404146] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-30T19:35:45.404229] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-30T19:35:45.406257] [DEBUG] [LOCAL ] KOF: Trimmed 37069 records to 26038 (keeping 200 days of data) [2025-09-30T19:35:45.427339] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-09-30T19:35:45.427756] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-09-30T19:35:45.635527] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-30T19:35:45.758458] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:45.759773] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-30T19:35:45.761068] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-30T19:35:45.763319] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-30T19:35:45.763622] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-30T19:35:45.865032] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-30T19:35:46.162680] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T19:35:46.240541] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:46.313739] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-30T19:35:46.317482] [DEBUG] [LOCAL ] KOF: Primary data saved (26038 records). [2025-09-30T19:35:46.317588] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-30T19:35:46.317711] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KOF took 33.3s. Estimated remaining: 2h 28m 9s. Rate: 7.8 symbols/min [2025-09-30T19:35:46.508790] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:46.556201] [DEBUG] [LOCAL ] KRC: Loaded 48355 existing records from primary storage. [2025-09-30T19:35:46.556539] [INFO ] [MAIN ] KRC: Loaded 48355 existing records. [2025-09-30T19:35:46.659518] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-30T19:35:46.775240] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:46.775749] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-30T19:35:46.775810] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-30T19:35:46.777615] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-30T19:35:46.777718] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-30T19:35:47.168508] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:47.180339] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-30T19:35:47.454404] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-30T19:35:48.254401] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-30T19:35:49.054382] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-30T19:35:49.131620] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T19:35:49.498410] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T19:35:49.862252] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-30T19:35:49.883695] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-30T19:35:50.415229] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-30T19:35:50.416361] [INFO ] [REMOTE ] KORE: Full fetch complete (5989 records). [2025-09-30T19:35:50.416435] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-30T19:35:50.659550] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-30T19:35:50.855790] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-30T19:35:50.855914] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-30T19:35:50.856114] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-30T19:35:50.856228] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-30T19:35:50.856624] [DEBUG] [LOCAL ] KORE: Trimmed 5989 records to 1997 (keeping 200 days of data) [2025-09-30T19:35:50.869367] [DEBUG] [LOCAL ] KORE: Primary data saved (1997 records). [2025-09-30T19:35:50.869458] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-30T19:35:50.869548] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KORE took 23.9s. Estimated remaining: 2h 27m 58s. Rate: 7.8 symbols/min [2025-09-30T19:35:51.052337] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:35:51.096233] [DEBUG] [LOCAL ] KREF: Loaded 37243 existing records from primary storage. [2025-09-30T19:35:51.096551] [INFO ] [MAIN ] KREF: Loaded 37243 existing records. [2025-09-30T19:35:51.293699] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:35:51.294038] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-30T19:35:51.294089] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-30T19:35:51.295378] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-30T19:35:51.295445] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-30T19:35:51.460319] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-30T19:35:51.724476] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:35:52.254407] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-30T19:35:52.416306] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T19:35:53.054464] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-30T19:35:53.278492] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-30T19:35:53.355115] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-30T19:35:53.854402] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-30T19:35:54.654376] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-30T19:35:54.798176] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T19:35:55.408884] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-30T19:35:55.454338] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-30T19:35:55.491372] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-30T19:35:56.254373] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-30T19:35:57.054373] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-30T19:35:57.269008] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-30T19:35:57.514073] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T19:35:57.854421] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-30T19:35:58.654375] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-30T19:35:58.783211] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-30T19:35:59.454405] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-30T19:35:59.620612] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T19:36:00.254362] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-30T19:36:00.486379] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T19:36:01.054371] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-30T19:36:01.142484] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-30T19:36:01.747367] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T19:36:01.854407] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-30T19:36:02.654392] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-30T19:36:02.982241] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-30T19:36:03.454370] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-30T19:36:03.515706] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T19:36:03.823232] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T19:36:04.254369] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-30T19:36:05.054383] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-30T19:36:05.278146] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-30T19:36:05.744968] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-30T19:36:05.854391] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-30T19:36:06.633517] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:36:06.654311] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-30T19:36:07.454356] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-30T19:36:07.681805] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:36:08.032063] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-30T19:36:08.254389] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-30T19:36:09.054400] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-30T19:36:09.446420] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-30T19:36:09.496106] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-30T19:36:09.854383] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-30T19:36:10.511878] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T19:36:10.654404] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-30T19:36:11.442674] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-30T19:36:11.454452] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-30T19:36:12.169545] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-30T19:36:12.254361] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-30T19:36:13.054422] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-30T19:36:13.854333] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-30T19:36:13.964732] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-30T19:36:14.268301] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T19:36:14.401006] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T19:36:14.654364] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-30T19:36:15.285440] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T19:36:15.454402] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-30T19:36:16.254373] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-30T19:36:16.404144] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-30T19:36:16.973901] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-30T19:36:16.982634] [INFO ] [REMOTE ] KREF: Full fetch complete (52335 records). [2025-09-30T19:36:16.982919] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-30T19:36:17.059517] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-30T19:36:17.401351] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-30T19:36:17.401479] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-30T19:36:17.402437] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-30T19:36:17.402551] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-30T19:36:17.404033] [DEBUG] [LOCAL ] KREF: Trimmed 52335 records to 37396 (keeping 200 days of data) [2025-09-30T19:36:17.648751] [DEBUG] [LOCAL ] KREF: Primary data saved (37396 records). [2025-09-30T19:36:17.648904] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-30T19:36:17.649111] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KREF took 26.8s. Estimated remaining: 2h 28m 9s. Rate: 7.8 symbols/min [2025-09-30T19:36:17.835937] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:17.865269] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-30T19:36:17.886605] [DEBUG] [LOCAL ] KRG: Loaded 49153 existing records from primary storage. [2025-09-30T19:36:17.886971] [INFO ] [MAIN ] KRG: Loaded 49153 existing records. [2025-09-30T19:36:18.089156] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T19:36:18.146019] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:18.146767] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-30T19:36:18.147030] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-30T19:36:18.148613] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-30T19:36:18.148731] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-30T19:36:18.547157] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:18.654333] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-30T19:36:18.721704] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T19:36:18.733335] [INFO ] [REMOTE ] KOS: Full fetch complete (76844 records). [2025-09-30T19:36:18.733482] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-30T19:36:19.185495] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-30T19:36:19.185615] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-30T19:36:19.187285] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-30T19:36:19.187370] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-30T19:36:19.189069] [DEBUG] [LOCAL ] KOS: Trimmed 76844 records to 53049 (keeping 200 days of data) [2025-09-30T19:36:19.462062] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-30T19:36:19.515461] [DEBUG] [LOCAL ] KOS: Primary data saved (53049 records). [2025-09-30T19:36:19.515606] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-30T19:36:19.515742] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KOS took 36.7s. Estimated remaining: 2h 27m 56s. Rate: 7.8 symbols/min [2025-09-30T19:36:19.745366] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:19.745620] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-30T19:36:19.745809] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-30T19:36:19.746128] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-30T19:36:19.746290] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-30T19:36:19.746374] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-30T19:36:19.746426] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-30T19:36:20.081305] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T19:36:20.143871] [INFO ] [REMOTE ] KRC: Full fetch complete (69813 records). [2025-09-30T19:36:20.179357] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-30T19:36:20.202740] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:20.267801] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-30T19:36:20.550937] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:36:20.557135] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-30T19:36:20.562631] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:36:20.573512] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-09-30T19:36:20.602063] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:36:20.639671] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-30T19:36:20.692438] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-30T19:36:20.691962] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-30T19:36:20.695377] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-30T19:36:20.695292] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-30T19:36:20.693172] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-30T19:36:20.695588] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-30T19:36:20.697100] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KRMN took 1.2s. Estimated remaining: 2h 27m 42s. Rate: 7.8 symbols/min [2025-09-30T19:36:20.696951] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-30T19:36:20.706668] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-30T19:36:20.825051] [DEBUG] [LOCAL ] KRC: Trimmed 69813 records to 48305 (keeping 200 days of data) [2025-09-30T19:36:20.904226] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:21.029929] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-30T19:36:21.058156] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-30T19:36:21.081676] [DEBUG] [LOCAL ] KRO: Loaded 26010 existing records from primary storage. [2025-09-30T19:36:21.083548] [INFO ] [MAIN ] KRO: Loaded 26010 existing records. [2025-09-30T19:36:21.297755] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:21.298243] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-30T19:36:21.298620] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-30T19:36:21.299815] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-30T19:36:21.300108] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-30T19:36:21.808425] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:21.868769] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-30T19:36:21.904183] [DEBUG] [LOCAL ] KRC: Primary data saved (48305 records). [2025-09-30T19:36:21.904345] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-30T19:36:21.904462] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KRC took 35.6s. Estimated remaining: 2h 27m 28s. Rate: 7.8 symbols/min [2025-09-30T19:36:22.088506] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:22.135480] [DEBUG] [LOCAL ] KRP: Loaded 37163 existing records from primary storage. [2025-09-30T19:36:22.135924] [INFO ] [MAIN ] KRP: Loaded 37163 existing records. [2025-09-30T19:36:22.336574] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:22.337243] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-30T19:36:22.337481] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-30T19:36:22.338824] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-30T19:36:22.338960] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-30T19:36:22.507619] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:36:22.654896] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-30T19:36:22.803978] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:22.819411] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-30T19:36:23.454413] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-30T19:36:24.048392] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T19:36:24.254375] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-30T19:36:25.054401] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-30T19:36:25.658217] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T19:36:25.671101] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-09-30T19:36:25.671325] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-30T19:36:25.864587] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-30T19:36:26.036351] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T19:36:26.129929] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T19:36:26.192702] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-30T19:36:26.192848] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-30T19:36:26.194282] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-30T19:36:26.194363] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-30T19:36:26.196710] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 53681 (keeping 200 days of data) [2025-09-30T19:36:26.614227] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-09-30T19:36:26.614520] [INFO ] [MAIN ] KR: Full history saved. [2025-09-30T19:36:26.614698] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KR took 42.0s. Estimated remaining: 2h 27m 17s. Rate: 7.8 symbols/min [2025-09-30T19:36:26.659969] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-30T19:36:26.801851] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:26.867919] [DEBUG] [LOCAL ] KSS: Loaded 53605 existing records from primary storage. [2025-09-30T19:36:26.868524] [INFO ] [MAIN ] KSS: Loaded 53605 existing records. [2025-09-30T19:36:27.084568] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:27.085025] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-30T19:36:27.085207] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-30T19:36:27.086385] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-30T19:36:27.086462] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-30T19:36:27.458977] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-30T19:36:27.465064] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:27.480599] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-30T19:36:28.254338] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-30T19:36:28.345502] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T19:36:28.517229] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T19:36:29.054355] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-30T19:36:29.551082] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T19:36:29.854395] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-30T19:36:30.461040] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T19:36:30.654386] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-30T19:36:31.365799] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T19:36:31.454400] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-30T19:36:32.254744] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T19:36:32.254864] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-30T19:36:32.786713] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-30T19:36:33.054428] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-30T19:36:33.854415] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-30T19:36:34.248038] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-30T19:36:34.553907] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-30T19:36:34.654416] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-30T19:36:34.995395] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-30T19:36:35.454416] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-30T19:36:36.254384] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-30T19:36:36.619486] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-30T19:36:37.054452] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-30T19:36:37.243448] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-30T19:36:37.707410] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-30T19:36:37.854434] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-30T19:36:38.572239] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T19:36:38.654388] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-30T19:36:39.464530] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-30T19:36:39.470721] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T19:36:40.254398] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-30T19:36:40.603605] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T19:36:40.708139] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-30T19:36:41.054381] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-30T19:36:41.855988] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-30T19:36:41.860182] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T19:36:41.873028] [INFO ] [REMOTE ] KRG: Full fetch complete (71119 records). [2025-09-30T19:36:41.873269] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-30T19:36:42.298544] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-30T19:36:42.298666] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-30T19:36:42.299618] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-30T19:36:42.299698] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-30T19:36:42.301191] [DEBUG] [LOCAL ] KRG: Trimmed 71119 records to 49160 (keeping 200 days of data) [2025-09-30T19:36:42.633334] [DEBUG] [LOCAL ] KRG: Primary data saved (49160 records). [2025-09-30T19:36:42.633570] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-30T19:36:42.633758] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRG took 25.0s. Estimated remaining: 2h 27m 18s. Rate: 7.8 symbols/min [2025-09-30T19:36:42.659486] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-30T19:36:42.828431] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:42.867252] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-30T19:36:42.901925] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T19:36:42.947450] [DEBUG] [LOCAL ] KT: Loaded 45650 existing records from primary storage. [2025-09-30T19:36:42.947951] [INFO ] [MAIN ] KT: Loaded 45650 existing records. [2025-09-30T19:36:43.157256] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:43.157520] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-30T19:36:43.157572] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-30T19:36:43.158185] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-30T19:36:43.158268] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-30T19:36:43.459602] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-30T19:36:43.574312] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:44.102590] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T19:36:44.254445] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-30T19:36:45.054459] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-30T19:36:45.595121] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-30T19:36:45.769913] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T19:36:45.846279] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:36:45.855959] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-30T19:36:46.654374] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-30T19:36:47.399304] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T19:36:47.454357] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-30T19:36:48.254386] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-30T19:36:48.981390] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T19:36:49.054382] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-30T19:36:49.854490] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-30T19:36:50.094221] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (3.44 seconds). [2025-09-30T19:36:50.624570] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:36:50.632407] [INFO ] [REMOTE ] KRP: Full fetch complete (54912 records). [2025-09-30T19:36:50.632528] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-30T19:36:50.668171] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-30T19:36:51.055359] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-30T19:36:51.055507] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-30T19:36:51.056463] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-30T19:36:51.056541] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-30T19:36:51.057864] [DEBUG] [LOCAL ] KRP: Trimmed 54912 records to 37125 (keeping 200 days of data) [2025-09-30T19:36:51.296659] [DEBUG] [LOCAL ] KRP: Primary data saved (37125 records). [2025-09-30T19:36:51.296815] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-30T19:36:51.296961] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRP took 29.4s. Estimated remaining: 2h 27m 11s. Rate: 7.8 symbols/min [2025-09-30T19:36:51.481379] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:51.523016] [DEBUG] [LOCAL ] KTB: Loaded 41099 existing records from primary storage. [2025-09-30T19:36:51.523362] [INFO ] [MAIN ] KTB: Loaded 41099 existing records. [2025-09-30T19:36:51.724131] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:51.724380] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-30T19:36:51.724431] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-30T19:36:51.724868] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-30T19:36:51.724931] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-30T19:36:52.082430] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-30T19:36:52.074456] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (3.82 seconds). [2025-09-30T19:36:52.125367] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-30T19:36:52.221247] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:52.254341] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-30T19:36:52.385264] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-30T19:36:53.054446] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-30T19:36:53.412009] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-30T19:36:53.854414] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-30T19:36:54.061142] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-30T19:36:54.384391] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-30T19:36:54.654374] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-30T19:36:55.454381] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-30T19:36:55.551438] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T19:36:55.607003] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T19:36:56.254403] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-30T19:36:56.896160] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T19:36:56.902884] [INFO ] [REMOTE ] KRO: Full fetch complete (34904 records). [2025-09-30T19:36:56.902987] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-30T19:36:57.063767] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-30T19:36:57.321060] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-30T19:36:57.321220] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-30T19:36:57.322062] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-30T19:36:57.322132] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-30T19:36:57.323422] [DEBUG] [LOCAL ] KRO: Trimmed 34904 records to 26036 (keeping 200 days of data) [2025-09-30T19:36:57.484481] [DEBUG] [LOCAL ] KRO: Primary data saved (26036 records). [2025-09-30T19:36:57.484626] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-30T19:36:57.484751] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KRO took 36.8s. Estimated remaining: 2h 27m 2s. Rate: 7.8 symbols/min [2025-09-30T19:36:57.667504] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:36:57.682564] [DEBUG] [LOCAL ] KTF: Loaded 12803 existing records from primary storage. [2025-09-30T19:36:57.682918] [INFO ] [MAIN ] KTF: Loaded 12803 existing records. [2025-09-30T19:36:57.871372] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-30T19:36:57.878945] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:36:57.880192] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-30T19:36:57.880411] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-30T19:36:57.881091] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-30T19:36:57.881159] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-30T19:36:58.093660] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T19:36:58.325331] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:36:58.351680] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-30T19:36:58.654406] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-30T19:36:59.454333] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-30T19:36:59.655594] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T19:36:59.927018] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T19:37:00.254398] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-30T19:37:01.016836] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T19:37:01.054353] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-30T19:37:01.170366] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-30T19:37:01.854358] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-30T19:37:02.631332] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-30T19:37:02.654351] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-30T19:37:02.845894] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T19:37:02.859215] [INFO ] [REMOTE ] KSS: Full fetch complete (77635 records). [2025-09-30T19:37:02.859433] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-30T19:37:03.337988] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-30T19:37:03.338107] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-30T19:37:03.339248] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-30T19:37:03.339343] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-30T19:37:03.356605] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-30T19:37:03.359961] [DEBUG] [LOCAL ] KSS: Trimmed 77635 records to 53603 (keeping 200 days of data) [2025-09-30T19:37:03.455292] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-30T19:37:03.722157] [DEBUG] [LOCAL ] KSS: Primary data saved (53603 records). [2025-09-30T19:37:03.722319] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-30T19:37:03.723496] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KSS took 37.1s. Estimated remaining: 2h 26m 53s. Rate: 7.8 symbols/min [2025-09-30T19:37:03.923029] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:03.923282] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-30T19:37:03.923359] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-30T19:37:03.923529] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-30T19:37:03.923574] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-30T19:37:03.923617] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-30T19:37:03.923686] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-30T19:37:04.259581] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-30T19:37:04.350049] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:04.835425] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-30T19:37:05.054326] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-30T19:37:05.285601] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T19:37:05.854357] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-30T19:37:06.654399] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-30T19:37:06.696466] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:37:07.307110] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-30T19:37:07.462597] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-30T19:37:07.469000] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-30T19:37:08.254362] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-30T19:37:08.271844] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-30T19:37:09.054366] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-30T19:37:09.854515] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-30T19:37:10.294915] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-30T19:37:10.652240] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T19:37:10.655987] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-30T19:37:11.186027] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T19:37:11.454351] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-30T19:37:11.601951] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-30T19:37:12.254367] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-30T19:37:13.059820] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-30T19:37:13.080013] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T19:37:13.854343] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-30T19:37:14.639962] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-30T19:37:14.652984] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-30T19:37:14.657342] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-30T19:37:14.745528] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T19:37:15.454367] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-30T19:37:16.231109] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T19:37:16.254363] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-30T19:37:16.315405] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T19:37:17.054376] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-30T19:37:17.111119] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-30T19:37:17.113763] [INFO ] [REMOTE ] KTF: Full fetch complete (17976 records). [2025-09-30T19:37:17.113853] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-30T19:37:17.515531] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-30T19:37:17.515609] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-30T19:37:17.516079] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-30T19:37:17.516153] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-30T19:37:17.517059] [DEBUG] [LOCAL ] KTF: Trimmed 17976 records to 12688 (keeping 200 days of data) [2025-09-30T19:37:17.598525] [DEBUG] [LOCAL ] KTF: Primary data saved (12688 records). [2025-09-30T19:37:17.598694] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-30T19:37:17.598803] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KTF took 20.1s. Estimated remaining: 2h 26m 51s. Rate: 7.8 symbols/min [2025-09-30T19:37:17.787992] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:17.846886] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-30T19:37:17.847263] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-09-30T19:37:17.859667] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-30T19:37:18.056098] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:18.056395] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-30T19:37:18.056452] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-30T19:37:18.057043] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-30T19:37:18.057106] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-30T19:37:18.454265] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:18.654361] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-30T19:37:19.123920] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-30T19:37:19.251335] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-30T19:37:19.454377] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-30T19:37:20.227483] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:37:20.236492] [INFO ] [REMOTE ] KTB: Full fetch complete (57737 records). [2025-09-30T19:37:20.236685] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-30T19:37:20.259597] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-30T19:37:20.690567] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-30T19:37:20.690736] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-30T19:37:20.691712] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-30T19:37:20.691783] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-30T19:37:20.693100] [DEBUG] [LOCAL ] KTB: Trimmed 57737 records to 41051 (keeping 200 days of data) [2025-09-30T19:37:20.960313] [DEBUG] [LOCAL ] KTB: Primary data saved (41051 records). [2025-09-30T19:37:20.960511] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-30T19:37:20.960613] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KTB took 29.7s. Estimated remaining: 2h 26m 39s. Rate: 7.8 symbols/min [2025-09-30T19:37:21.071628] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-30T19:37:21.065960] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-30T19:37:21.164292] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:21.198834] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-30T19:37:21.263483] [DEBUG] [LOCAL ] KVYO: Loaded 49993 existing records from primary storage. [2025-09-30T19:37:21.263921] [INFO ] [MAIN ] KVYO: Loaded 49993 existing records. [2025-09-30T19:37:21.452545] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:21.452831] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-30T19:37:21.452883] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-30T19:37:21.453364] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-30T19:37:21.453423] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-30T19:37:21.835677] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:21.854312] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-30T19:37:22.654353] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-30T19:37:22.955084] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T19:37:22.965585] [INFO ] [REMOTE ] KT: Full fetch complete (66710 records). [2025-09-30T19:37:22.965751] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-30T19:37:23.405891] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-30T19:37:23.406026] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-30T19:37:23.407128] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-30T19:37:23.407196] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-30T19:37:23.408872] [DEBUG] [LOCAL ] KT: Trimmed 66710 records to 45663 (keeping 200 days of data) [2025-09-30T19:37:23.470965] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-30T19:37:23.553005] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T19:37:23.761578] [DEBUG] [LOCAL ] KT: Primary data saved (45663 records). [2025-09-30T19:37:23.761754] [INFO ] [MAIN ] KT: Full history saved. [2025-09-30T19:37:23.761852] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KT took 41.1s. Estimated remaining: 2h 26m 27s. Rate: 7.8 symbols/min [2025-09-30T19:37:23.945282] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:23.963051] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-30T19:37:23.991721] [DEBUG] [LOCAL ] KW: Loaded 40567 existing records from primary storage. [2025-09-30T19:37:23.992032] [INFO ] [MAIN ] KW: Loaded 40567 existing records. [2025-09-30T19:37:24.191815] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:24.192191] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-30T19:37:24.192352] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-30T19:37:24.192771] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-30T19:37:24.192855] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-30T19:37:24.259463] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-30T19:37:24.396515] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T19:37:24.634218] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:24.780327] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-30T19:37:25.054406] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-30T19:37:25.854391] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-30T19:37:26.305116] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T19:37:26.654599] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-30T19:37:26.863478] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-30T19:37:27.454398] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-30T19:37:28.254347] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-30T19:37:28.561714] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-30T19:37:29.054415] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-30T19:37:29.227426] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T19:37:29.322562] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-30T19:37:29.854433] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-30T19:37:30.428842] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-30T19:37:30.662987] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-30T19:37:30.668682] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:37:31.454417] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-30T19:37:32.095238] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-30T19:37:32.116814] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-30T19:37:32.119015] [INFO ] [REMOTE ] KUKE: Full fetch complete (8348 records). [2025-09-30T19:37:32.119099] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-30T19:37:32.259476] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-30T19:37:32.338679] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T19:37:32.339189] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:37:32.339270] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:37:32.339346] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-30T19:37:32.339428] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-30T19:37:32.339485] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-30T19:37:32.339545] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-30T19:37:32.339691] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KUKE took 28.6s. Estimated remaining: 2h 26m 20s. Rate: 7.8 symbols/min [2025-09-30T19:37:32.527115] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:32.546632] [DEBUG] [LOCAL ] KWR: Loaded 16635 existing records from primary storage. [2025-09-30T19:37:32.546937] [INFO ] [MAIN ] KWR: Loaded 16635 existing records. [2025-09-30T19:37:32.770361] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:32.770707] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-30T19:37:32.770773] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-30T19:37:32.771126] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-30T19:37:32.771187] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-30T19:37:33.060043] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-30T19:37:33.196677] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:33.643202] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-30T19:37:33.854410] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-30T19:37:34.654360] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-30T19:37:34.941207] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-30T19:37:35.022741] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-30T19:37:35.454376] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-30T19:37:36.255567] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-30T19:37:36.280668] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-30T19:37:36.409350] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-30T19:37:37.054398] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-30T19:37:37.587636] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-30T19:37:37.854365] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-30T19:37:38.654393] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-30T19:37:38.716607] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-30T19:37:39.332349] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-30T19:37:39.454397] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-30T19:37:39.767747] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-30T19:37:40.254389] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-30T19:37:40.452568] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-30T19:37:41.054366] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-30T19:37:41.713920] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-30T19:37:41.854364] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-30T19:37:42.221915] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T19:37:42.654351] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-30T19:37:43.310167] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-30T19:37:43.454362] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-30T19:37:43.633158] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T19:37:44.254378] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-30T19:37:44.907633] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T19:37:45.054324] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-30T19:37:45.854365] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-30T19:37:45.910499] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-30T19:37:46.029355] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-30T19:37:46.654374] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-30T19:37:47.454376] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-30T19:37:47.536344] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:37:48.162451] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-30T19:37:48.254380] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-30T19:37:48.599207] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-30T19:37:49.054363] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-30T19:37:49.426055] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T19:37:49.854380] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-30T19:37:50.217498] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T19:37:50.654381] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-30T19:37:50.789043] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-30T19:37:51.454377] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-30T19:37:52.254337] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-30T19:37:52.402372] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T19:37:52.405904] [INFO ] [REMOTE ] KWR: Full fetch complete (23937 records). [2025-09-30T19:37:52.406001] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-30T19:37:52.733285] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-30T19:37:52.855590] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-30T19:37:52.855707] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-30T19:37:52.856270] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-30T19:37:52.856335] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-30T19:37:52.857177] [DEBUG] [LOCAL ] KWR: Trimmed 23937 records to 16599 (keeping 200 days of data) [2025-09-30T19:37:52.981695] [DEBUG] [LOCAL ] KWR: Primary data saved (16599 records). [2025-09-30T19:37:52.981900] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-30T19:37:52.982055] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KWR took 20.6s. Estimated remaining: 2h 26m 24s. Rate: 7.8 symbols/min [2025-09-30T19:37:53.060440] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-30T19:37:53.187937] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:53.227297] [DEBUG] [LOCAL ] KYN: Loaded 30077 existing records from primary storage. [2025-09-30T19:37:53.227805] [INFO ] [MAIN ] KYN: Loaded 30077 existing records. [2025-09-30T19:37:53.431080] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:53.431931] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-30T19:37:53.446576] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-30T19:37:53.459826] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-30T19:37:53.459753] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T19:37:53.460029] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-30T19:37:53.839499] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:53.854361] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-30T19:37:54.472878] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:37:54.487511] [INFO ] [REMOTE ] KVYO: Full fetch complete (71527 records). [2025-09-30T19:37:54.487744] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-30T19:37:54.662540] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-30T19:37:54.915303] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-30T19:37:54.915402] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-30T19:37:54.916485] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-30T19:37:54.916555] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-30T19:37:54.918302] [DEBUG] [LOCAL ] KVYO: Trimmed 71527 records to 50023 (keeping 200 days of data) [2025-09-30T19:37:55.224209] [DEBUG] [LOCAL ] KVYO: Primary data saved (50023 records). [2025-09-30T19:37:55.224356] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-30T19:37:55.224488] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KVYO took 34.3s. Estimated remaining: 2h 26m 11s. Rate: 7.8 symbols/min [2025-09-30T19:37:55.409781] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:55.455068] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-30T19:37:55.457143] [DEBUG] [LOCAL ] L: Loaded 40928 existing records from primary storage. [2025-09-30T19:37:55.457569] [INFO ] [MAIN ] L: Loaded 40928 existing records. [2025-09-30T19:37:55.667566] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:55.668042] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-30T19:37:55.668264] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-30T19:37:55.668958] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-30T19:37:55.669047] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-30T19:37:56.164810] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:56.167577] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-30T19:37:56.193464] [INFO ] [REMOTE ] KVUE: Full fetch complete (77673 records). [2025-09-30T19:37:56.200063] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-30T19:37:56.213540] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T19:37:56.258594] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-30T19:37:56.746301] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-30T19:37:56.746466] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-30T19:37:56.749248] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-30T19:37:56.749327] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-30T19:37:56.752569] [DEBUG] [LOCAL ] KVUE: Trimmed 77673 records to 53667 (keeping 200 days of data) [2025-09-30T19:37:57.079901] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-30T19:37:57.143917] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:37:57.181801] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-09-30T19:37:57.181983] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-30T19:37:57.182166] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KVUE took 39.6s. Estimated remaining: 2h 25m 58s. Rate: 7.8 symbols/min [2025-09-30T19:37:57.366758] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:37:57.421398] [DEBUG] [LOCAL ] LAC: Loaded 52321 existing records from primary storage. [2025-09-30T19:37:57.421797] [INFO ] [MAIN ] LAC: Loaded 52321 existing records. [2025-09-30T19:37:57.657887] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:37:57.658358] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-30T19:37:57.658564] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-30T19:37:57.659272] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-30T19:37:57.659370] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-30T19:37:57.858086] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-30T19:37:57.933392] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T19:37:58.101099] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:37:58.135802] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T19:37:58.654368] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-30T19:37:59.276960] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T19:37:59.454362] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-30T19:38:00.254356] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-30T19:38:00.300633] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:38:01.054363] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-30T19:38:01.502255] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-30T19:38:01.751340] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-30T19:38:01.854359] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-30T19:38:02.219425] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-30T19:38:02.228296] [INFO ] [REMOTE ] KW: Full fetch complete (57050 records). [2025-09-30T19:38:02.228467] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-30T19:38:02.646597] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-30T19:38:02.646714] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-30T19:38:02.647631] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-30T19:38:02.647718] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-30T19:38:02.649098] [DEBUG] [LOCAL ] KW: Trimmed 57050 records to 40564 (keeping 200 days of data) [2025-09-30T19:38:02.654360] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-30T19:38:02.912301] [DEBUG] [LOCAL ] KW: Primary data saved (40564 records). [2025-09-30T19:38:02.912440] [INFO ] [MAIN ] KW: Full history saved. [2025-09-30T19:38:02.912525] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. KW took 39.2s. Estimated remaining: 2h 25m 49s. Rate: 7.8 symbols/min [2025-09-30T19:38:03.116101] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:03.143949] [DEBUG] [LOCAL ] LAD: Loaded 23520 existing records from primary storage. [2025-09-30T19:38:03.144242] [INFO ] [MAIN ] LAD: Loaded 23520 existing records. [2025-09-30T19:38:03.314336] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T19:38:03.392761] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:03.393028] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-30T19:38:03.393098] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-30T19:38:03.393496] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-30T19:38:03.393558] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-30T19:38:03.456993] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-30T19:38:03.786291] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:03.805191] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-30T19:38:04.254361] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-30T19:38:05.054348] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-30T19:38:05.247972] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-30T19:38:05.524088] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T19:38:05.854375] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-30T19:38:05.959235] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-30T19:38:06.654370] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-30T19:38:07.454363] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-30T19:38:07.525348] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-30T19:38:08.254381] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-30T19:38:08.759338] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-30T19:38:08.902159] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:38:09.054351] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-30T19:38:09.502283] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-30T19:38:09.854365] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-30T19:38:10.654317] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-30T19:38:10.700244] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-30T19:38:11.055244] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-30T19:38:11.454372] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-30T19:38:12.191727] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T19:38:12.254351] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-30T19:38:12.339733] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T19:38:13.054351] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-30T19:38:13.567749] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-30T19:38:13.854348] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-30T19:38:14.241223] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T19:38:14.654359] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-30T19:38:15.454356] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-30T19:38:15.625119] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-30T19:38:15.912011] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-30T19:38:16.254362] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-30T19:38:16.567952] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-30T19:38:17.054347] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-30T19:38:17.832531] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T19:38:17.854339] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-30T19:38:17.888934] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-30T19:38:18.654395] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-30T19:38:18.794685] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T19:38:19.454362] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-30T19:38:20.254323] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-30T19:38:20.292161] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-30T19:38:20.302842] [INFO ] [REMOTE ] L: Full fetch complete (59524 records). [2025-09-30T19:38:20.302978] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-30T19:38:20.750130] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-30T19:38:20.750333] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-30T19:38:20.751327] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-30T19:38:20.751430] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-30T19:38:20.772455] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T19:38:20.779996] [DEBUG] [LOCAL ] L: Trimmed 59524 records to 40964 (keeping 200 days of data) [2025-09-30T19:38:21.048996] [DEBUG] [LOCAL ] L: Primary data saved (40964 records). [2025-09-30T19:38:21.049127] [INFO ] [MAIN ] L: Full history saved. [2025-09-30T19:38:21.049206] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. L took 25.8s. Estimated remaining: 2h 25m 51s. Rate: 7.8 symbols/min [2025-09-30T19:38:21.060737] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-30T19:38:21.239194] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:21.281128] [DEBUG] [LOCAL ] LADR: Loaded 38625 existing records from primary storage. [2025-09-30T19:38:21.281517] [INFO ] [MAIN ] LADR: Loaded 38625 existing records. [2025-09-30T19:38:21.474989] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:21.475247] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-30T19:38:21.475299] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-30T19:38:21.475679] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-30T19:38:21.475756] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-30T19:38:21.865216] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-30T19:38:21.917614] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:22.164557] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T19:38:22.469749] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-30T19:38:22.654413] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-30T19:38:23.120257] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-30T19:38:23.454382] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-30T19:38:24.254439] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-30T19:38:24.444975] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-30T19:38:24.833769] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T19:38:24.840377] [INFO ] [REMOTE ] KYN: Full fetch complete (44629 records). [2025-09-30T19:38:24.840531] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-30T19:38:25.059521] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-30T19:38:25.255087] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-30T19:38:25.255193] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-30T19:38:25.256066] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-30T19:38:25.256157] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-30T19:38:25.257500] [DEBUG] [LOCAL ] KYN: Trimmed 44629 records to 30028 (keeping 200 days of data) [2025-09-30T19:38:25.475879] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:38:25.499447] [DEBUG] [LOCAL ] KYN: Primary data saved (30028 records). [2025-09-30T19:38:25.499602] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-30T19:38:25.501582] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. KYN took 32.5s. Estimated remaining: 2h 25m 40s. Rate: 7.8 symbols/min [2025-09-30T19:38:25.680135] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:25.686382] [DEBUG] [LOCAL ] LANV: Loaded 2823 existing records from primary storage. [2025-09-30T19:38:25.686592] [INFO ] [MAIN ] LANV: Loaded 2823 existing records. [2025-09-30T19:38:25.866178] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-30T19:38:25.872453] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:25.873699] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-30T19:38:25.873789] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-30T19:38:25.874055] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-30T19:38:25.874185] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-30T19:38:26.302886] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:26.654363] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-30T19:38:26.932967] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-30T19:38:27.205412] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-30T19:38:27.377383] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-30T19:38:27.454385] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-30T19:38:28.254379] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-30T19:38:28.632595] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-30T19:38:28.825313] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-30T19:38:29.054391] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-30T19:38:29.854423] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-30T19:38:30.398197] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T19:38:30.654358] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-30T19:38:31.018891] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-30T19:38:31.024018] [INFO ] [REMOTE ] LAD: Full fetch complete (35448 records). [2025-09-30T19:38:31.024213] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-30T19:38:31.455597] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-30T19:38:31.455294] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-30T19:38:31.455736] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-30T19:38:31.457267] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-30T19:38:31.457335] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-30T19:38:31.458812] [DEBUG] [LOCAL ] LAD: Trimmed 35448 records to 23493 (keeping 200 days of data) [2025-09-30T19:38:31.641061] [DEBUG] [LOCAL ] LAD: Primary data saved (23493 records). [2025-09-30T19:38:31.641286] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-30T19:38:31.641450] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. LAD took 28.7s. Estimated remaining: 2h 25m 31s. Rate: 7.8 symbols/min [2025-09-30T19:38:31.859583] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:31.859794] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-30T19:38:31.859853] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-30T19:38:31.860001] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-30T19:38:31.860057] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-30T19:38:31.860103] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-30T19:38:31.860137] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-30T19:38:32.276705] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-30T19:38:32.283009] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:32.287468] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-30T19:38:32.709452] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-30T19:38:33.054342] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-30T19:38:33.427810] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:38:33.428170] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-30T19:38:33.428263] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:38:33.428314] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-09-30T19:38:33.428376] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:38:33.428449] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-30T19:38:33.428516] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-30T19:38:33.428554] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-30T19:38:33.428611] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-30T19:38:33.428709] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LAR took 1.8s. Estimated remaining: 2h 25m 18s. Rate: 7.8 symbols/min [2025-09-30T19:38:33.718635] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-30T19:38:33.854361] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-30T19:38:34.654408] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-30T19:38:35.454390] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-30T19:38:35.498758] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:38:35.869526] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-30T19:38:36.254330] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-30T19:38:36.622500] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-30T19:38:36.716891] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-30T19:38:37.054351] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-30T19:38:37.408433] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-30T19:38:37.854384] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-30T19:38:38.271111] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-30T19:38:38.654436] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-30T19:38:39.454422] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-30T19:38:39.965218] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T19:38:40.254386] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-30T19:38:41.054368] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-30T19:38:41.476670] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-30T19:38:41.559547] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-30T19:38:41.704712] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-30T19:38:41.716336] [INFO ] [REMOTE ] LAC: Full fetch complete (75979 records). [2025-09-30T19:38:41.716511] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-30T19:38:41.869200] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-30T19:38:42.145398] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-30T19:38:42.145492] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-30T19:38:42.146518] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-30T19:38:42.146588] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-30T19:38:42.148193] [DEBUG] [LOCAL ] LAC: Trimmed 75979 records to 52329 (keeping 200 days of data) [2025-09-30T19:38:42.453427] [DEBUG] [LOCAL ] LAC: Primary data saved (52329 records). [2025-09-30T19:38:42.453579] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-30T19:38:42.453691] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LAC took 45.3s. Estimated remaining: 2h 25m 12s. Rate: 7.8 symbols/min [2025-09-30T19:38:42.481478] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-30T19:38:42.654378] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-30T19:38:43.292217] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-30T19:38:43.293821] [INFO ] [REMOTE ] LANV: Full fetch complete (4421 records). [2025-09-30T19:38:43.293896] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-30T19:38:43.475977] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-30T19:38:43.684164] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-30T19:38:43.684480] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-30T19:38:43.684678] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-30T19:38:43.684739] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-30T19:38:43.685127] [DEBUG] [LOCAL ] LANV: Trimmed 4421 records to 2826 (keeping 200 days of data) [2025-09-30T19:38:43.701840] [DEBUG] [LOCAL ] LANV: Primary data saved (2826 records). [2025-09-30T19:38:43.701930] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-30T19:38:43.702006] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LANV took 18.2s. Estimated remaining: 2h 24m 58s. Rate: 7.8 symbols/min [2025-09-30T19:38:45.051983] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-30T19:38:45.062169] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-30T19:38:46.516263] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T19:38:46.525102] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-30T19:38:47.935395] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:38:47.944332] [INFO ] [REMOTE ] LADR: Full fetch complete (55276 records). [2025-09-30T19:38:47.944476] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-30T19:38:48.345682] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-30T19:38:48.345773] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-30T19:38:48.346634] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-30T19:38:48.346722] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-30T19:38:48.347944] [DEBUG] [LOCAL ] LADR: Trimmed 55276 records to 38698 (keeping 200 days of data) [2025-09-30T19:38:48.590639] [DEBUG] [LOCAL ] LADR: Primary data saved (38698 records). [2025-09-30T19:38:48.590807] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-30T19:38:48.590893] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LADR took 27.5s. Estimated remaining: 2h 24m 48s. Rate: 7.8 symbols/min [2025-09-30T19:38:49.339545] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:49.369783] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:49.392479] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:49.388951] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:38:49.422416] [DEBUG] [LOCAL ] LAW: Loaded 13949 existing records from primary storage. [2025-09-30T19:38:49.422724] [INFO ] [MAIN ] LAW: Loaded 13949 existing records. [2025-09-30T19:38:49.660311] [DEBUG] [LOCAL ] LAZ: Loaded 44983 existing records from primary storage. [2025-09-30T19:38:49.659622] [DEBUG] [LOCAL ] LB: Loaded 37552 existing records from primary storage. [2025-09-30T19:38:49.694314] [INFO ] [MAIN ] LB: Loaded 37552 existing records. [2025-09-30T19:38:49.711220] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:49.711712] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-30T19:38:49.711476] [INFO ] [MAIN ] LAZ: Loaded 44983 existing records. [2025-09-30T19:38:49.712695] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-30T19:38:49.712564] [DEBUG] [LOCAL ] LBRT: Loaded 52915 existing records from primary storage. [2025-09-30T19:38:49.730807] [INFO ] [MAIN ] LBRT: Loaded 52915 existing records. [2025-09-30T19:38:49.780780] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-30T19:38:49.854132] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-30T19:38:50.432514] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:50.474747] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:50.493429] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-30T19:38:50.477730] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-30T19:38:50.522508] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-30T19:38:50.499627] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:38:50.534872] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-30T19:38:50.543221] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-30T19:38:50.543126] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-30T19:38:50.534703] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-30T19:38:50.572276] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-30T19:38:50.591270] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-30T19:38:50.616290] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-30T19:38:50.648252] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-30T19:38:50.808828] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-30T19:38:51.110513] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:51.144107] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-30T19:38:51.877809] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:51.935758] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-30T19:38:52.014514] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:52.033578] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-30T19:38:52.040365] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:38:52.041880] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-30T19:38:52.195984] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-30T19:38:52.199870] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-30T19:38:53.183347] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-30T19:38:53.187398] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-30T19:38:53.360861] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T19:38:53.370384] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-30T19:38:53.520403] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-30T19:38:53.529877] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-30T19:38:53.727388] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-30T19:38:53.731205] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-30T19:38:53.804604] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-30T19:38:53.815512] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-30T19:38:54.227562] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-30T19:38:54.231142] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-30T19:38:54.831803] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-30T19:38:54.842780] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-30T19:38:55.005837] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-30T19:38:55.105281] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-30T19:38:55.197545] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-30T19:38:55.454395] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-30T19:38:55.944369] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T19:38:56.254360] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-30T19:38:56.954366] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T19:38:57.054358] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-30T19:38:57.694399] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-30T19:38:57.854368] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-30T19:38:58.654533] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-30T19:38:58.667489] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-30T19:38:58.709278] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-30T19:38:59.454396] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-30T19:39:00.254337] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-30T19:39:00.331796] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T19:39:00.727476] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-30T19:39:01.054368] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-30T19:39:01.767881] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T19:39:01.794589] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:39:01.854356] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-30T19:39:02.654412] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-30T19:39:02.829829] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-30T19:39:03.454400] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-30T19:39:04.254360] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-30T19:39:04.324502] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-30T19:39:04.450339] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-30T19:39:05.054349] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-30T19:39:05.774292] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-30T19:39:05.854348] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-30T19:39:06.167133] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T19:39:06.171038] [INFO ] [REMOTE ] LAW: Full fetch complete (20540 records). [2025-09-30T19:39:06.171114] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-30T19:39:06.566509] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-30T19:39:06.566589] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-30T19:39:06.567082] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-30T19:39:06.567146] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-30T19:39:06.567840] [DEBUG] [LOCAL ] LAW: Trimmed 20540 records to 13998 (keeping 200 days of data) [2025-09-30T19:39:06.653772] [DEBUG] [LOCAL ] LAW: Primary data saved (13998 records). [2025-09-30T19:39:06.653917] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-30T19:39:06.654001] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LAW took 18.1s. Estimated remaining: 2h 24m 49s. Rate: 7.8 symbols/min [2025-09-30T19:39:06.659556] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-30T19:39:06.850834] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:06.903484] [DEBUG] [LOCAL ] LC: Loaded 47828 existing records from primary storage. [2025-09-30T19:39:06.903874] [INFO ] [MAIN ] LC: Loaded 47828 existing records. [2025-09-30T19:39:07.112935] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:07.113188] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-30T19:39:07.113238] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-30T19:39:07.113777] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-30T19:39:07.113856] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-30T19:39:07.456467] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-30T19:39:07.532501] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:07.568816] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T19:39:08.207012] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T19:39:08.254367] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-30T19:39:09.021305] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T19:39:09.054365] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-30T19:39:09.854334] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-30T19:39:09.980990] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-30T19:39:10.654392] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-30T19:39:10.780106] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-30T19:39:11.454419] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-30T19:39:11.581600] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-30T19:39:12.256927] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-30T19:39:12.262744] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-30T19:39:12.752984] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-30T19:39:13.054341] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-30T19:39:13.675278] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-30T19:39:13.854354] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-30T19:39:14.654355] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-30T19:39:14.924345] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-30T19:39:15.454333] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-30T19:39:15.539989] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-30T19:39:16.187543] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T19:39:16.254338] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-30T19:39:17.059511] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-30T19:39:17.076052] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-30T19:39:17.853906] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-30T19:39:17.857012] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-30T19:39:18.654366] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-30T19:39:18.785995] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T19:39:19.456976] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-30T19:39:19.462891] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T19:39:19.473083] [INFO ] [REMOTE ] LAZ: Full fetch complete (65824 records). [2025-09-30T19:39:19.473237] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-30T19:39:19.904289] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-30T19:39:19.904405] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-30T19:39:19.905521] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-30T19:39:19.905596] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-30T19:39:19.907571] [DEBUG] [LOCAL ] LAZ: Trimmed 65824 records to 44962 (keeping 200 days of data) [2025-09-30T19:39:20.211064] [DEBUG] [LOCAL ] LAZ: Primary data saved (44962 records). [2025-09-30T19:39:20.211209] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-30T19:39:20.211296] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LAZ took 31.6s. Estimated remaining: 2h 24m 47s. Rate: 7.8 symbols/min [2025-09-30T19:39:20.264772] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-30T19:39:20.405020] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:20.440600] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-30T19:39:20.453209] [INFO ] [REMOTE ] LBRT: Full fetch complete (76540 records). [2025-09-30T19:39:20.453388] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-30T19:39:20.611286] [DEBUG] [LOCAL ] LCII: Loaded 28223 existing records from primary storage. [2025-09-30T19:39:20.635068] [INFO ] [MAIN ] LCII: Loaded 28223 existing records. [2025-09-30T19:39:21.173239] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:21.206385] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-30T19:39:21.231566] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-30T19:39:21.231808] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-30T19:39:21.233111] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-30T19:39:21.233275] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-30T19:39:21.233345] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-30T19:39:21.234214] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-30T19:39:21.234391] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-30T19:39:21.298810] [DEBUG] [LOCAL ] LBRT: Trimmed 76540 records to 52915 (keeping 200 days of data) [2025-09-30T19:39:21.406438] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-30T19:39:21.586467] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-30T19:39:21.846286] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:21.854560] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-30T19:39:22.012544] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-30T19:39:22.024586] [INFO ] [REMOTE ] LB: Full fetch complete (55874 records). [2025-09-30T19:39:22.025682] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-30T19:39:22.473787] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-30T19:39:22.474167] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-30T19:39:22.476230] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-30T19:39:22.476321] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-30T19:39:22.479099] [DEBUG] [LOCAL ] LB: Trimmed 55874 records to 37689 (keeping 200 days of data) [2025-09-30T19:39:22.700463] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-30T19:39:22.706314] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-30T19:39:22.821337] [DEBUG] [LOCAL ] LBRT: Primary data saved (52915 records). [2025-09-30T19:39:22.822227] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-30T19:39:22.822348] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LBRT took 34.2s. Estimated remaining: 2h 24m 35s. Rate: 7.8 symbols/min [2025-09-30T19:39:23.040255] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:23.057527] [DEBUG] [LOCAL ] LB: Primary data saved (37689 records). [2025-09-30T19:39:23.057861] [INFO ] [MAIN ] LB: Full history saved. [2025-09-30T19:39:23.058007] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LB took 34.5s. Estimated remaining: 2h 24m 20s. Rate: 7.8 symbols/min [2025-09-30T19:39:23.281636] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:23.285321] [DEBUG] [LOCAL ] LDI: Loaded 44119 existing records from primary storage. [2025-09-30T19:39:23.286434] [INFO ] [MAIN ] LDI: Loaded 44119 existing records. [2025-09-30T19:39:23.445245] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-30T19:39:23.526306] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:23.528041] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-30T19:39:23.539978] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-30T19:39:23.541486] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-30T19:39:23.542058] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-30T19:39:23.542125] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-30T19:39:23.682684] [DEBUG] [LOCAL ] LDOS: Loaded 45633 existing records from primary storage. [2025-09-30T19:39:23.711900] [INFO ] [MAIN ] LDOS: Loaded 45633 existing records. [2025-09-30T19:39:24.221166] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:24.246439] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-30T19:39:24.255248] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-30T19:39:24.278609] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:24.281333] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:39:24.281929] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-30T19:39:24.286776] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-30T19:39:24.287999] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-30T19:39:24.657555] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:24.962733] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T19:39:25.054356] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-30T19:39:25.364094] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T19:39:25.854457] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-30T19:39:26.505938] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T19:39:26.654474] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-30T19:39:27.074686] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:39:27.454367] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-30T19:39:28.254411] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-30T19:39:28.370304] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T19:39:28.583391] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-30T19:39:29.054415] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-30T19:39:29.854404] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-30T19:39:29.911134] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T19:39:30.290032] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-30T19:39:30.654457] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-30T19:39:31.091866] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T19:39:31.454442] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-30T19:39:32.107798] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T19:39:32.254372] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-30T19:39:33.054346] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-30T19:39:33.118895] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T19:39:33.525772] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-30T19:39:33.854397] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-30T19:39:34.390706] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T19:39:34.654405] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-30T19:39:35.330136] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:39:35.340811] [INFO ] [REMOTE ] LC: Full fetch complete (70539 records). [2025-09-30T19:39:35.340959] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-30T19:39:35.459433] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-30T19:39:35.766674] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-30T19:39:35.766793] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-30T19:39:35.767888] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-30T19:39:35.768032] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-30T19:39:35.769590] [DEBUG] [LOCAL ] LC: Trimmed 70539 records to 47854 (keeping 200 days of data) [2025-09-30T19:39:35.890444] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T19:39:36.086490] [DEBUG] [LOCAL ] LC: Primary data saved (47854 records). [2025-09-30T19:39:36.086678] [INFO ] [MAIN ] LC: Full history saved. [2025-09-30T19:39:36.086789] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LC took 29.4s. Estimated remaining: 2h 24m 18s. Rate: 7.8 symbols/min [2025-09-30T19:39:36.268919] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-30T19:39:36.273742] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:36.291081] [DEBUG] [LOCAL ] LDP: Loaded 12962 existing records from primary storage. [2025-09-30T19:39:36.291314] [INFO ] [MAIN ] LDP: Loaded 12962 existing records. [2025-09-30T19:39:36.476748] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:36.477003] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-30T19:39:36.477065] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-30T19:39:36.477244] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-30T19:39:36.477303] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-30T19:39:36.883561] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-30T19:39:36.906278] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:37.054349] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-30T19:39:37.407997] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T19:39:37.854403] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-30T19:39:38.593633] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:39:38.654410] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-30T19:39:39.267345] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T19:39:39.454393] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-30T19:39:39.905896] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-30T19:39:40.254377] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-30T19:39:40.924994] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-30T19:39:41.054349] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-30T19:39:41.712462] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-30T19:39:41.854377] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-30T19:39:42.387686] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T19:39:42.654382] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-30T19:39:43.238664] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T19:39:43.454371] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-30T19:39:44.254348] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-30T19:39:44.332362] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T19:39:44.732345] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-30T19:39:44.739402] [INFO ] [REMOTE ] LCII: Full fetch complete (39162 records). [2025-09-30T19:39:44.739526] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-30T19:39:45.059583] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-30T19:39:45.176619] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-30T19:39:45.176813] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-30T19:39:45.177623] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-30T19:39:45.177747] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-30T19:39:45.178730] [DEBUG] [LOCAL ] LCII: Trimmed 39162 records to 28110 (keeping 200 days of data) [2025-09-30T19:39:45.373548] [DEBUG] [LOCAL ] LCII: Primary data saved (28110 records). [2025-09-30T19:39:45.374631] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-30T19:39:45.374791] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-30T19:39:45.375082] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LCII took 25.2s. Estimated remaining: 2h 24m 11s. Rate: 7.8 symbols/min [2025-09-30T19:39:45.566350] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:45.608760] [DEBUG] [LOCAL ] LEA: Loaded 41756 existing records from primary storage. [2025-09-30T19:39:45.609071] [INFO ] [MAIN ] LEA: Loaded 41756 existing records. [2025-09-30T19:39:45.801749] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:45.802102] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-30T19:39:45.802160] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-30T19:39:45.803309] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-30T19:39:45.803369] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-30T19:39:45.866774] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-30T19:39:46.177728] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:46.654340] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-30T19:39:46.839382] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-30T19:39:47.454341] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-30T19:39:47.717136] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-30T19:39:47.912820] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-30T19:39:48.254366] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-30T19:39:49.018366] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T19:39:49.054351] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-30T19:39:49.817008] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T19:39:49.854356] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-30T19:39:50.585748] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T19:39:50.654342] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-30T19:39:51.446240] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T19:39:51.454917] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-30T19:39:51.581689] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-30T19:39:52.254362] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-30T19:39:53.054351] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-30T19:39:53.811203] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-30T19:39:53.822739] [INFO ] [REMOTE ] LDI: Full fetch complete (60422 records). [2025-09-30T19:39:53.822888] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-30T19:39:53.868478] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-30T19:39:53.946052] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T19:39:54.148622] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-30T19:39:54.197995] [INFO ] [REMOTE ] LDOS: Full fetch complete (67695 records). [2025-09-30T19:39:54.208438] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-30T19:39:54.378838] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-30T19:39:54.384122] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-30T19:39:54.385219] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-30T19:39:54.405493] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-30T19:39:54.462344] [DEBUG] [LOCAL ] LDI: Trimmed 60422 records to 44128 (keeping 200 days of data) [2025-09-30T19:39:54.673976] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-30T19:39:54.940789] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-30T19:39:54.946322] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-30T19:39:54.954282] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-30T19:39:54.954687] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-30T19:39:54.961924] [DEBUG] [LOCAL ] LDOS: Trimmed 67695 records to 45593 (keeping 200 days of data) [2025-09-30T19:39:55.100794] [DEBUG] [LOCAL ] LDI: Primary data saved (44128 records). [2025-09-30T19:39:55.103543] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-30T19:39:55.104536] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDI took 32.3s. Estimated remaining: 2h 24m 5s. Rate: 7.8 symbols/min [2025-09-30T19:39:55.302525] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:55.330856] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-30T19:39:55.466301] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-30T19:39:55.487398] [DEBUG] [LOCAL ] LEG: Loaded 50337 existing records from primary storage. [2025-09-30T19:39:55.488724] [INFO ] [MAIN ] LEG: Loaded 50337 existing records. [2025-09-30T19:39:55.700011] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:55.701344] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-30T19:39:55.701692] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-30T19:39:55.702732] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-30T19:39:55.704235] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-30T19:39:55.858282] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T19:39:56.141770] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:56.186732] [DEBUG] [LOCAL ] LDOS: Primary data saved (45593 records). [2025-09-30T19:39:56.186924] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-30T19:39:56.189138] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDOS took 33.1s. Estimated remaining: 2h 23m 52s. Rate: 7.8 symbols/min [2025-09-30T19:39:56.259506] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-30T19:39:56.386754] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:39:56.458428] [DEBUG] [LOCAL ] LEN: Loaded 53195 existing records from primary storage. [2025-09-30T19:39:56.458827] [INFO ] [MAIN ] LEN: Loaded 53195 existing records. [2025-09-30T19:39:56.662019] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:39:56.662271] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-30T19:39:56.662318] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-30T19:39:56.662828] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-30T19:39:56.662887] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-30T19:39:57.060764] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-30T19:39:57.076766] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:39:57.153616] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:39:57.206549] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-30T19:39:57.854369] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-30T19:39:58.654345] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-30T19:39:58.817608] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T19:39:59.363639] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T19:39:59.454376] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-30T19:39:59.635425] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-30T19:40:00.254382] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-30T19:40:01.054358] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-30T19:40:01.344807] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-30T19:40:01.855536] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-30T19:40:01.857758] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-30T19:40:02.040065] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-30T19:40:02.654361] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-30T19:40:03.454374] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-30T19:40:03.609297] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T19:40:03.927569] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-30T19:40:04.254372] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-30T19:40:05.054365] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-30T19:40:05.145354] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-30T19:40:05.238546] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-30T19:40:05.854356] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-30T19:40:06.655696] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-30T19:40:06.661314] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:40:07.361527] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-30T19:40:07.454344] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-30T19:40:07.591240] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-30T19:40:07.594339] [INFO ] [REMOTE ] LDP: Full fetch complete (19461 records). [2025-09-30T19:40:07.594447] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-30T19:40:07.996799] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-30T19:40:07.996878] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-30T19:40:07.997304] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-30T19:40:07.997368] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-30T19:40:07.998012] [DEBUG] [LOCAL ] LDP: Trimmed 19461 records to 12967 (keeping 200 days of data) [2025-09-30T19:40:08.083865] [DEBUG] [LOCAL ] LDP: Primary data saved (12967 records). [2025-09-30T19:40:08.084011] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-30T19:40:08.084170] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDP took 32.0s. Estimated remaining: 2h 23m 48s. Rate: 7.8 symbols/min [2025-09-30T19:40:08.263812] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-30T19:40:08.268548] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:08.288133] [DEBUG] [LOCAL ] LEO: Loaded 17498 existing records from primary storage. [2025-09-30T19:40:08.288411] [INFO ] [MAIN ] LEO: Loaded 17498 existing records. [2025-09-30T19:40:08.487901] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:08.488222] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-30T19:40:08.488304] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-30T19:40:08.488715] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-30T19:40:08.488812] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-30T19:40:08.934900] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:08.969832] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-30T19:40:09.054365] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-30T19:40:09.854337] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-30T19:40:10.263386] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-30T19:40:10.645270] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T19:40:10.654672] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-30T19:40:11.134897] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T19:40:11.454378] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-30T19:40:12.254369] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-30T19:40:12.563579] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-30T19:40:13.033471] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-30T19:40:13.054318] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-30T19:40:13.764074] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-30T19:40:13.854351] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-30T19:40:14.114869] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-30T19:40:14.654325] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-30T19:40:15.454400] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-30T19:40:15.527792] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-30T19:40:15.538324] [INFO ] [REMOTE ] LEA: Full fetch complete (60918 records). [2025-09-30T19:40:15.538498] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-30T19:40:15.956408] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-30T19:40:15.956503] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-30T19:40:15.957393] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-30T19:40:15.957460] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-30T19:40:15.958810] [DEBUG] [LOCAL ] LEA: Trimmed 60918 records to 41744 (keeping 200 days of data) [2025-09-30T19:40:16.249885] [DEBUG] [LOCAL ] LEA: Primary data saved (41744 records). [2025-09-30T19:40:16.250052] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-30T19:40:16.250188] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 30.9s. Estimated remaining: 2h 23m 41s. Rate: 7.8 symbols/min [2025-09-30T19:40:16.255768] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-30T19:40:16.482728] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:16.546453] [DEBUG] [LOCAL ] LEVI: Loaded 51512 existing records from primary storage. [2025-09-30T19:40:16.546919] [INFO ] [MAIN ] LEVI: Loaded 51512 existing records. [2025-09-30T19:40:16.688353] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-30T19:40:16.757552] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-30T19:40:16.846604] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:16.846823] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-30T19:40:16.846871] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-30T19:40:16.847177] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-30T19:40:16.847236] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-30T19:40:17.059594] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-30T19:40:17.238726] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:17.813142] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T19:40:17.854391] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-30T19:40:18.654374] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-30T19:40:18.975244] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-30T19:40:19.454323] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-30T19:40:19.497052] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:40:19.549270] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T19:40:20.254373] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-30T19:40:21.054329] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-30T19:40:21.118830] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:40:21.741224] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T19:40:21.854316] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-30T19:40:22.245632] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-30T19:40:22.654423] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-30T19:40:23.454571] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-30T19:40:23.603771] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-30T19:40:23.611187] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T19:40:24.254374] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-30T19:40:25.054328] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-30T19:40:25.601127] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-30T19:40:25.854422] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-30T19:40:25.910807] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-30T19:40:26.033910] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-30T19:40:26.654415] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-30T19:40:27.454350] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-30T19:40:27.545947] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-30T19:40:27.614430] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-30T19:40:28.254426] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-30T19:40:29.054405] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-30T19:40:29.854349] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-30T19:40:29.902915] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-30T19:40:29.914700] [INFO ] [REMOTE ] LEN: Full fetch complete (77039 records). [2025-09-30T19:40:29.914915] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-30T19:40:30.065972] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-30T19:40:30.171945] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T19:40:30.445038] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-30T19:40:30.445136] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-30T19:40:30.446157] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-30T19:40:30.446238] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-30T19:40:30.447839] [DEBUG] [LOCAL ] LEN: Trimmed 77039 records to 53188 (keeping 200 days of data) [2025-09-30T19:40:30.679810] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-30T19:40:30.811366] [DEBUG] [LOCAL ] LEN: Primary data saved (53188 records). [2025-09-30T19:40:30.811525] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-30T19:40:30.812097] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEN took 34.6s. Estimated remaining: 2h 23m 39s. Rate: 7.8 symbols/min [2025-09-30T19:40:31.015072] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:31.036320] [DEBUG] [LOCAL ] LFT: Loaded 18238 existing records from primary storage. [2025-09-30T19:40:31.036593] [INFO ] [MAIN ] LFT: Loaded 18238 existing records. [2025-09-30T19:40:31.238848] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:31.239202] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-30T19:40:31.239452] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-30T19:40:31.239828] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-30T19:40:31.239893] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-30T19:40:31.461174] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-30T19:40:31.513191] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-30T19:40:31.714018] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:31.725356] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-30T19:40:31.729527] [INFO ] [REMOTE ] LEO: Full fetch complete (27010 records). [2025-09-30T19:40:31.729671] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-30T19:40:32.138950] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-30T19:40:32.139042] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-30T19:40:32.139692] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-30T19:40:32.139757] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-30T19:40:32.140536] [DEBUG] [LOCAL ] LEO: Trimmed 27010 records to 17325 (keeping 200 days of data) [2025-09-30T19:40:32.250919] [DEBUG] [LOCAL ] LEO: Primary data saved (17325 records). [2025-09-30T19:40:32.251072] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-30T19:40:32.251158] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEO took 24.2s. Estimated remaining: 2h 23m 26s. Rate: 7.8 symbols/min [2025-09-30T19:40:32.263434] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-30T19:40:32.454615] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:32.468512] [DEBUG] [LOCAL ] LGI: Loaded 9870 existing records from primary storage. [2025-09-30T19:40:32.468884] [INFO ] [MAIN ] LGI: Loaded 9870 existing records. [2025-09-30T19:40:32.684961] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:32.685207] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-30T19:40:32.685257] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-30T19:40:32.685437] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-30T19:40:32.685497] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-30T19:40:33.061415] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-30T19:40:33.092700] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:33.340300] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-30T19:40:33.509915] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T19:40:33.854382] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-30T19:40:34.574264] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-30T19:40:34.654379] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-30T19:40:35.039980] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-30T19:40:35.454372] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-30T19:40:36.254374] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-30T19:40:36.335906] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T19:40:36.896019] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-30T19:40:36.909545] [INFO ] [REMOTE ] LEG: Full fetch complete (73158 records). [2025-09-30T19:40:36.909750] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-30T19:40:37.055418] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-30T19:40:37.274898] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T19:40:37.374722] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-30T19:40:37.374851] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-30T19:40:37.375841] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-30T19:40:37.375934] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-30T19:40:37.377488] [DEBUG] [LOCAL ] LEG: Trimmed 73158 records to 50291 (keeping 200 days of data) [2025-09-30T19:40:37.706421] [DEBUG] [LOCAL ] LEG: Primary data saved (50291 records). [2025-09-30T19:40:37.706567] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-30T19:40:37.706736] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEG took 42.6s. Estimated remaining: 2h 23m 16s. Rate: 7.8 symbols/min [2025-09-30T19:40:37.866842] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-30T19:40:37.902238] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:37.943010] [DEBUG] [LOCAL ] LH: Loaded 37834 existing records from primary storage. [2025-09-30T19:40:37.943310] [INFO ] [MAIN ] LH: Loaded 37834 existing records. [2025-09-30T19:40:38.145875] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:38.146162] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-30T19:40:38.146218] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-30T19:40:38.146616] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-30T19:40:38.146726] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-30T19:40:38.565219] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:38.600828] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-30T19:40:38.654379] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-30T19:40:38.760884] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-30T19:40:39.454365] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-30T19:40:40.116197] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-30T19:40:40.254364] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-30T19:40:40.378177] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-30T19:40:41.054431] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-30T19:40:41.836248] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:40:41.854321] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-30T19:40:41.876371] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-30T19:40:42.654380] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-30T19:40:43.384934] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:40:43.400231] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-30T19:40:43.454405] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-30T19:40:44.254430] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-30T19:40:45.054364] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-30T19:40:45.434368] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T19:40:45.459688] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T19:40:45.854382] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-30T19:40:46.450589] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-30T19:40:46.654381] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-30T19:40:46.736258] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T19:40:47.454383] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-30T19:40:48.254360] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-30T19:40:48.312634] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-30T19:40:48.414609] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T19:40:48.808725] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T19:40:49.054385] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-30T19:40:49.799463] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-30T19:40:49.854363] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-30T19:40:50.621282] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T19:40:50.654397] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-30T19:40:51.454415] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-30T19:40:51.984248] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-30T19:40:52.254338] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-30T19:40:52.296150] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-30T19:40:53.035504] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T19:40:53.054358] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-30T19:40:53.854394] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-30T19:40:54.594479] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T19:40:54.654406] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-30T19:40:55.073555] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-30T19:40:55.454371] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-30T19:40:56.254374] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-30T19:40:56.561235] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-30T19:40:56.577811] [INFO ] [REMOTE ] LEVI: Full fetch complete (74446 records). [2025-09-30T19:40:56.577996] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-30T19:40:57.025845] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-30T19:40:57.026052] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-30T19:40:57.027202] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-30T19:40:57.027285] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-30T19:40:57.058938] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-30T19:40:57.060571] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-30T19:40:57.066142] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-30T19:40:57.077070] [DEBUG] [LOCAL ] LEVI: Trimmed 74446 records to 51554 (keeping 200 days of data) [2025-09-30T19:40:57.082227] [INFO ] [REMOTE ] LGI: Full fetch complete (14293 records). [2025-09-30T19:40:57.082355] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-30T19:40:57.610706] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-30T19:40:57.611079] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-30T19:40:57.611906] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-30T19:40:57.611989] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-30T19:40:57.615132] [DEBUG] [LOCAL ] LGI: Trimmed 14293 records to 9828 (keeping 200 days of data) [2025-09-30T19:40:57.802139] [DEBUG] [LOCAL ] LGI: Primary data saved (9828 records). [2025-09-30T19:40:57.803116] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-30T19:40:57.803258] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LGI took 25.6s. Estimated remaining: 2h 23m 19s. Rate: 7.8 symbols/min [2025-09-30T19:40:57.856111] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-30T19:40:58.012194] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:58.118285] [DEBUG] [LOCAL ] LEVI: Primary data saved (51554 records). [2025-09-30T19:40:58.118445] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-30T19:40:58.118535] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LEVI took 41.9s. Estimated remaining: 2h 23m 5s. Rate: 7.8 symbols/min [2025-09-30T19:40:58.246490] [DEBUG] [LOCAL ] LHX: Loaded 48649 existing records from primary storage. [2025-09-30T19:40:58.262819] [INFO ] [MAIN ] LHX: Loaded 48649 existing records. [2025-09-30T19:40:58.353153] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:40:58.394990] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-30T19:40:58.557806] [DEBUG] [LOCAL ] LII: Loaded 27955 existing records from primary storage. [2025-09-30T19:40:58.563773] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:58.564065] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-30T19:40:58.564157] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-30T19:40:58.564405] [INFO ] [MAIN ] LII: Loaded 27955 existing records. [2025-09-30T19:40:58.598912] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-30T19:40:58.633293] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-30T19:40:58.655534] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-30T19:40:58.882756] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:40:58.883314] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-30T19:40:58.893934] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-30T19:40:58.925123] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-30T19:40:58.936444] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-30T19:40:59.430970] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:59.457270] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-30T19:40:59.599564] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:40:59.630660] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T19:40:59.788249] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T19:41:00.254359] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-30T19:41:01.054363] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-30T19:41:01.211273] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-30T19:41:01.499233] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-30T19:41:01.854392] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-30T19:41:02.469942] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-30T19:41:02.654326] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-30T19:41:02.884313] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T19:41:02.888393] [INFO ] [REMOTE ] LFT: Full fetch complete (24105 records). [2025-09-30T19:41:02.888494] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-30T19:41:03.407703] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-30T19:41:03.407822] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-30T19:41:03.408417] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-30T19:41:03.408485] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-30T19:41:03.409902] [DEBUG] [LOCAL ] LFT: Trimmed 24105 records to 18306 (keeping 200 days of data) [2025-09-30T19:41:03.465883] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-30T19:41:03.549207] [DEBUG] [LOCAL ] LFT: Primary data saved (18306 records). [2025-09-30T19:41:03.549409] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-30T19:41:03.549596] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LFT took 32.7s. Estimated remaining: 2h 22m 56s. Rate: 7.8 symbols/min [2025-09-30T19:41:03.780666] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:41:03.826747] [DEBUG] [LOCAL ] LION: Loaded 43772 existing records from primary storage. [2025-09-30T19:41:03.827073] [INFO ] [MAIN ] LION: Loaded 43772 existing records. [2025-09-30T19:41:04.036119] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:41:04.036378] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-30T19:41:04.036449] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-30T19:41:04.043490] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-30T19:41:04.052811] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-30T19:41:04.061742] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:41:04.168868] [INFO ] [REMOTE ] LH: Full fetch complete (54860 records). [2025-09-30T19:41:04.182296] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-30T19:41:04.257306] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-30T19:41:04.806121] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:41:04.906931] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-30T19:41:04.907024] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-30T19:41:04.907868] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-30T19:41:04.907968] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-30T19:41:04.909260] [DEBUG] [LOCAL ] LH: Trimmed 54860 records to 37822 (keeping 200 days of data) [2025-09-30T19:41:05.093910] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-30T19:41:05.170467] [DEBUG] [LOCAL ] LH: Primary data saved (37822 records). [2025-09-30T19:41:05.170745] [INFO ] [MAIN ] LH: Full history saved. [2025-09-30T19:41:05.170853] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LH took 27.5s. Estimated remaining: 2h 22m 42s. Rate: 7.8 symbols/min [2025-09-30T19:41:05.388066] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:41:05.388725] [DEBUG] [LOCAL ] LITB: No existing data file found in primary storage. [2025-09-30T19:41:05.388803] [WARN ] [MAIN ] LITB: No existing data found, performing full refresh instead. [2025-09-30T19:41:05.389121] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-30T19:41:05.389345] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-30T19:41:05.389682] [DEBUG] [LOCAL ] LITB: No primary data file found to delete. [2025-09-30T19:41:05.389790] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-30T19:41:05.660449] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-30T19:41:05.861193] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:41:05.857936] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-30T19:41:05.887927] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-30T19:41:05.905766] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-30T19:41:06.654458] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-30T19:41:07.149585] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-30T19:41:07.454415] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-30T19:41:07.537467] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-30T19:41:07.948274] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-30T19:41:08.254362] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-30T19:41:09.054375] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-30T19:41:09.854339] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-30T19:41:09.969009] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-30T19:41:10.370613] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T19:41:10.654365] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-30T19:41:10.679924] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T19:41:11.133136] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-30T19:41:11.454397] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-30T19:41:12.254437] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-30T19:41:12.911693] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T19:41:13.054360] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-30T19:41:13.088215] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-30T19:41:13.854469] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-30T19:41:14.654478] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-30T19:41:14.876601] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T19:41:15.219814] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-30T19:41:15.362468] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-30T19:41:15.454388] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-30T19:41:16.254406] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-30T19:41:17.052218] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T19:41:17.066608] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-30T19:41:17.701856] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-30T19:41:17.743969] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T19:41:17.854353] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-30T19:41:18.654360] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-30T19:41:19.128326] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-30T19:41:19.146877] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T19:41:19.454408] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-30T19:41:19.740954] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-30T19:41:20.254399] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-30T19:41:21.054382] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-30T19:41:21.849324] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T19:41:21.859680] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-30T19:41:22.168543] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-30T19:41:22.318556] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-30T19:41:22.654351] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-30T19:41:23.454365] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-30T19:41:24.088238] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T19:41:24.254381] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-30T19:41:24.483917] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-30T19:41:25.054343] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-30T19:41:25.408432] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-30T19:41:25.854376] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-30T19:41:26.284813] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-30T19:41:26.654395] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-30T19:41:27.089771] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T19:41:27.100276] [INFO ] [REMOTE ] LHX: Full fetch complete (70797 records). [2025-09-30T19:41:27.100451] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-30T19:41:27.456392] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-30T19:41:27.474750] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-30T19:41:27.494589] [INFO ] [REMOTE ] LITB: Full fetch complete (5625 records). [2025-09-30T19:41:27.519860] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-30T19:41:27.570608] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-30T19:41:27.570771] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-30T19:41:27.571755] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-30T19:41:27.571841] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-30T19:41:27.689609] [DEBUG] [LOCAL ] LHX: Trimmed 70797 records to 48643 (keeping 200 days of data) [2025-09-30T19:41:28.110249] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-30T19:41:28.110577] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-30T19:41:28.110809] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-30T19:41:28.110891] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-30T19:41:28.113281] [DEBUG] [LOCAL ] LITB: Trimmed 5625 records to 4352 (keeping 200 days of data) [2025-09-30T19:41:28.150012] [DEBUG] [LOCAL ] LITB: Primary data saved (4352 records). [2025-09-30T19:41:28.150982] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-30T19:41:28.151338] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LITB took 23.0s. Estimated remaining: 2h 22m 48s. Rate: 7.8 symbols/min [2025-09-30T19:41:28.259917] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-30T19:41:28.374761] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:41:28.607110] [DEBUG] [LOCAL ] LLY: Loaded 53280 existing records from primary storage. [2025-09-30T19:41:28.609298] [INFO ] [MAIN ] LLY: Loaded 53280 existing records. [2025-09-30T19:41:28.835930] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:41:28.837204] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-30T19:41:28.837575] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-30T19:41:28.838725] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-30T19:41:28.839048] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-30T19:41:28.877170] [DEBUG] [LOCAL ] LHX: Primary data saved (48643 records). [2025-09-30T19:41:28.913372] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-30T19:41:28.926865] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LHX took 31.1s. Estimated remaining: 2h 22m 34s. Rate: 7.8 symbols/min [2025-09-30T19:41:29.306430] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:41:29.468174] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:41:29.512144] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-30T19:41:29.516190] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-30T19:41:29.563312] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-30T19:41:29.589185] [DEBUG] [LOCAL ] LMND: Loaded 51875 existing records from primary storage. [2025-09-30T19:41:29.589598] [INFO ] [MAIN ] LMND: Loaded 51875 existing records. [2025-09-30T19:41:29.782290] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:41:29.782531] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-30T19:41:29.782580] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-30T19:41:29.783166] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-30T19:41:29.783245] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-30T19:41:29.859504] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-30T19:41:30.201513] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:41:30.654386] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-30T19:41:31.119569] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-30T19:41:31.454413] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-30T19:41:32.065071] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-30T19:41:32.254403] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-30T19:41:32.410736] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T19:41:33.054364] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-30T19:41:33.129075] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-30T19:41:33.854368] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-30T19:41:34.654369] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-30T19:41:34.707803] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-30T19:41:34.814070] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-30T19:41:35.454368] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-30T19:41:35.627576] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T19:41:35.871725] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T19:41:35.878331] [INFO ] [REMOTE ] LII: Full fetch complete (41301 records). [2025-09-30T19:41:35.878496] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-30T19:41:36.262606] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-30T19:41:36.310623] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-30T19:41:36.310808] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-30T19:41:36.311671] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-30T19:41:36.311743] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-30T19:41:36.312900] [DEBUG] [LOCAL ] LII: Trimmed 41301 records to 27966 (keeping 200 days of data) [2025-09-30T19:41:36.514952] [DEBUG] [LOCAL ] LII: Primary data saved (27966 records). [2025-09-30T19:41:36.515136] [INFO ] [MAIN ] LII: Full history saved. [2025-09-30T19:41:36.515230] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LII took 38.4s. Estimated remaining: 2h 22m 27s. Rate: 7.8 symbols/min [2025-09-30T19:41:36.699770] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:41:36.758478] [DEBUG] [LOCAL ] LMT: Loaded 49839 existing records from primary storage. [2025-09-30T19:41:36.758853] [INFO ] [MAIN ] LMT: Loaded 49839 existing records. [2025-09-30T19:41:36.947874] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:41:36.948136] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-30T19:41:36.948197] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-30T19:41:36.948946] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-30T19:41:36.949011] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-30T19:41:37.059537] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-30T19:41:37.354134] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:41:37.433570] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-30T19:41:37.854373] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-30T19:41:37.987789] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:41:38.654417] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-30T19:41:39.045715] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-30T19:41:39.454383] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-30T19:41:40.254485] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-30T19:41:40.304439] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:41:40.317359] [INFO ] [REMOTE ] LION: Full fetch complete (54787 records). [2025-09-30T19:41:40.317669] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-30T19:41:40.519852] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-30T19:41:40.829950] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-30T19:41:40.830202] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-30T19:41:40.831354] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-30T19:41:40.831463] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-30T19:41:40.833460] [DEBUG] [LOCAL ] LION: Trimmed 54787 records to 44032 (keeping 200 days of data) [2025-09-30T19:41:40.959621] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T19:41:41.077176] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-30T19:41:41.138598] [DEBUG] [LOCAL ] LION: Primary data saved (44032 records). [2025-09-30T19:41:41.138780] [INFO ] [MAIN ] LION: Full history saved. [2025-09-30T19:41:41.139363] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LION took 37.6s. Estimated remaining: 2h 22m 16s. Rate: 7.8 symbols/min [2025-09-30T19:41:41.329780] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:41:41.388381] [DEBUG] [LOCAL ] LNC: Loaded 51612 existing records from primary storage. [2025-09-30T19:41:41.388763] [INFO ] [MAIN ] LNC: Loaded 51612 existing records. [2025-09-30T19:41:41.606109] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:41:41.606388] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-30T19:41:41.606450] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-30T19:41:41.606948] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-30T19:41:41.607009] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-30T19:41:41.863476] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-30T19:41:42.014285] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:41:42.284013] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-30T19:41:42.654371] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-30T19:41:43.270938] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-30T19:41:43.454402] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-30T19:41:43.781539] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-30T19:41:44.254346] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-30T19:41:44.347241] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-30T19:41:45.054385] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-30T19:41:45.854335] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-30T19:41:46.070559] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-30T19:41:46.114692] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-09-30T19:41:46.276110] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-30T19:41:46.654372] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-30T19:41:47.454426] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-30T19:41:47.842627] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-30T19:41:48.254359] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-30T19:41:49.054359] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-30T19:41:49.116168] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-30T19:41:49.546502] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-30T19:41:49.628861] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-30T19:41:49.854363] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-30T19:41:50.654406] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-30T19:41:51.222686] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-30T19:41:51.454450] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-30T19:41:52.254392] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-30T19:41:52.326762] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-30T19:41:52.447460] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-30T19:41:53.054391] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-30T19:41:53.116617] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-30T19:41:53.854336] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-30T19:41:54.264406] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-30T19:41:54.654562] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-30T19:41:54.875236] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-30T19:41:55.454436] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-30T19:41:56.079805] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-30T19:41:56.254402] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-30T19:41:56.778440] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-30T19:41:56.963707] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T19:41:57.054354] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-30T19:41:57.854386] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-30T19:41:58.639988] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-30T19:41:58.654386] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-30T19:41:59.224891] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-30T19:41:59.237671] [INFO ] [REMOTE ] LMND: Full fetch complete (75300 records). [2025-09-30T19:41:59.237846] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-30T19:41:59.467732] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-30T19:41:59.675510] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-30T19:41:59.675668] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-30T19:41:59.676679] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-30T19:41:59.676891] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-30T19:41:59.678602] [DEBUG] [LOCAL ] LMND: Trimmed 75300 records to 51876 (keeping 200 days of data) [2025-09-30T19:41:59.794342] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T19:42:00.035086] [DEBUG] [LOCAL ] LMND: Primary data saved (51876 records). [2025-09-30T19:42:00.035232] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-30T19:42:00.035329] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LMND took 31.1s. Estimated remaining: 2h 22m 18s. Rate: 7.8 symbols/min [2025-09-30T19:42:00.230230] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:00.238761] [DEBUG] [LOCAL ] LND: Loaded 4918 existing records from primary storage. [2025-09-30T19:42:00.239043] [INFO ] [MAIN ] LND: Loaded 4918 existing records. [2025-09-30T19:42:00.261789] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-30T19:42:00.448404] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:00.448760] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-30T19:42:00.448978] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-30T19:42:00.449524] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-30T19:42:00.449599] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-30T19:42:00.857712] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:00.891867] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-30T19:42:01.054356] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-30T19:42:01.854343] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-30T19:42:01.969506] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-30T19:42:01.985965] [INFO ] [REMOTE ] LLY: Full fetch complete (77263 records). [2025-09-30T19:42:01.986184] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-30T19:42:02.433382] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-30T19:42:02.433519] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-30T19:42:02.434841] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-30T19:42:02.435008] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-30T19:42:02.440974] [DEBUG] [LOCAL ] LLY: Trimmed 77263 records to 53281 (keeping 200 days of data) [2025-09-30T19:42:02.596797] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-30T19:42:02.698845] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-30T19:42:02.848310] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-30T19:42:02.877545] [DEBUG] [LOCAL ] LLY: Primary data saved (53281 records). [2025-09-30T19:42:02.877722] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-30T19:42:02.877895] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LLY took 34.7s. Estimated remaining: 2h 22m 6s. Rate: 7.8 symbols/min [2025-09-30T19:42:03.058057] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:03.123053] [DEBUG] [LOCAL ] LNG: Loaded 51428 existing records from primary storage. [2025-09-30T19:42:03.123433] [INFO ] [MAIN ] LNG: Loaded 51428 existing records. [2025-09-30T19:42:03.322463] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:03.322708] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-30T19:42:03.322764] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-30T19:42:03.323605] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-30T19:42:03.323718] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-30T19:42:03.464966] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-30T19:42:03.919832] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-30T19:42:03.926542] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:04.154369] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T19:42:04.254319] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-30T19:42:04.450832] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-30T19:42:05.054371] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-30T19:42:05.854357] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-30T19:42:06.401398] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-30T19:42:06.482334] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-30T19:42:06.654360] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-30T19:42:07.454367] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-30T19:42:07.680512] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T19:42:07.895469] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-30T19:42:08.254350] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-30T19:42:08.851906] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-30T19:42:08.862725] [INFO ] [REMOTE ] LMT: Full fetch complete (72507 records). [2025-09-30T19:42:08.862886] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-30T19:42:09.055505] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-30T19:42:09.285741] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-30T19:42:09.285870] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-30T19:42:09.287013] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-30T19:42:09.287084] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-30T19:42:09.288680] [DEBUG] [LOCAL ] LMT: Trimmed 72507 records to 49835 (keeping 200 days of data) [2025-09-30T19:42:09.617587] [DEBUG] [LOCAL ] LMT: Primary data saved (49835 records). [2025-09-30T19:42:09.617781] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-30T19:42:09.617914] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LMT took 33.1s. Estimated remaining: 2h 21m 58s. Rate: 7.8 symbols/min [2025-09-30T19:42:09.800120] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:09.814219] [DEBUG] [LOCAL ] LNN: Loaded 11213 existing records from primary storage. [2025-09-30T19:42:09.814449] [INFO ] [MAIN ] LNN: Loaded 11213 existing records. [2025-09-30T19:42:09.871748] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-30T19:42:10.008595] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:10.008938] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-30T19:42:10.009096] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-30T19:42:10.009409] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-30T19:42:10.009510] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-30T19:42:10.353449] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-30T19:42:10.407275] [INFO ] [REMOTE ] LNC: Full fetch complete (74159 records). [2025-09-30T19:42:10.424066] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-30T19:42:10.446607] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:10.651478] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T19:42:10.675770] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-30T19:42:10.914565] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-30T19:42:10.914799] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-30T19:42:10.916005] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-30T19:42:10.916104] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-30T19:42:10.918007] [DEBUG] [LOCAL ] LNC: Trimmed 74159 records to 51615 (keeping 200 days of data) [2025-09-30T19:42:11.043847] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-30T19:42:11.288886] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-30T19:42:11.306510] [DEBUG] [LOCAL ] LNC: Primary data saved (51615 records). [2025-09-30T19:42:11.306694] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-30T19:42:11.308916] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNC took 30.2s. Estimated remaining: 2h 21m 45s. Rate: 7.8 symbols/min [2025-09-30T19:42:11.463693] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-30T19:42:11.494702] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:11.544090] [DEBUG] [LOCAL ] LOAR: Loaded 41633 existing records from primary storage. [2025-09-30T19:42:11.544505] [INFO ] [MAIN ] LOAR: Loaded 41633 existing records. [2025-09-30T19:42:11.737257] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:11.737490] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-30T19:42:11.737540] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-30T19:42:11.738015] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-30T19:42:11.738103] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-30T19:42:12.137313] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:12.214599] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-30T19:42:12.254327] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-30T19:42:12.886936] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-30T19:42:13.054366] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-30T19:42:13.854370] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-30T19:42:14.654348] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-30T19:42:14.975302] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-30T19:42:15.352834] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:42:15.454365] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-30T19:42:15.487021] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-30T19:42:16.254388] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-30T19:42:17.054374] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-30T19:42:17.351894] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-30T19:42:17.405129] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T19:42:17.854353] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-30T19:42:17.904146] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-30T19:42:18.500535] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-30T19:42:18.654359] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-30T19:42:19.330981] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-30T19:42:19.454355] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-30T19:42:20.254409] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-30T19:42:21.054363] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-30T19:42:21.383050] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T19:42:21.574521] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T19:42:21.854369] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-30T19:42:22.194607] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-30T19:42:22.654355] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-30T19:42:23.301891] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T19:42:23.454358] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-30T19:42:23.687076] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:42:24.254381] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-30T19:42:24.484326] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T19:42:24.877536] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-30T19:42:25.054374] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-30T19:42:25.854377] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-30T19:42:26.579880] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-30T19:42:26.654448] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-30T19:42:27.454350] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-30T19:42:27.608897] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-30T19:42:27.714128] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-30T19:42:28.057679] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-30T19:42:28.254396] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-30T19:42:29.054341] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-30T19:42:29.854398] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-30T19:42:30.028738] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T19:42:30.638255] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-30T19:42:30.640621] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-30T19:42:30.654306] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-30T19:42:31.454378] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-30T19:42:31.482623] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-30T19:42:31.484546] [INFO ] [REMOTE ] LND: Full fetch complete (8508 records). [2025-09-30T19:42:31.484690] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-30T19:42:31.885557] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-30T19:42:31.885629] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-30T19:42:31.885878] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-30T19:42:31.885927] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-30T19:42:31.886337] [DEBUG] [LOCAL ] LND: Trimmed 8508 records to 4911 (keeping 200 days of data) [2025-09-30T19:42:31.913920] [DEBUG] [LOCAL ] LND: Primary data saved (4911 records). [2025-09-30T19:42:31.914021] [INFO ] [MAIN ] LND: Full history saved. [2025-09-30T19:42:31.914113] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LND took 31.9s. Estimated remaining: 2h 21m 49s. Rate: 7.8 symbols/min [2025-09-30T19:42:32.111198] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:32.107809] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-30T19:42:32.146280] [DEBUG] [LOCAL ] LOB: Loaded 27432 existing records from primary storage. [2025-09-30T19:42:32.146549] [INFO ] [MAIN ] LOB: Loaded 27432 existing records. [2025-09-30T19:42:32.259725] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-30T19:42:32.353572] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:32.353805] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-30T19:42:32.353854] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-30T19:42:32.354213] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-30T19:42:32.354285] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-30T19:42:32.747853] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:33.054391] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-30T19:42:33.337759] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-30T19:42:33.854345] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-30T19:42:34.217006] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-30T19:42:34.654408] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-30T19:42:34.708557] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T19:42:34.711724] [INFO ] [REMOTE ] LNN: Full fetch complete (15629 records). [2025-09-30T19:42:34.711877] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-30T19:42:35.159922] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-30T19:42:35.160024] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-30T19:42:35.160419] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-30T19:42:35.160491] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-30T19:42:35.161146] [DEBUG] [LOCAL ] LNN: Trimmed 15629 records to 11224 (keeping 200 days of data) [2025-09-30T19:42:35.234418] [DEBUG] [LOCAL ] LNN: Primary data saved (11224 records). [2025-09-30T19:42:35.234560] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-30T19:42:35.234684] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNN took 25.6s. Estimated remaining: 2h 21m 37s. Rate: 7.8 symbols/min [2025-09-30T19:42:35.423107] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:35.428628] [DEBUG] [LOCAL ] LOCL: Loaded 3631 existing records from primary storage. [2025-09-30T19:42:35.428837] [INFO ] [MAIN ] LOCL: Loaded 3631 existing records. [2025-09-30T19:42:35.461014] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-30T19:42:35.621168] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:35.621424] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-30T19:42:35.621475] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-30T19:42:35.621717] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-30T19:42:35.621778] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-30T19:42:36.006055] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:36.254409] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-30T19:42:36.472531] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-30T19:42:37.054408] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-30T19:42:37.167261] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-30T19:42:37.222949] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-30T19:42:37.671221] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-30T19:42:37.854382] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-30T19:42:38.654401] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-30T19:42:38.919483] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-30T19:42:39.105727] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-30T19:42:39.454370] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-30T19:42:40.254383] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-30T19:42:40.938803] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-30T19:42:40.981556] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T19:42:41.054389] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-30T19:42:41.510322] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-30T19:42:41.854361] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-30T19:42:42.654389] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-30T19:42:43.163973] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-30T19:42:43.454404] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-30T19:42:44.254353] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-30T19:42:44.358713] [DEBUG] [REMOTE ] LOCL: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-30T19:42:44.359017] [WARN ] [REMOTE ] LOCL: No data returned for month 2025-04 [2025-09-30T19:42:44.359125] [FATAL] [REMOTE ] LOCL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:42:44.359203] [FATAL] [MAIN ] LOCL: Failed to fetch primary data. [2025-09-30T19:42:44.359267] [WARN ] [MAIN ] LOCL: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:42:44.359341] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-30T19:42:44.359406] [DEBUG] [LOCAL ] LOCL: No primary data file found to delete. [2025-09-30T19:42:44.359443] [INFO ] [LOCAL ] LOCL: Starting deletion of derivative data. [2025-09-30T19:42:44.359969] [DEBUG] [LOCAL ] LOCL: Deleted derivative data file. [2025-09-30T19:42:44.360071] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LOCL took 9.1s. Estimated remaining: 2h 21m 31s. Rate: 7.8 symbols/min [2025-09-30T19:42:44.554254] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:44.589267] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-30T19:42:44.636348] [INFO ] [REMOTE ] LNG: Full fetch complete (74683 records). [2025-09-30T19:42:44.636987] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-30T19:42:44.656155] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-30T19:42:44.765238] [DEBUG] [LOCAL ] LOMA: Loaded 32012 existing records from primary storage. [2025-09-30T19:42:44.791567] [INFO ] [MAIN ] LOMA: Loaded 32012 existing records. [2025-09-30T19:42:45.059543] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-30T19:42:45.154110] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:45.203846] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-30T19:42:45.215733] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-30T19:42:45.221564] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-30T19:42:45.231946] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-30T19:42:45.437942] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-30T19:42:45.438127] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-30T19:42:45.439577] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-30T19:42:45.445133] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-30T19:42:45.517927] [DEBUG] [LOCAL ] LNG: Trimmed 74683 records to 51406 (keeping 200 days of data) [2025-09-30T19:42:45.855339] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-30T19:42:45.855268] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:46.093681] [DEBUG] [LOCAL ] LNG: Primary data saved (51406 records). [2025-09-30T19:42:46.093856] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-30T19:42:46.093955] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LNG took 43.2s. Estimated remaining: 2h 21m 18s. Rate: 7.8 symbols/min [2025-09-30T19:42:46.282438] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:46.338184] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-30T19:42:46.362929] [DEBUG] [LOCAL ] LOW: Loaded 52947 existing records from primary storage. [2025-09-30T19:42:46.363394] [INFO ] [MAIN ] LOW: Loaded 52947 existing records. [2025-09-30T19:42:46.558998] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:46.559309] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-30T19:42:46.559384] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-30T19:42:46.560089] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-30T19:42:46.560156] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-30T19:42:46.664313] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-30T19:42:46.943718] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:47.454367] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-30T19:42:47.454276] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T19:42:47.465574] [INFO ] [REMOTE ] LOAR: Full fetch complete (56398 records). [2025-09-30T19:42:47.465813] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-30T19:42:47.697242] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-30T19:42:47.948702] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-30T19:42:47.949017] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-30T19:42:47.949991] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-30T19:42:47.950062] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-30T19:42:47.951449] [DEBUG] [LOCAL ] LOAR: Trimmed 56398 records to 41572 (keeping 200 days of data) [2025-09-30T19:42:48.224770] [DEBUG] [LOCAL ] LOAR: Primary data saved (41572 records). [2025-09-30T19:42:48.224930] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-30T19:42:48.225911] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOAR took 36.9s. Estimated remaining: 2h 21m 5s. Rate: 7.8 symbols/min [2025-09-30T19:42:48.260592] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-30T19:42:48.422509] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:42:48.473606] [DEBUG] [LOCAL ] LPG: Loaded 39930 existing records from primary storage. [2025-09-30T19:42:48.473961] [INFO ] [MAIN ] LPG: Loaded 39930 existing records. [2025-09-30T19:42:48.679227] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:42:48.679515] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-30T19:42:48.679567] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-30T19:42:48.679826] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-30T19:42:48.679885] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-30T19:42:49.078767] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-30T19:42:49.085119] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:42:49.428153] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-30T19:42:49.495430] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-30T19:42:49.854365] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-30T19:42:50.275275] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T19:42:50.654391] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-30T19:42:51.303270] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-30T19:42:51.454400] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-30T19:42:52.035406] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-30T19:42:52.254353] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-30T19:42:52.895926] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-30T19:42:53.054367] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-30T19:42:53.513946] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-30T19:42:53.854344] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-30T19:42:54.654345] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-30T19:42:54.859327] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-30T19:42:55.454348] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-30T19:42:55.510771] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-30T19:42:55.511920] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-30T19:42:56.254400] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-30T19:42:56.756337] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T19:42:57.054370] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-30T19:42:57.770883] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-30T19:42:57.854356] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-30T19:42:58.654366] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-30T19:42:59.022338] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-30T19:42:59.332450] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-30T19:42:59.454359] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-30T19:42:59.584524] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-30T19:42:59.591034] [INFO ] [REMOTE ] LOB: Full fetch complete (37813 records). [2025-09-30T19:42:59.591282] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-30T19:43:00.028903] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-30T19:43:00.028992] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-30T19:43:00.029762] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-30T19:43:00.029828] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-30T19:43:00.030898] [DEBUG] [LOCAL ] LOB: Trimmed 37813 records to 27471 (keeping 200 days of data) [2025-09-30T19:43:00.225780] [DEBUG] [LOCAL ] LOB: Primary data saved (27471 records). [2025-09-30T19:43:00.225931] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-30T19:43:00.226045] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOB took 28.3s. Estimated remaining: 2h 21m 1s. Rate: 7.8 symbols/min [2025-09-30T19:43:00.259603] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-30T19:43:00.428365] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:43:00.457479] [DEBUG] [LOCAL ] LPL: Loaded 26121 existing records from primary storage. [2025-09-30T19:43:00.457798] [INFO ] [MAIN ] LPL: Loaded 26121 existing records. [2025-09-30T19:43:00.651632] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:43:00.651862] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-30T19:43:00.651910] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-30T19:43:00.652373] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-30T19:43:00.652431] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-30T19:43:01.050591] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:43:01.054309] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-30T19:43:01.506954] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-30T19:43:01.836900] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-30T19:43:01.854313] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-30T19:43:02.252182] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T19:43:02.654381] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-30T19:43:03.214614] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-30T19:43:03.454381] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-30T19:43:03.960587] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T19:43:04.254362] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-30T19:43:04.880952] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-30T19:43:05.054357] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-30T19:43:05.556088] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-30T19:43:05.854358] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-30T19:43:06.654327] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-30T19:43:07.020194] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-30T19:43:07.048692] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-30T19:43:07.454361] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-30T19:43:07.670047] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-30T19:43:08.254429] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-30T19:43:09.055104] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-30T19:43:09.058472] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-30T19:43:09.720132] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T19:43:09.790785] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-30T19:43:09.854357] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-30T19:43:10.654367] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-30T19:43:10.878923] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T19:43:11.454374] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-30T19:43:12.254343] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-30T19:43:12.397552] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-30T19:43:12.477925] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-30T19:43:13.054359] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-30T19:43:13.585051] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T19:43:13.854370] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-30T19:43:14.654344] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-30T19:43:14.815450] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T19:43:15.004430] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-30T19:43:15.454381] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-30T19:43:16.182123] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T19:43:16.254390] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-30T19:43:17.054625] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-30T19:43:17.354511] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-30T19:43:17.721714] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T19:43:17.729811] [INFO ] [REMOTE ] LPG: Full fetch complete (59652 records). [2025-09-30T19:43:17.729962] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-30T19:43:17.859513] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-30T19:43:18.147635] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-30T19:43:18.147771] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-30T19:43:18.148984] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-30T19:43:18.149060] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-30T19:43:18.150560] [DEBUG] [LOCAL ] LPG: Trimmed 59652 records to 39874 (keeping 200 days of data) [2025-09-30T19:43:18.441978] [DEBUG] [LOCAL ] LPG: Primary data saved (39874 records). [2025-09-30T19:43:18.442187] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-30T19:43:18.443533] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LPG took 30.2s. Estimated remaining: 2h 21m 3s. Rate: 7.8 symbols/min [2025-09-30T19:43:18.655459] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:43:18.655906] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-30T19:43:18.700968] [DEBUG] [LOCAL ] LPX: Loaded 39661 existing records from primary storage. [2025-09-30T19:43:18.701292] [INFO ] [MAIN ] LPX: Loaded 39661 existing records. [2025-09-30T19:43:18.938002] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:43:18.938798] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-30T19:43:18.950715] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-30T19:43:18.953506] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-30T19:43:18.954698] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T19:43:18.964080] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-30T19:43:18.969350] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-30T19:43:19.026955] [INFO ] [REMOTE ] LOMA: Full fetch complete (48081 records). [2025-09-30T19:43:19.045778] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-30T19:43:19.466250] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-30T19:43:19.956963] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:43:20.084346] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-30T19:43:20.084481] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-30T19:43:20.086047] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-30T19:43:20.086141] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-30T19:43:20.088268] [DEBUG] [LOCAL ] LOMA: Trimmed 48081 records to 32080 (keeping 200 days of data) [2025-09-30T19:43:20.256139] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-30T19:43:20.366322] [DEBUG] [LOCAL ] LOMA: Primary data saved (32080 records). [2025-09-30T19:43:20.366603] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-30T19:43:20.366767] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LOMA took 36.0s. Estimated remaining: 2h 20m 50s. Rate: 7.8 symbols/min [2025-09-30T19:43:20.582351] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:43:20.636306] [DEBUG] [LOCAL ] LRN: Loaded 39826 existing records from primary storage. [2025-09-30T19:43:20.636680] [INFO ] [MAIN ] LRN: Loaded 39826 existing records. [2025-09-30T19:43:20.812399] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-30T19:43:20.911962] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:43:20.923006] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-30T19:43:20.917566] [INFO ] [REMOTE ] LOW: Full fetch complete (76509 records). [2025-09-30T19:43:20.931250] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-30T19:43:20.931061] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-30T19:43:20.933706] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-30T19:43:20.946524] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-30T19:43:20.993247] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-30T19:43:21.062818] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-30T19:43:21.854930] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-30T19:43:21.862195] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:43:21.862634] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-30T19:43:21.863123] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-30T19:43:21.864357] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-30T19:43:21.865462] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-30T19:43:21.868510] [DEBUG] [LOCAL ] LOW: Trimmed 76509 records to 52947 (keeping 200 days of data) [2025-09-30T19:43:22.013938] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-30T19:43:22.262242] [DEBUG] [LOCAL ] LOW: Primary data saved (52947 records). [2025-09-30T19:43:22.262377] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-30T19:43:22.262466] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LOW took 36.2s. Estimated remaining: 2h 20m 37s. Rate: 7.8 symbols/min [2025-09-30T19:43:22.444817] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:43:22.488212] [DEBUG] [LOCAL ] LSPD: Loaded 42949 existing records from primary storage. [2025-09-30T19:43:22.488545] [INFO ] [MAIN ] LSPD: Loaded 42949 existing records. [2025-09-30T19:43:22.684284] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-30T19:43:22.684175] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:43:22.685346] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-30T19:43:22.685478] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-30T19:43:22.685769] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-30T19:43:22.685894] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-30T19:43:22.841049] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T19:43:23.122794] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:43:23.454334] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-30T19:43:23.544303] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-30T19:43:23.926595] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-30T19:43:24.254397] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-30T19:43:25.051727] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T19:43:25.059999] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-30T19:43:25.062078] [INFO ] [REMOTE ] LPL: Full fetch complete (35228 records). [2025-09-30T19:43:25.062164] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-30T19:43:25.471867] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-30T19:43:25.471959] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-30T19:43:25.472605] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-30T19:43:25.472676] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-30T19:43:25.473740] [DEBUG] [LOCAL ] LPL: Trimmed 35228 records to 26306 (keeping 200 days of data) [2025-09-30T19:43:25.643195] [DEBUG] [LOCAL ] LPL: Primary data saved (26306 records). [2025-09-30T19:43:25.643368] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-30T19:43:25.643466] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LPL took 25.4s. Estimated remaining: 2h 20m 26s. Rate: 7.8 symbols/min [2025-09-30T19:43:25.846562] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:43:25.857627] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-30T19:43:25.861886] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:43:25.903751] [DEBUG] [LOCAL ] LTC: Loaded 29954 existing records from primary storage. [2025-09-30T19:43:25.904385] [INFO ] [MAIN ] LTC: Loaded 29954 existing records. [2025-09-30T19:43:26.094617] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:43:26.095415] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-30T19:43:26.095466] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-30T19:43:26.095806] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-30T19:43:26.095865] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-30T19:43:26.486149] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:43:26.586911] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-30T19:43:26.654357] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-30T19:43:27.201828] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-30T19:43:27.454333] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-30T19:43:27.576426] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-30T19:43:28.254409] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-30T19:43:29.054403] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-30T19:43:29.057502] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-30T19:43:29.530273] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-30T19:43:29.854368] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-30T19:43:30.587847] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:43:30.654370] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-30T19:43:31.448001] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-30T19:43:31.456406] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-30T19:43:31.845595] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-30T19:43:32.254360] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-30T19:43:32.815524] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-30T19:43:33.054395] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-30T19:43:33.853859] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-30T19:43:33.862390] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-30T19:43:34.265927] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T19:43:34.654348] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-30T19:43:35.455990] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-30T19:43:35.461164] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-30T19:43:35.753116] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-30T19:43:36.254353] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-30T19:43:36.592756] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-30T19:43:37.054378] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-30T19:43:37.350085] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T19:43:37.854375] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-30T19:43:38.499237] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:43:38.654433] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-30T19:43:39.069125] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-30T19:43:39.454369] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-30T19:43:40.260505] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-30T19:43:40.298397] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:43:41.030494] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-30T19:43:41.054316] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-30T19:43:41.168552] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T19:43:41.854373] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-30T19:43:42.609554] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T19:43:42.618610] [INFO ] [REMOTE ] LPX: Full fetch complete (58778 records). [2025-09-30T19:43:42.618860] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-30T19:43:42.659443] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-30T19:43:43.089905] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-30T19:43:43.090121] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-30T19:43:43.091250] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-30T19:43:43.091374] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-30T19:43:43.092894] [DEBUG] [LOCAL ] LPX: Trimmed 58778 records to 39672 (keeping 200 days of data) [2025-09-30T19:43:43.217495] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-30T19:43:43.394981] [DEBUG] [LOCAL ] LPX: Primary data saved (39672 records). [2025-09-30T19:43:43.395138] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-30T19:43:43.395967] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LPX took 25.0s. Estimated remaining: 2h 20m 27s. Rate: 7.8 symbols/min [2025-09-30T19:43:43.460895] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-30T19:43:43.576630] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:43:43.640215] [DEBUG] [LOCAL ] LTH: Loaded 51770 existing records from primary storage. [2025-09-30T19:43:43.640674] [INFO ] [MAIN ] LTH: Loaded 51770 existing records. [2025-09-30T19:43:43.832513] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:43:43.832769] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-30T19:43:43.832823] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-30T19:43:43.833183] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-30T19:43:43.833243] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-30T19:43:44.222402] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:43:44.249172] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:43:44.258747] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-30T19:43:44.892219] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-30T19:43:45.054358] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-30T19:43:45.743540] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T19:43:45.854378] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-30T19:43:46.236254] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-30T19:43:46.654355] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-30T19:43:47.344908] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-30T19:43:47.454359] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-30T19:43:48.098070] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:43:48.254353] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-30T19:43:48.650723] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T19:43:49.054367] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-30T19:43:49.700049] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-30T19:43:49.854341] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-30T19:43:50.659437] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-30T19:43:50.674950] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T19:43:51.028421] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-30T19:43:51.454358] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-30T19:43:52.147196] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T19:43:52.254368] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-30T19:43:52.800366] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-30T19:43:53.054368] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-30T19:43:53.764683] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-30T19:43:53.854347] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-30T19:43:54.250278] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-30T19:43:54.259372] [INFO ] [REMOTE ] LSPD: Full fetch complete (61599 records). [2025-09-30T19:43:54.259520] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-30T19:43:54.659684] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-30T19:43:54.680597] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-30T19:43:54.680709] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-30T19:43:54.681776] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-30T19:43:54.681841] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-30T19:43:54.683176] [DEBUG] [LOCAL ] LSPD: Trimmed 61599 records to 42882 (keeping 200 days of data) [2025-09-30T19:43:54.957280] [DEBUG] [LOCAL ] LSPD: Primary data saved (42882 records). [2025-09-30T19:43:54.957425] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-30T19:43:54.957516] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LSPD took 32.7s. Estimated remaining: 2h 20m 22s. Rate: 7.8 symbols/min [2025-09-30T19:43:55.065247] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-30T19:43:55.454390] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-30T19:43:56.254403] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-30T19:43:56.355254] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-30T19:43:56.364421] [INFO ] [REMOTE ] LRN: Full fetch complete (58442 records). [2025-09-30T19:43:56.364568] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-30T19:43:56.787443] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-30T19:43:56.787614] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-30T19:43:56.788547] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-30T19:43:56.788669] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-30T19:43:56.790184] [DEBUG] [LOCAL ] LRN: Trimmed 58442 records to 39818 (keeping 200 days of data) [2025-09-30T19:43:56.903324] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T19:43:56.913877] [INFO ] [REMOTE ] LTC: Full fetch complete (43384 records). [2025-09-30T19:43:56.919699] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-30T19:43:57.471086] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-30T19:43:57.471491] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-30T19:43:57.474165] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-30T19:43:57.474519] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-30T19:43:57.478977] [DEBUG] [LOCAL ] LTC: Trimmed 43384 records to 30125 (keeping 200 days of data) [2025-09-30T19:43:57.609017] [DEBUG] [LOCAL ] LRN: Primary data saved (39818 records). [2025-09-30T19:43:57.609240] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-30T19:43:57.609637] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LRN took 37.2s. Estimated remaining: 2h 20m 10s. Rate: 7.8 symbols/min [2025-09-30T19:43:57.702634] [DEBUG] [LOCAL ] LTC: Primary data saved (30125 records). [2025-09-30T19:43:57.702876] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-30T19:43:57.703113] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LTC took 32.1s. Estimated remaining: 2h 19m 56s. Rate: 7.8 symbols/min [2025-09-30T19:43:57.740123] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-30T19:43:57.752090] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-30T19:43:59.473530] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-30T19:43:59.485451] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-30T19:44:01.315575] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:44:01.326900] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-30T19:44:02.905966] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:44:02.917862] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-30T19:44:04.475753] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-30T19:44:04.487396] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-30T19:44:05.807548] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-30T19:44:05.819714] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-30T19:44:07.621139] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-30T19:44:07.632907] [INFO ] [REMOTE ] LTH: Full fetch complete (74124 records). [2025-09-30T19:44:07.633090] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-30T19:44:08.109266] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-30T19:44:08.109444] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-30T19:44:08.110447] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-30T19:44:08.110567] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-30T19:44:08.112218] [DEBUG] [LOCAL ] LTH: Trimmed 74124 records to 51759 (keeping 200 days of data) [2025-09-30T19:44:08.466936] [DEBUG] [LOCAL ] LTH: Primary data saved (51759 records). [2025-09-30T19:44:08.467134] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-30T19:44:08.474501] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTH took 25.1s. Estimated remaining: 2h 19m 51s. Rate: 7.8 symbols/min [2025-09-30T19:44:09.214272] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:09.231223] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:09.265972] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:09.278291] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:09.279177] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-30T19:44:09.279249] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-30T19:44:09.279358] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-30T19:44:09.279398] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-30T19:44:09.279440] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-30T19:44:09.279473] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-30T19:44:09.584851] [DEBUG] [LOCAL ] LTM: Loaded 36751 existing records from primary storage. [2025-09-30T19:44:09.647267] [INFO ] [MAIN ] LTM: Loaded 36751 existing records. [2025-09-30T19:44:09.653724] [DEBUG] [LOCAL ] LU: Loaded 48923 existing records from primary storage. [2025-09-30T19:44:09.700737] [INFO ] [MAIN ] LU: Loaded 48923 existing records. [2025-09-30T19:44:09.723575] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-30T19:44:09.777308] [INFO ] [MAIN ] LUMN: Loaded 53634 existing records. [2025-09-30T19:44:10.225711] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:10.328770] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:10.258461] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-30T19:44:10.344543] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-30T19:44:10.374474] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-30T19:44:10.432550] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:10.461329] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-30T19:44:10.473296] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-30T19:44:10.477695] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:10.469523] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-30T19:44:10.478178] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-30T19:44:10.478384] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-30T19:44:10.478275] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-30T19:44:10.478630] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-30T19:44:10.483948] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-30T19:44:10.484088] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-30T19:44:10.502192] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-30T19:44:11.688495] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:11.734094] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-30T19:44:11.839378] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:11.844246] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:11.844691] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-30T19:44:11.845265] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-30T19:44:11.862170] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-30T19:44:11.867802] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-30T19:44:12.877635] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-30T19:44:12.885507] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-30T19:44:13.365401] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-30T19:44:13.383281] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-30T19:44:13.549377] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T19:44:13.565979] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-30T19:44:13.653538] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-30T19:44:13.672219] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-30T19:44:13.758012] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-30T19:44:13.764569] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-30T19:44:14.334486] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-30T19:44:14.342387] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-30T19:44:14.916719] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-30T19:44:14.922778] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-30T19:44:15.182626] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-30T19:44:15.193463] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-30T19:44:15.474895] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-30T19:44:15.486604] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-30T19:44:15.640102] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-30T19:44:15.646684] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-30T19:44:15.788888] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-30T19:44:15.795475] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-30T19:44:16.559285] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-30T19:44:16.569250] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-30T19:44:16.694822] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-30T19:44:16.704979] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-30T19:44:17.087739] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-30T19:44:17.095751] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-30T19:44:17.376974] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-30T19:44:17.388687] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-30T19:44:17.944452] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-30T19:44:17.950721] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-30T19:44:18.023011] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-30T19:44:18.263209] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:44:18.654361] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-30T19:44:18.765574] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-30T19:44:19.228425] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-30T19:44:19.454402] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-30T19:44:20.002148] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-30T19:44:20.254355] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-30T19:44:20.940363] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-30T19:44:21.054344] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-30T19:44:21.854472] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-30T19:44:21.957064] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T19:44:22.660497] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-30T19:44:22.698884] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:44:22.990922] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T19:44:23.454372] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-30T19:44:24.142251] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-30T19:44:24.162897] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T19:44:24.254383] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-30T19:44:25.054371] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-30T19:44:25.854373] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-30T19:44:25.962307] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-30T19:44:25.968897] [INFO ] [REMOTE ] LUCK: Full fetch complete (41087 records). [2025-09-30T19:44:25.969146] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-30T19:44:26.133279] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-30T19:44:26.250189] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T19:44:26.250995] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:44:26.251100] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:44:26.251233] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-30T19:44:26.251340] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-30T19:44:26.251410] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-30T19:44:26.251494] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-30T19:44:26.251728] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LUCK took 17.8s. Estimated remaining: 2h 19m 52s. Rate: 7.8 symbols/min [2025-09-30T19:44:26.455170] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:26.522730] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-30T19:44:26.523283] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-09-30T19:44:26.661862] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-30T19:44:26.743209] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:26.743551] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-30T19:44:26.743604] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-30T19:44:26.744199] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-30T19:44:26.744279] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-30T19:44:27.147990] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:27.192548] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-30T19:44:27.454405] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-30T19:44:28.254397] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-30T19:44:28.652446] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-30T19:44:29.048686] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-30T19:44:29.058721] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-30T19:44:29.768695] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T19:44:29.779480] [INFO ] [REMOTE ] LTM: Full fetch complete (47621 records). [2025-09-30T19:44:29.779682] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-30T19:44:29.859486] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-30T19:44:30.181938] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-30T19:44:30.182032] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-30T19:44:30.182825] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-30T19:44:30.182888] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-30T19:44:30.184043] [DEBUG] [LOCAL ] LTM: Trimmed 47621 records to 36826 (keeping 200 days of data) [2025-09-30T19:44:30.430000] [DEBUG] [LOCAL ] LTM: Primary data saved (36826 records). [2025-09-30T19:44:30.430213] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-30T19:44:30.430352] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LTM took 22.0s. Estimated remaining: 2h 19m 41s. Rate: 7.8 symbols/min [2025-09-30T19:44:30.660290] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-30T19:44:30.663954] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:30.665332] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-30T19:44:30.665468] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-30T19:44:30.665701] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-30T19:44:30.665775] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-30T19:44:30.666129] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-30T19:44:30.666201] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-30T19:44:30.886768] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-30T19:44:31.115097] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:31.452126] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-30T19:44:31.462480] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-30T19:44:31.978400] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-30T19:44:32.254418] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-30T19:44:32.486388] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-30T19:44:32.486838] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-30T19:44:32.486956] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:44:32.487043] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-09-30T19:44:32.487129] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:44:32.487224] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-30T19:44:32.487314] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-30T19:44:32.487407] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-30T19:44:32.487482] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-30T19:44:32.487549] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LUXE took 2.1s. Estimated remaining: 2h 19m 29s. Rate: 7.8 symbols/min [2025-09-30T19:44:32.685192] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:32.747125] [DEBUG] [LOCAL ] LVS: Loaded 53564 existing records from primary storage. [2025-09-30T19:44:32.747673] [INFO ] [MAIN ] LVS: Loaded 53564 existing records. [2025-09-30T19:44:32.955458] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:32.955752] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-30T19:44:32.955817] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-30T19:44:32.956185] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-30T19:44:32.956245] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-30T19:44:33.057270] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-30T19:44:33.363565] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:33.395155] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-30T19:44:33.854403] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-30T19:44:34.621501] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T19:44:34.654381] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-30T19:44:35.454374] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-30T19:44:35.980515] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-30T19:44:35.992946] [INFO ] [REMOTE ] LUMN: Full fetch complete (77635 records). [2025-09-30T19:44:35.993216] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-30T19:44:36.260338] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-30T19:44:36.446479] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-30T19:44:36.446637] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-30T19:44:36.447924] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-30T19:44:36.448012] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-30T19:44:36.465582] [DEBUG] [LOCAL ] LUMN: Trimmed 77635 records to 53634 (keeping 200 days of data) [2025-09-30T19:44:36.482373] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-30T19:44:36.834019] [DEBUG] [LOCAL ] LUMN: Primary data saved (53634 records). [2025-09-30T19:44:36.834185] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-30T19:44:36.834936] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUMN took 28.4s. Estimated remaining: 2h 19m 18s. Rate: 7.8 symbols/min [2025-09-30T19:44:37.042071] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:37.054423] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-30T19:44:37.068108] [DEBUG] [LOCAL ] LVWR: Loaded 17628 existing records from primary storage. [2025-09-30T19:44:37.068523] [INFO ] [MAIN ] LVWR: Loaded 17628 existing records. [2025-09-30T19:44:37.290075] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:37.290326] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-30T19:44:37.290398] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-30T19:44:37.290715] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-30T19:44:37.290844] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-30T19:44:37.741474] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:37.745434] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-30T19:44:37.796552] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-30T19:44:37.807968] [INFO ] [REMOTE ] LU: Full fetch complete (70404 records). [2025-09-30T19:44:37.808199] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-30T19:44:37.859524] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-30T19:44:38.265043] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-30T19:44:38.265136] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-30T19:44:38.266370] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-30T19:44:38.266467] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-30T19:44:38.268048] [DEBUG] [LOCAL ] LU: Trimmed 70404 records to 48947 (keeping 200 days of data) [2025-09-30T19:44:38.570785] [DEBUG] [LOCAL ] LU: Primary data saved (48947 records). [2025-09-30T19:44:38.571034] [INFO ] [MAIN ] LU: Full history saved. [2025-09-30T19:44:38.571160] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LU took 30.1s. Estimated remaining: 2h 19m 6s. Rate: 7.8 symbols/min [2025-09-30T19:44:38.664923] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-30T19:44:38.814766] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:44:38.884044] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-30T19:44:38.912744] [DEBUG] [LOCAL ] LW: Loaded 51154 existing records from primary storage. [2025-09-30T19:44:38.913507] [INFO ] [MAIN ] LW: Loaded 51154 existing records. [2025-09-30T19:44:39.108722] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:44:39.108972] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-30T19:44:39.109022] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-30T19:44:39.109353] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-30T19:44:39.109413] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-30T19:44:39.360249] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T19:44:39.467340] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-30T19:44:39.512878] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:44:39.711766] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-30T19:44:40.092215] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-30T19:44:40.254387] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-30T19:44:41.054360] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-30T19:44:41.448817] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-30T19:44:41.854342] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-30T19:44:42.288590] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-30T19:44:42.654371] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-30T19:44:43.207745] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-30T19:44:43.454340] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-30T19:44:43.643109] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T19:44:44.254386] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-30T19:44:44.816917] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-30T19:44:45.054375] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-30T19:44:45.854417] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-30T19:44:46.340668] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-30T19:44:46.654383] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-30T19:44:46.883225] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T19:44:47.229584] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-30T19:44:47.454368] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-30T19:44:48.254360] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-30T19:44:48.320933] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-30T19:44:48.958553] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-30T19:44:49.054359] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-30T19:44:49.812039] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-30T19:44:49.854411] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-30T19:44:50.479762] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-30T19:44:50.654372] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-30T19:44:51.316469] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-30T19:44:51.424622] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-30T19:44:51.454326] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-30T19:44:52.254342] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-30T19:44:52.531524] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-30T19:44:53.054358] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-30T19:44:53.854343] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-30T19:44:54.192404] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T19:44:54.654382] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-30T19:44:55.238542] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-30T19:44:55.312832] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-30T19:44:55.454347] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-30T19:44:55.881863] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-30T19:44:56.254406] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-30T19:44:57.054375] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-30T19:44:57.100892] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-30T19:44:57.361289] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-30T19:44:57.854369] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-30T19:44:58.654356] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-30T19:44:58.782039] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:44:59.435180] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:44:59.458370] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-30T19:44:59.461542] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-30T19:45:00.254352] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-30T19:45:01.054404] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-30T19:45:01.675067] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-30T19:45:01.690148] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-09-30T19:45:01.690363] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-30T19:45:01.864207] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-30T19:45:02.151623] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-30T19:45:02.157232] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-30T19:45:02.164329] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-30T19:45:02.165474] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-30T19:45:02.166278] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-30T19:45:02.175419] [INFO ] [REMOTE ] LVWR: Full fetch complete (19918 records). [2025-09-30T19:45:02.175637] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-30T19:45:02.213726] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 53689 (keeping 200 days of data) [2025-09-30T19:45:02.680033] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-30T19:45:02.737370] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-30T19:45:02.844261] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-30T19:45:02.844705] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-30T19:45:02.845677] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-30T19:45:02.846039] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-30T19:45:02.849939] [DEBUG] [LOCAL ] LVWR: Trimmed 19918 records to 17657 (keeping 200 days of data) [2025-09-30T19:45:03.090396] [DEBUG] [LOCAL ] LVWR: Primary data saved (17657 records). [2025-09-30T19:45:03.091054] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-30T19:45:03.091390] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LVWR took 26.3s. Estimated remaining: 2h 19m 12s. Rate: 7.8 symbols/min [2025-09-30T19:45:03.361466] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:03.389792] [DEBUG] [LOCAL ] LXFR: Loaded 16896 existing records from primary storage. [2025-09-30T19:45:03.391258] [INFO ] [MAIN ] LXFR: Loaded 16896 existing records. [2025-09-30T19:45:03.515306] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-09-30T19:45:03.515547] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-30T19:45:03.521450] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LUV took 37.3s. Estimated remaining: 2h 18m 58s. Rate: 7.8 symbols/min [2025-09-30T19:45:03.655609] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:03.695566] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-30T19:45:03.700884] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-30T19:45:03.716896] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-30T19:45:03.721353] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-30T19:45:03.885096] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:04.043142] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-30T19:45:04.131810] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-30T19:45:04.221418] [DEBUG] [LOCAL ] LXP: Loaded 50667 existing records from primary storage. [2025-09-30T19:45:04.254225] [INFO ] [MAIN ] LXP: Loaded 50667 existing records. [2025-09-30T19:45:04.322519] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:04.365404] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-30T19:45:04.539694] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:04.539995] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-30T19:45:04.555571] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-30T19:45:04.570196] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-30T19:45:04.571428] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-30T19:45:04.571553] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-30T19:45:04.990015] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:05.054428] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-30T19:45:05.512276] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T19:45:05.854356] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-30T19:45:06.111981] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-30T19:45:06.654386] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-30T19:45:07.110973] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-30T19:45:07.123208] [INFO ] [REMOTE ] LVS: Full fetch complete (77514 records). [2025-09-30T19:45:07.123411] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-30T19:45:07.457864] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-30T19:45:07.641834] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-30T19:45:07.641997] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-30T19:45:07.643297] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-30T19:45:07.643402] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-30T19:45:07.646897] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-30T19:45:07.663839] [DEBUG] [LOCAL ] LVS: Trimmed 77514 records to 53564 (keeping 200 days of data) [2025-09-30T19:45:08.113529] [DEBUG] [LOCAL ] LVS: Primary data saved (53564 records). [2025-09-30T19:45:08.113746] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-30T19:45:08.113875] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LVS took 35.6s. Estimated remaining: 2h 18m 48s. Rate: 7.8 symbols/min [2025-09-30T19:45:08.254815] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-30T19:45:08.329282] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:08.374605] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T19:45:08.426564] [DEBUG] [LOCAL ] LXU: Loaded 31780 existing records from primary storage. [2025-09-30T19:45:08.427009] [INFO ] [MAIN ] LXU: Loaded 31780 existing records. [2025-09-30T19:45:08.686404] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T19:45:08.692372] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:08.697857] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-30T19:45:08.697945] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-30T19:45:08.698253] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-30T19:45:08.698315] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-30T19:45:09.070824] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-30T19:45:09.123702] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:09.854337] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-30T19:45:09.990396] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-30T19:45:10.074335] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T19:45:10.654365] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-30T19:45:11.454377] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-30T19:45:11.840002] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-30T19:45:11.851751] [INFO ] [REMOTE ] LW: Full fetch complete (74652 records). [2025-09-30T19:45:11.851929] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-30T19:45:12.289351] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-30T19:45:12.337553] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-30T19:45:12.357424] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-30T19:45:12.363040] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-30T19:45:12.391070] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-30T19:45:12.394541] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-30T19:45:12.397954] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-30T19:45:12.410320] [DEBUG] [LOCAL ] LW: Trimmed 74652 records to 51157 (keeping 200 days of data) [2025-09-30T19:45:12.792168] [DEBUG] [LOCAL ] LW: Primary data saved (51157 records). [2025-09-30T19:45:12.792324] [INFO ] [MAIN ] LW: Full history saved. [2025-09-30T19:45:12.792412] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LW took 34.2s. Estimated remaining: 2h 18m 38s. Rate: 7.8 symbols/min [2025-09-30T19:45:13.003487] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:13.057250] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-30T19:45:13.059971] [DEBUG] [LOCAL ] LYB: Loaded 53599 existing records from primary storage. [2025-09-30T19:45:13.060685] [INFO ] [MAIN ] LYB: Loaded 53599 existing records. [2025-09-30T19:45:13.266196] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:13.266685] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-30T19:45:13.266834] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-30T19:45:13.267112] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-30T19:45:13.267172] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-30T19:45:13.558110] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-30T19:45:13.741333] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:13.854394] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-30T19:45:14.134544] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-30T19:45:14.654367] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-30T19:45:15.173581] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T19:45:15.454388] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-30T19:45:16.254346] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-30T19:45:16.411619] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-30T19:45:16.564329] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-30T19:45:17.054412] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-30T19:45:17.338120] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-30T19:45:17.854387] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-30T19:45:17.994110] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-30T19:45:18.654431] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-30T19:45:19.248510] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T19:45:19.454419] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-30T19:45:19.970372] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-30T19:45:20.254368] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-30T19:45:20.832899] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-30T19:45:21.054382] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-30T19:45:21.702426] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T19:45:21.854385] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-30T19:45:22.384551] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-30T19:45:22.654358] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-30T19:45:23.246846] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T19:45:23.454409] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-30T19:45:24.254427] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-30T19:45:24.575278] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T19:45:25.054367] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-30T19:45:25.194917] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-30T19:45:25.331436] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-30T19:45:25.854343] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-30T19:45:26.466173] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-30T19:45:26.654400] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-30T19:45:27.454370] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-30T19:45:27.820333] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-30T19:45:27.851787] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-30T19:45:28.254376] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-30T19:45:28.857560] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-30T19:45:28.983189] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-30T19:45:29.054391] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-30T19:45:29.854386] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-30T19:45:30.467409] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-30T19:45:30.654366] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-30T19:45:30.920062] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-30T19:45:30.923798] [INFO ] [REMOTE ] LXFR: Full fetch complete (25073 records). [2025-09-30T19:45:30.923928] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-30T19:45:31.332262] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-30T19:45:31.332342] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-30T19:45:31.332868] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-30T19:45:31.332930] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-30T19:45:31.333629] [DEBUG] [LOCAL ] LXFR: Trimmed 25073 records to 16855 (keeping 200 days of data) [2025-09-30T19:45:31.444636] [DEBUG] [LOCAL ] LXFR: Primary data saved (16855 records). [2025-09-30T19:45:31.444804] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-30T19:45:31.444891] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXFR took 28.4s. Estimated remaining: 2h 18m 39s. Rate: 7.8 symbols/min [2025-09-30T19:45:31.459571] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-30T19:45:31.676325] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:31.739357] [DEBUG] [LOCAL ] LYG: Loaded 52817 existing records from primary storage. [2025-09-30T19:45:31.739912] [INFO ] [MAIN ] LYG: Loaded 52817 existing records. [2025-09-30T19:45:31.940587] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:31.940873] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-30T19:45:31.940929] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-30T19:45:31.941328] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-30T19:45:31.941412] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-30T19:45:32.257297] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-30T19:45:32.352873] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:32.387007] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-30T19:45:32.895454] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-30T19:45:33.054374] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-30T19:45:33.854364] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-30T19:45:34.117250] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T19:45:34.402119] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-30T19:45:34.654392] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-30T19:45:35.331097] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-30T19:45:35.342042] [INFO ] [REMOTE ] LXP: Full fetch complete (72564 records). [2025-09-30T19:45:35.342230] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-30T19:45:35.457159] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-30T19:45:35.781957] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-30T19:45:35.782069] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-30T19:45:35.783354] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-30T19:45:35.783431] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-30T19:45:35.785045] [DEBUG] [LOCAL ] LXP: Trimmed 72564 records to 50687 (keeping 200 days of data) [2025-09-30T19:45:36.142309] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T19:45:36.167575] [DEBUG] [LOCAL ] LXP: Primary data saved (50687 records). [2025-09-30T19:45:36.167773] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-30T19:45:36.167913] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXP took 32.6s. Estimated remaining: 2h 18m 29s. Rate: 7.8 symbols/min [2025-09-30T19:45:36.259476] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-30T19:45:36.396738] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:36.463334] [DEBUG] [LOCAL ] LYV: Loaded 51121 existing records from primary storage. [2025-09-30T19:45:36.463705] [INFO ] [MAIN ] LYV: Loaded 51121 existing records. [2025-09-30T19:45:36.679103] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:36.679328] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-30T19:45:36.679379] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-30T19:45:36.680045] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-30T19:45:36.680106] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-30T19:45:37.092073] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:37.084356] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-30T19:45:37.258517] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-30T19:45:37.310867] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-30T19:45:37.854377] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-30T19:45:38.654414] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-30T19:45:38.849873] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T19:45:39.460047] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-30T19:45:39.475704] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-30T19:45:39.901009] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-30T19:45:39.909808] [INFO ] [REMOTE ] LXU: Full fetch complete (44884 records). [2025-09-30T19:45:39.910005] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-30T19:45:40.259486] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-30T19:45:40.352575] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-30T19:45:40.352714] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-30T19:45:40.353591] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-30T19:45:40.353683] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-30T19:45:40.354840] [DEBUG] [LOCAL ] LXU: Trimmed 44884 records to 31733 (keeping 200 days of data) [2025-09-30T19:45:40.542227] [DEBUG] [LOCAL ] LXU: Primary data saved (31733 records). [2025-09-30T19:45:40.542376] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-30T19:45:40.542467] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LXU took 32.4s. Estimated remaining: 2h 18m 19s. Rate: 7.8 symbols/min [2025-09-30T19:45:40.733813] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:40.770538] [DEBUG] [LOCAL ] LZB: Loaded 35586 existing records from primary storage. [2025-09-30T19:45:40.770932] [INFO ] [MAIN ] LZB: Loaded 35586 existing records. [2025-09-30T19:45:40.992772] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:40.993026] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-30T19:45:40.993083] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-30T19:45:40.993397] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-30T19:45:40.993463] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-30T19:45:41.070163] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-30T19:45:41.413588] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:41.449670] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-30T19:45:41.854338] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-30T19:45:42.251369] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-30T19:45:42.473735] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-30T19:45:42.654387] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-30T19:45:43.454334] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-30T19:45:43.795985] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-30T19:45:44.254349] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-30T19:45:44.352990] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-30T19:45:45.054410] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-30T19:45:45.553949] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T19:45:45.592835] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-30T19:45:45.610463] [INFO ] [REMOTE ] LYB: Full fetch complete (77456 records). [2025-09-30T19:45:45.610635] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-30T19:45:45.866708] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-30T19:45:46.054382] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-30T19:45:46.054475] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-30T19:45:46.055619] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-30T19:45:46.055724] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-30T19:45:46.057302] [DEBUG] [LOCAL ] LYB: Trimmed 77456 records to 53600 (keeping 200 days of data) [2025-09-30T19:45:46.411509] [DEBUG] [LOCAL ] LYB: Primary data saved (53600 records). [2025-09-30T19:45:46.411696] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-30T19:45:46.411810] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYB took 33.6s. Estimated remaining: 2h 18m 10s. Rate: 7.8 symbols/min [2025-09-30T19:45:46.612344] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:45:46.627176] [DEBUG] [LOCAL ] LZM: Loaded 13838 existing records from primary storage. [2025-09-30T19:45:46.627462] [INFO ] [MAIN ] LZM: Loaded 13838 existing records. [2025-09-30T19:45:46.662732] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-30T19:45:46.836993] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:45:46.837318] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-30T19:45:46.837450] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-30T19:45:46.837985] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-30T19:45:46.838106] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-30T19:45:46.991769] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-30T19:45:47.293120] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:45:47.454370] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-30T19:45:47.655069] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-30T19:45:48.145031] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-30T19:45:48.254322] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-30T19:45:48.263956] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-30T19:45:49.054393] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-30T19:45:49.854380] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-30T19:45:50.012949] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-30T19:45:50.576795] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-30T19:45:50.654359] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-30T19:45:51.033287] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-30T19:45:51.454352] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-30T19:45:51.459175] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-30T19:45:52.254379] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-30T19:45:52.840560] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-30T19:45:53.054355] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-30T19:45:53.854359] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-30T19:45:54.027978] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-30T19:45:54.583278] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T19:45:54.654361] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-30T19:45:55.454332] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-30T19:45:55.559961] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T19:45:56.254338] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-30T19:45:56.357542] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-30T19:45:56.508961] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-30T19:45:57.054351] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-30T19:45:57.734850] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T19:45:57.854370] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-30T19:45:58.425077] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-30T19:45:58.654350] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-30T19:45:59.454679] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-30T19:45:59.459435] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-30T19:45:59.473692] [INFO ] [REMOTE ] LYG: Full fetch complete (76057 records). [2025-09-30T19:45:59.473900] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-30T19:45:59.920211] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-30T19:45:59.920365] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-30T19:45:59.921519] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-30T19:45:59.921669] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-30T19:45:59.941408] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-30T19:45:59.949112] [DEBUG] [LOCAL ] LYG: Trimmed 76057 records to 52804 (keeping 200 days of data) [2025-09-30T19:46:00.261284] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-30T19:46:00.289148] [DEBUG] [LOCAL ] LYG: Primary data saved (52804 records). [2025-09-30T19:46:00.289323] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-30T19:46:00.292499] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYG took 28.8s. Estimated remaining: 2h 18m 7s. Rate: 7.8 symbols/min [2025-09-30T19:46:00.472565] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:00.534292] [DEBUG] [LOCAL ] M: Loaded 53537 existing records from primary storage. [2025-09-30T19:46:00.534821] [INFO ] [MAIN ] M: Loaded 53537 existing records. [2025-09-30T19:46:00.751528] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:00.751878] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-30T19:46:00.751929] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-30T19:46:00.753253] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-30T19:46:00.753317] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-30T19:46:01.064994] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-30T19:46:01.166889] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:01.270970] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-30T19:46:01.412201] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-30T19:46:01.854408] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-30T19:46:02.475945] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T19:46:02.623590] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-30T19:46:02.654329] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-30T19:46:03.454429] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-30T19:46:04.254348] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-30T19:46:04.581630] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-30T19:46:04.723825] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-30T19:46:05.054371] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-30T19:46:05.178696] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-30T19:46:05.818492] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T19:46:05.854335] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-30T19:46:06.654363] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-30T19:46:06.819088] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-30T19:46:07.454375] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-30T19:46:08.076829] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-30T19:46:08.254367] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-30T19:46:08.895298] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-30T19:46:09.054375] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-30T19:46:09.703490] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-30T19:46:09.854390] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-30T19:46:10.645702] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-30T19:46:10.655852] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-30T19:46:11.454334] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-30T19:46:11.773719] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-30T19:46:11.786366] [INFO ] [REMOTE ] LYV: Full fetch complete (73672 records). [2025-09-30T19:46:11.786544] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-30T19:46:12.232814] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-30T19:46:12.232987] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-30T19:46:12.234330] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-30T19:46:12.234455] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-30T19:46:12.254682] [DEBUG] [LOCAL ] LYV: Trimmed 73672 records to 51121 (keeping 200 days of data) [2025-09-30T19:46:12.257100] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-30T19:46:12.260772] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-30T19:46:12.330104] [INFO ] [REMOTE ] LZB: Full fetch complete (50496 records). [2025-09-30T19:46:12.357561] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-30T19:46:12.965929] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-30T19:46:12.967301] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-30T19:46:12.972435] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-30T19:46:12.972946] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-30T19:46:13.000124] [DEBUG] [LOCAL ] LZB: Trimmed 50496 records to 35551 (keeping 200 days of data) [2025-09-30T19:46:13.203775] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-30T19:46:13.214610] [INFO ] [REMOTE ] LZM: Full fetch complete (18307 records). [2025-09-30T19:46:13.215789] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-30T19:46:13.250045] [DEBUG] [LOCAL ] LYV: Primary data saved (51121 records). [2025-09-30T19:46:13.285038] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-30T19:46:13.322850] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-30T19:46:13.328250] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LYV took 37.2s. Estimated remaining: 2h 18m 4s. Rate: 7.8 symbols/min [2025-09-30T19:46:13.398353] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-30T19:46:13.747422] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:13.907221] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-30T19:46:13.910171] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-30T19:46:13.911221] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-30T19:46:13.912163] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-30T19:46:13.916343] [DEBUG] [LOCAL ] LZM: Trimmed 18307 records to 13960 (keeping 200 days of data) [2025-09-30T19:46:14.088000] [DEBUG] [LOCAL ] MA: Loaded 52540 existing records from primary storage. [2025-09-30T19:46:14.089881] [INFO ] [MAIN ] MA: Loaded 52540 existing records. [2025-09-30T19:46:14.314289] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:14.316395] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-30T19:46:14.317006] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-30T19:46:14.318876] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-30T19:46:14.318998] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-30T19:46:14.434509] [DEBUG] [LOCAL ] LZM: Primary data saved (13960 records). [2025-09-30T19:46:14.447451] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-30T19:46:14.447928] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LZM took 28.0s. Estimated remaining: 2h 17m 51s. Rate: 7.8 symbols/min [2025-09-30T19:46:14.529569] [DEBUG] [LOCAL ] LZB: Primary data saved (35551 records). [2025-09-30T19:46:14.575825] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-30T19:46:14.646234] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. LZB took 34.1s. Estimated remaining: 2h 17m 37s. Rate: 7.8 symbols/min [2025-09-30T19:46:14.950003] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:15.129165] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:15.146099] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-30T19:46:15.238260] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:15.256918] [DEBUG] [LOCAL ] MAA: Loaded 42690 existing records from primary storage. [2025-09-30T19:46:15.257301] [INFO ] [MAIN ] MAA: Loaded 42690 existing records. [2025-09-30T19:46:15.523585] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:15.532998] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-30T19:46:15.552142] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-30T19:46:15.554468] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-30T19:46:15.566865] [DEBUG] [LOCAL ] MAC: Loaded 49693 existing records from primary storage. [2025-09-30T19:46:15.567218] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-30T19:46:15.568209] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-30T19:46:15.568148] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-30T19:46:15.581588] [INFO ] [MAIN ] MAC: Loaded 49693 existing records. [2025-09-30T19:46:16.029074] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:16.069743] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-30T19:46:16.094863] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-30T19:46:16.101439] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-30T19:46:16.117205] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-30T19:46:16.226531] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:16.268550] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-30T19:46:16.783625] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:16.784176] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-30T19:46:17.184526] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-30T19:46:17.196666] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-30T19:46:17.588349] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-30T19:46:17.854332] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-30T19:46:17.938511] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T19:46:18.654357] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-30T19:46:18.702025] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-30T19:46:19.157866] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-30T19:46:19.454382] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-30T19:46:19.715829] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-30T19:46:20.148317] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-30T19:46:20.254391] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-30T19:46:20.946154] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-30T19:46:21.054344] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-30T19:46:21.838693] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-30T19:46:21.854329] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-30T19:46:22.222846] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-30T19:46:22.654389] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-30T19:46:23.454392] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-30T19:46:23.749497] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-30T19:46:23.888960] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-30T19:46:24.254427] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-30T19:46:25.054327] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-30T19:46:25.472037] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-30T19:46:25.854387] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-30T19:46:25.950620] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-30T19:46:26.424067] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-30T19:46:26.654409] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-30T19:46:27.459538] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-30T19:46:27.465561] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-30T19:46:28.254356] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-30T19:46:28.338002] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-30T19:46:29.054360] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-30T19:46:29.661894] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-30T19:46:29.854347] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-30T19:46:30.390763] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-30T19:46:30.402819] [INFO ] [REMOTE ] M: Full fetch complete (77520 records). [2025-09-30T19:46:30.403008] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-30T19:46:30.659206] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-30T19:46:30.848555] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-30T19:46:30.848765] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-30T19:46:30.850007] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-30T19:46:30.850199] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-30T19:46:30.868112] [DEBUG] [LOCAL ] M: Trimmed 77520 records to 53535 (keeping 200 days of data) [2025-09-30T19:46:30.884386] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-30T19:46:31.268304] [DEBUG] [LOCAL ] M: Primary data saved (53535 records). [2025-09-30T19:46:31.268499] [INFO ] [MAIN ] M: Full history saved. [2025-09-30T19:46:31.269228] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. M took 31.0s. Estimated remaining: 2h 17m 36s. Rate: 7.8 symbols/min [2025-09-30T19:46:31.459506] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-30T19:46:31.463456] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:31.493679] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:46:31.539885] [DEBUG] [LOCAL ] MAGN: Loaded 34851 existing records from primary storage. [2025-09-30T19:46:31.540228] [INFO ] [MAIN ] MAGN: Loaded 34851 existing records. [2025-09-30T19:46:31.736923] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:31.737153] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-30T19:46:31.737201] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-30T19:46:31.738037] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-30T19:46:31.738131] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-30T19:46:32.135075] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:32.254324] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-30T19:46:32.363757] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-30T19:46:33.054382] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-30T19:46:33.243033] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-30T19:46:33.358880] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-30T19:46:33.854373] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-30T19:46:34.654356] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-09-30T19:46:35.097274] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-30T19:46:35.180972] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T19:46:35.454378] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-30T19:46:36.019545] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T19:46:36.254373] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-30T19:46:37.054372] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-09-30T19:46:37.133887] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-30T19:46:37.854393] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-30T19:46:38.091891] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T19:46:38.500422] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-30T19:46:38.654392] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-30T19:46:39.454391] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-30T19:46:39.518046] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-30T19:46:40.254449] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-30T19:46:40.595255] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-30T19:46:40.761914] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-30T19:46:41.054360] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-30T19:46:41.854315] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-30T19:46:41.892674] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-30T19:46:42.654368] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-30T19:46:43.021732] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-30T19:46:43.033703] [INFO ] [REMOTE ] MA: Full fetch complete (76253 records). [2025-09-30T19:46:43.033880] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-30T19:46:43.460323] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-30T19:46:43.493876] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-30T19:46:43.495072] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-30T19:46:43.496453] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-30T19:46:43.496667] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-30T19:46:43.524874] [DEBUG] [LOCAL ] MA: Trimmed 76253 records to 52531 (keeping 200 days of data) [2025-09-30T19:46:43.529450] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-30T19:46:43.895924] [DEBUG] [LOCAL ] MA: Primary data saved (52531 records). [2025-09-30T19:46:43.896075] [INFO ] [MAIN ] MA: Full history saved. [2025-09-30T19:46:43.896182] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. MA took 30.6s. Estimated remaining: 2h 17m 33s. Rate: 7.8 symbols/min [2025-09-30T19:46:44.083103] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:44.115926] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T19:46:44.162563] [DEBUG] [LOCAL ] MAIN: Loaded 41208 existing records from primary storage. [2025-09-30T19:46:44.162940] [INFO ] [MAIN ] MAIN: Loaded 41208 existing records. [2025-09-30T19:46:44.259960] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-30T19:46:44.359703] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:44.359933] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-30T19:46:44.359995] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-30T19:46:44.360988] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-30T19:46:44.361051] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-30T19:46:44.773900] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:44.868726] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-30T19:46:45.054369] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-30T19:46:45.854332] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-09-30T19:46:45.977925] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-30T19:46:45.989623] [INFO ] [REMOTE ] MAA: Full fetch complete (61113 records). [2025-09-30T19:46:45.989813] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-30T19:46:46.424125] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-30T19:46:46.424250] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-30T19:46:46.425442] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-30T19:46:46.425582] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-30T19:46:46.427433] [DEBUG] [LOCAL ] MAA: Trimmed 61113 records to 42672 (keeping 200 days of data) [2025-09-30T19:46:46.562679] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T19:46:46.575383] [INFO ] [REMOTE ] MAC: Full fetch complete (71444 records). [2025-09-30T19:46:46.576115] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-30T19:46:46.660741] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-30T19:46:47.053573] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-30T19:46:47.055052] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-30T19:46:47.056700] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-30T19:46:47.056842] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-30T19:46:47.062440] [DEBUG] [LOCAL ] MAC: Trimmed 71444 records to 49676 (keeping 200 days of data) [2025-09-30T19:46:47.289119] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-30T19:46:47.363038] [DEBUG] [LOCAL ] MAA: Primary data saved (42672 records). [2025-09-30T19:46:47.363874] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-30T19:46:47.364475] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MAA took 32.9s. Estimated remaining: 2h 17m 22s. Rate: 7.8 symbols/min [2025-09-30T19:46:47.458639] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-09-30T19:46:47.681522] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:47.734159] [DEBUG] [LOCAL ] MAN: Loaded 43536 existing records from primary storage. [2025-09-30T19:46:47.735352] [INFO ] [MAIN ] MAN: Loaded 43536 existing records. [2025-09-30T19:46:47.974273] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:47.977933] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-30T19:46:47.978032] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-30T19:46:48.022706] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-30T19:46:48.023587] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-30T19:46:48.176167] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-30T19:46:48.254401] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-30T19:46:48.405151] [DEBUG] [LOCAL ] MAC: Primary data saved (49676 records). [2025-09-30T19:46:48.405886] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-30T19:46:48.406007] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAC took 33.7s. Estimated remaining: 2h 17m 8s. Rate: 7.8 symbols/min [2025-09-30T19:46:48.610506] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:48.690143] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:46:48.718955] [DEBUG] [LOCAL ] MANU: Loaded 27013 existing records from primary storage. [2025-09-30T19:46:48.719261] [INFO ] [MAIN ] MANU: Loaded 27013 existing records. [2025-09-30T19:46:48.917829] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:46:48.918044] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-30T19:46:48.918131] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-30T19:46:48.918423] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-30T19:46:48.918481] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-30T19:46:49.054747] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-09-30T19:46:49.351753] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-30T19:46:49.384010] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:46:49.463222] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T19:46:49.854387] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-09-30T19:46:50.267393] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-30T19:46:50.654364] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-30T19:46:51.008035] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-30T19:46:51.454377] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-09-30T19:46:52.065048] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-30T19:46:52.254354] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-30T19:46:52.928817] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-30T19:46:53.054356] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-30T19:46:53.818473] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-30T19:46:53.854362] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-30T19:46:54.551982] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-30T19:46:54.654365] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-09-30T19:46:55.454363] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-30T19:46:55.540876] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-30T19:46:55.770740] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-30T19:46:56.254350] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-30T19:46:56.755523] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T19:46:57.054355] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-30T19:46:57.854353] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-30T19:46:58.080889] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-30T19:46:58.265061] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-30T19:46:58.654399] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-30T19:46:59.221439] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-30T19:46:59.229256] [INFO ] [REMOTE ] MAGN: Full fetch complete (50939 records). [2025-09-30T19:46:59.229452] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-30T19:46:59.456405] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-30T19:46:59.673717] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-30T19:46:59.673971] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-30T19:46:59.674950] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-30T19:46:59.675065] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-30T19:46:59.698453] [DEBUG] [LOCAL ] MAGN: Trimmed 50939 records to 34849 (keeping 200 days of data) [2025-09-30T19:46:59.698327] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-30T19:46:59.929560] [DEBUG] [LOCAL ] MAGN: Primary data saved (34849 records). [2025-09-30T19:46:59.929761] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-30T19:46:59.930517] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAGN took 28.7s. Estimated remaining: 2h 17m 4s. Rate: 7.8 symbols/min [2025-09-30T19:47:00.121743] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:00.177782] [DEBUG] [LOCAL ] MAS: Loaded 52336 existing records from primary storage. [2025-09-30T19:47:00.178195] [INFO ] [MAIN ] MAS: Loaded 52336 existing records. [2025-09-30T19:47:00.259546] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-30T19:47:00.399418] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:00.400465] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-30T19:47:00.400537] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-30T19:47:00.401791] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-30T19:47:00.401877] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-30T19:47:00.773992] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:01.054368] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-09-30T19:47:01.374927] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-30T19:47:01.646936] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-30T19:47:01.854367] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-30T19:47:02.338394] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-30T19:47:02.654379] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-30T19:47:03.454377] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-30T19:47:03.536253] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-30T19:47:04.254840] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-30T19:47:04.254766] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T19:47:04.636007] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-30T19:47:05.054384] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-30T19:47:05.416465] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-30T19:47:05.854410] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-30T19:47:06.632163] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-30T19:47:06.654349] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-30T19:47:07.036603] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T19:47:07.454402] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-30T19:47:08.053076] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-30T19:47:08.254406] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-30T19:47:09.054436] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-30T19:47:09.156131] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T19:47:09.616873] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-30T19:47:09.854408] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-30T19:47:10.654332] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-30T19:47:10.834903] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-30T19:47:11.454368] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-30T19:47:11.549410] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-30T19:47:11.925946] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T19:47:12.254406] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-30T19:47:13.054327] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-30T19:47:13.160254] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T19:47:13.169708] [INFO ] [REMOTE ] MAIN: Full fetch complete (59751 records). [2025-09-30T19:47:13.169951] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-30T19:47:13.618475] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-30T19:47:13.618587] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-30T19:47:13.619734] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-30T19:47:13.619821] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-30T19:47:13.643943] [DEBUG] [LOCAL ] MAIN: Trimmed 59751 records to 41190 (keeping 200 days of data) [2025-09-30T19:47:13.645412] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-30T19:47:13.879768] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-30T19:47:13.930492] [DEBUG] [LOCAL ] MAIN: Primary data saved (41190 records). [2025-09-30T19:47:13.930624] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-30T19:47:13.930737] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MAIN took 30.0s. Estimated remaining: 2h 17m 1s. Rate: 7.8 symbols/min [2025-09-30T19:47:14.120414] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:14.157216] [DEBUG] [LOCAL ] MATV: Loaded 37051 existing records from primary storage. [2025-09-30T19:47:14.157515] [INFO ] [MAIN ] MATV: Loaded 37051 existing records. [2025-09-30T19:47:14.364748] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:14.365058] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-30T19:47:14.365200] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-30T19:47:14.365576] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-30T19:47:14.365672] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-30T19:47:14.506188] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-30T19:47:14.659984] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-30T19:47:14.797352] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:15.448328] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-30T19:47:15.458751] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-30T19:47:16.254350] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-30T19:47:16.491180] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-30T19:47:16.745070] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-30T19:47:17.054390] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-30T19:47:17.615848] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-30T19:47:17.854338] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-30T19:47:18.080972] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-30T19:47:18.654401] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-09-30T19:47:19.454319] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-30T19:47:19.499375] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-30T19:47:19.509131] [INFO ] [REMOTE ] MAN: Full fetch complete (62067 records). [2025-09-30T19:47:19.509266] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-30T19:47:19.927479] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-30T19:47:19.927562] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-30T19:47:19.928677] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-30T19:47:19.928757] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-30T19:47:19.930278] [DEBUG] [LOCAL ] MAN: Trimmed 62067 records to 43544 (keeping 200 days of data) [2025-09-30T19:47:20.059695] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-30T19:47:20.240915] [DEBUG] [LOCAL ] MAN: Primary data saved (43544 records). [2025-09-30T19:47:20.241044] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-30T19:47:20.241177] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MAN took 32.9s. Estimated remaining: 2h 16m 52s. Rate: 7.8 symbols/min [2025-09-30T19:47:20.263533] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-30T19:47:20.432139] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:20.467278] [DEBUG] [LOCAL ] MATX: Loaded 31452 existing records from primary storage. [2025-09-30T19:47:20.467553] [INFO ] [MAIN ] MATX: Loaded 31452 existing records. [2025-09-30T19:47:20.657751] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:20.658113] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-30T19:47:20.658172] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-30T19:47:20.658426] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-30T19:47:20.658515] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-30T19:47:21.055518] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-30T19:47:21.055427] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:21.118249] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-30T19:47:21.125766] [INFO ] [REMOTE ] MANU: Full fetch complete (38285 records). [2025-09-30T19:47:21.125900] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-30T19:47:21.521403] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-30T19:47:21.521489] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-30T19:47:21.522272] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-30T19:47:21.522337] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-30T19:47:21.523325] [DEBUG] [LOCAL ] MANU: Trimmed 38285 records to 27013 (keeping 200 days of data) [2025-09-30T19:47:21.690874] [DEBUG] [LOCAL ] MANU: Primary data saved (27013 records). [2025-09-30T19:47:21.691062] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-30T19:47:21.691171] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MANU took 33.3s. Estimated remaining: 2h 16m 40s. Rate: 7.8 symbols/min [2025-09-30T19:47:21.810924] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-30T19:47:21.859450] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-30T19:47:21.908408] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:21.940968] [DEBUG] [LOCAL ] MAX: Loaded 30602 existing records from primary storage. [2025-09-30T19:47:21.941325] [INFO ] [MAIN ] MAX: Loaded 30602 existing records. [2025-09-30T19:47:22.133254] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:22.133506] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-30T19:47:22.133558] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-30T19:47:22.133888] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-30T19:47:22.133947] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-30T19:47:22.519976] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:22.654351] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-09-30T19:47:22.786076] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-30T19:47:22.845558] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-30T19:47:23.454335] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-30T19:47:23.745918] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T19:47:24.254358] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-30T19:47:25.054384] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-09-30T19:47:25.319152] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-30T19:47:25.854353] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-30T19:47:25.890015] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-30T19:47:26.426966] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-30T19:47:26.654410] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-30T19:47:27.454350] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-09-30T19:47:27.643339] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-30T19:47:28.101958] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-30T19:47:28.254372] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-30T19:47:28.605626] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T19:47:29.054400] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-09-30T19:47:29.825336] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-30T19:47:29.854381] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-30T19:47:30.375360] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T19:47:30.654402] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-30T19:47:31.230259] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-30T19:47:31.454354] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-30T19:47:32.223157] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-30T19:47:32.235225] [INFO ] [REMOTE ] MAS: Full fetch complete (74826 records). [2025-09-30T19:47:32.235421] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-30T19:47:32.261718] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-30T19:47:32.687728] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-30T19:47:32.687849] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-30T19:47:32.689010] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-30T19:47:32.689082] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-30T19:47:32.690625] [DEBUG] [LOCAL ] MAS: Trimmed 74826 records to 52338 (keeping 200 days of data) [2025-09-30T19:47:32.944093] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T19:47:33.054375] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-30T19:47:33.085630] [DEBUG] [LOCAL ] MAS: Primary data saved (52338 records). [2025-09-30T19:47:33.085806] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-30T19:47:33.086598] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MAS took 33.2s. Estimated remaining: 2h 16m 35s. Rate: 7.8 symbols/min [2025-09-30T19:47:33.274784] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:33.293110] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-30T19:47:33.341341] [DEBUG] [LOCAL ] MBC: Loaded 43180 existing records from primary storage. [2025-09-30T19:47:33.341766] [INFO ] [MAIN ] MBC: Loaded 43180 existing records. [2025-09-30T19:47:33.524754] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:33.525000] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-30T19:47:33.525054] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-30T19:47:33.525338] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-30T19:47:33.525402] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-30T19:47:33.856521] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-30T19:47:33.892916] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:34.021388] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T19:47:34.654335] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-09-30T19:47:34.834797] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T19:47:35.454367] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-30T19:47:36.254400] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-30T19:47:36.486132] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-30T19:47:37.054423] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-30T19:47:37.775493] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-30T19:47:37.854329] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-30T19:47:38.199584] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-30T19:47:38.654408] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-30T19:47:39.268962] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-30T19:47:39.275868] [INFO ] [REMOTE ] MATV: Full fetch complete (52388 records). [2025-09-30T19:47:39.275989] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-30T19:47:39.458125] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-30T19:47:39.626847] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (4.97 seconds). [2025-09-30T19:47:39.751936] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-30T19:47:39.752024] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-30T19:47:39.752874] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-30T19:47:39.752938] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-30T19:47:39.754084] [DEBUG] [LOCAL ] MATV: Trimmed 52388 records to 36847 (keeping 200 days of data) [2025-09-30T19:47:39.987931] [DEBUG] [LOCAL ] MATV: Primary data saved (36847 records). [2025-09-30T19:47:39.988105] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-30T19:47:39.988209] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATV took 26.1s. Estimated remaining: 2h 16m 27s. Rate: 7.8 symbols/min [2025-09-30T19:47:40.167999] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:40.192090] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-30T19:47:40.221303] [DEBUG] [LOCAL ] MBI: Loaded 24353 existing records from primary storage. [2025-09-30T19:47:40.221679] [INFO ] [MAIN ] MBI: Loaded 24353 existing records. [2025-09-30T19:47:40.259476] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-30T19:47:40.417974] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:40.418337] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-30T19:47:40.418487] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-30T19:47:40.418907] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-30T19:47:40.419011] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-30T19:47:40.624695] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-30T19:47:40.838319] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:41.054355] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-30T19:47:41.838348] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:47:41.854307] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-30T19:47:42.363761] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-30T19:47:42.654358] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-09-30T19:47:43.294424] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-30T19:47:43.454383] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-30T19:47:43.952230] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T19:47:44.254382] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-09-30T19:47:44.541081] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T19:47:45.054317] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-30T19:47:45.448071] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-30T19:47:45.854322] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-30T19:47:46.041244] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-30T19:47:46.654376] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-30T19:47:47.173100] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-30T19:47:47.454333] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-30T19:47:47.490511] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-30T19:47:48.254375] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-30T19:47:48.960715] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-30T19:47:49.054327] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-30T19:47:49.586874] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-30T19:47:49.854349] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-30T19:47:50.353350] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-30T19:47:50.654365] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-30T19:47:51.081999] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-30T19:47:51.454384] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-30T19:47:52.224855] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-30T19:47:52.254324] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-30T19:47:52.794262] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-30T19:47:52.801465] [INFO ] [REMOTE ] MATX: Full fetch complete (42584 records). [2025-09-30T19:47:52.801677] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-30T19:47:53.059478] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-30T19:47:53.237419] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-30T19:47:53.237543] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-30T19:47:53.238422] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-30T19:47:53.238537] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-30T19:47:53.239768] [DEBUG] [LOCAL ] MATX: Trimmed 42584 records to 31534 (keeping 200 days of data) [2025-09-30T19:47:53.451073] [DEBUG] [LOCAL ] MATX: Primary data saved (31534 records). [2025-09-30T19:47:53.451418] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-30T19:47:53.451526] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MATX took 33.2s. Estimated remaining: 2h 16m 24s. Rate: 7.8 symbols/min [2025-09-30T19:47:53.585391] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-30T19:47:53.681419] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:53.725189] [DEBUG] [LOCAL ] MC: Loaded 44106 existing records from primary storage. [2025-09-30T19:47:53.725497] [INFO ] [MAIN ] MC: Loaded 44106 existing records. [2025-09-30T19:47:53.859495] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-30T19:47:53.917917] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:53.918179] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-30T19:47:53.918241] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-30T19:47:53.918604] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-30T19:47:53.918692] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-30T19:47:54.464059] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:54.571413] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-30T19:47:54.582412] [INFO ] [REMOTE ] MAX: Full fetch complete (45233 records). [2025-09-30T19:47:54.582692] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-30T19:47:54.659515] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-09-30T19:47:54.994609] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-30T19:47:54.994726] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-30T19:47:54.995469] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-30T19:47:54.995512] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-30T19:47:54.996534] [DEBUG] [LOCAL ] MAX: Trimmed 45233 records to 30628 (keeping 200 days of data) [2025-09-30T19:47:55.181304] [DEBUG] [LOCAL ] MAX: Primary data saved (30628 records). [2025-09-30T19:47:55.181444] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-30T19:47:55.181548] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MAX took 33.5s. Estimated remaining: 2h 16m 11s. Rate: 7.8 symbols/min [2025-09-30T19:47:55.372851] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:47:55.397418] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-30T19:47:55.416019] [DEBUG] [LOCAL ] MCB: Loaded 11659 existing records from primary storage. [2025-09-30T19:47:55.416272] [INFO ] [MAIN ] MCB: Loaded 11659 existing records. [2025-09-30T19:47:55.461203] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-30T19:47:55.611183] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:47:55.611449] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-30T19:47:55.611510] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-30T19:47:55.611813] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-30T19:47:55.611871] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-30T19:47:56.023976] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:47:56.051224] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-30T19:47:56.254368] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-09-30T19:47:56.971508] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-30T19:47:56.987815] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-30T19:47:57.054365] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-30T19:47:57.854364] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-09-30T19:47:58.644510] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-30T19:47:58.655734] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-09-30T19:47:58.893611] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-30T19:47:59.454401] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-30T19:48:00.049403] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-30T19:48:00.254356] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-30T19:48:00.345724] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-30T19:48:01.054389] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-30T19:48:01.803628] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-30T19:48:01.818953] [INFO ] [REMOTE ] MBC: Full fetch complete (62838 records). [2025-09-30T19:48:01.819252] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-30T19:48:01.856045] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-30T19:48:01.957183] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-30T19:48:02.396881] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-30T19:48:02.396967] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-30T19:48:02.398135] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-30T19:48:02.398201] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-30T19:48:02.399578] [DEBUG] [LOCAL ] MBC: Trimmed 62838 records to 43179 (keeping 200 days of data) [2025-09-30T19:48:02.655513] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-30T19:48:02.679742] [DEBUG] [LOCAL ] MBC: Primary data saved (43179 records). [2025-09-30T19:48:02.679854] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-30T19:48:02.681112] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MBC took 29.6s. Estimated remaining: 2h 16m 3s. Rate: 7.8 symbols/min [2025-09-30T19:48:02.860037] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:02.860260] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-09-30T19:48:02.860315] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-09-30T19:48:02.860435] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-30T19:48:02.860476] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-30T19:48:02.860516] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-30T19:48:02.860549] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-30T19:48:03.264960] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:03.278391] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-30T19:48:03.454377] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-30T19:48:04.196038] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-30T19:48:04.254332] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-30T19:48:04.291327] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-30T19:48:05.054372] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-30T19:48:05.854331] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-30T19:48:05.962062] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-30T19:48:06.155844] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-30T19:48:06.654329] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-30T19:48:06.890516] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-30T19:48:07.454371] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-30T19:48:08.254406] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-30T19:48:08.655498] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-30T19:48:08.973834] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-30T19:48:09.065971] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-30T19:48:09.071886] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-30T19:48:09.854404] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-30T19:48:10.635875] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T19:48:10.654314] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-30T19:48:11.087234] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-30T19:48:11.454361] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-30T19:48:11.568994] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-30T19:48:12.254350] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-30T19:48:13.020303] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-30T19:48:13.054350] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-30T19:48:13.167994] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-30T19:48:13.854349] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-30T19:48:13.965760] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-30T19:48:14.654422] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-30T19:48:15.416677] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T19:48:15.454394] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-30T19:48:16.033952] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-30T19:48:16.254437] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-30T19:48:16.527340] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-30T19:48:16.695784] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T19:48:17.054387] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-30T19:48:17.727062] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-30T19:48:17.730277] [INFO ] [REMOTE ] MCB: Full fetch complete (16347 records). [2025-09-30T19:48:17.730403] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-30T19:48:17.859521] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-30T19:48:18.126584] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-30T19:48:18.126701] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-30T19:48:18.127124] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-30T19:48:18.127175] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-30T19:48:18.127842] [DEBUG] [LOCAL ] MCB: Trimmed 16347 records to 11531 (keeping 200 days of data) [2025-09-30T19:48:18.203679] [DEBUG] [LOCAL ] MCB: Primary data saved (11531 records). [2025-09-30T19:48:18.203835] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-30T19:48:18.203924] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MCB took 23.0s. Estimated remaining: 2h 16m 2s. Rate: 7.8 symbols/min [2025-09-30T19:48:18.392230] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:18.403554] [DEBUG] [LOCAL ] MCI: Loaded 6387 existing records from primary storage. [2025-09-30T19:48:18.403816] [INFO ] [MAIN ] MCI: Loaded 6387 existing records. [2025-09-30T19:48:18.602941] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:48:18.603255] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-30T19:48:18.603320] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-30T19:48:18.603616] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-30T19:48:18.603704] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-30T19:48:18.660890] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-30T19:48:18.992300] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:19.243206] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-30T19:48:19.248816] [INFO ] [REMOTE ] MBI: Full fetch complete (36488 records). [2025-09-30T19:48:19.248925] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-30T19:48:19.463578] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-30T19:48:19.656105] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-30T19:48:19.656188] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-30T19:48:19.656981] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-30T19:48:19.657065] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-30T19:48:19.658004] [DEBUG] [LOCAL ] MBI: Trimmed 36488 records to 24289 (keeping 200 days of data) [2025-09-30T19:48:19.804558] [DEBUG] [LOCAL ] MBI: Primary data saved (24289 records). [2025-09-30T19:48:19.804713] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-30T19:48:19.804843] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MBI took 39.8s. Estimated remaining: 2h 15m 49s. Rate: 7.8 symbols/min [2025-09-30T19:48:20.006045] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:20.054536] [DEBUG] [LOCAL ] MCK: Loaded 39218 existing records from primary storage. [2025-09-30T19:48:20.054938] [INFO ] [MAIN ] MCK: Loaded 39218 existing records. [2025-09-30T19:48:20.258240] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-09-30T19:48:20.257919] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:48:20.260996] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-30T19:48:20.261110] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-30T19:48:20.261788] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-30T19:48:20.261937] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-30T19:48:20.594472] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-30T19:48:20.702455] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:20.954493] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-30T19:48:21.054389] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-30T19:48:21.711842] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-30T19:48:21.854380] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-30T19:48:22.587156] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-30T19:48:22.654363] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-30T19:48:23.454379] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-09-30T19:48:24.099831] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-30T19:48:24.107394] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-30T19:48:24.254340] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-09-30T19:48:24.360383] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-30T19:48:24.369807] [INFO ] [REMOTE ] MC: Full fetch complete (62468 records). [2025-09-30T19:48:24.370038] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-30T19:48:24.822836] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-30T19:48:24.822955] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-30T19:48:24.824001] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-30T19:48:24.824069] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-30T19:48:24.826681] [DEBUG] [LOCAL ] MC: Trimmed 62468 records to 44091 (keeping 200 days of data) [2025-09-30T19:48:25.055743] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-30T19:48:25.113167] [DEBUG] [LOCAL ] MC: Primary data saved (44091 records). [2025-09-30T19:48:25.113347] [INFO ] [MAIN ] MC: Full history saved. [2025-09-30T19:48:25.113502] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MC took 31.7s. Estimated remaining: 2h 15m 40s. Rate: 7.8 symbols/min [2025-09-30T19:48:25.299274] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:25.309712] [DEBUG] [LOCAL ] MCN: Loaded 8133 existing records from primary storage. [2025-09-30T19:48:25.309925] [INFO ] [MAIN ] MCN: Loaded 8133 existing records. [2025-09-30T19:48:25.498958] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:48:25.499224] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-30T19:48:25.499274] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-30T19:48:25.499563] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-30T19:48:25.499668] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-30T19:48:25.857457] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-30T19:48:25.894303] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:25.926600] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-30T19:48:26.022075] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-30T19:48:26.654452] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-30T19:48:27.148352] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-30T19:48:27.454370] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-30T19:48:28.102612] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-30T19:48:28.119444] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-30T19:48:28.254382] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-30T19:48:29.054415] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-30T19:48:29.854366] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-30T19:48:30.479387] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-30T19:48:30.500996] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-30T19:48:30.633816] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-30T19:48:30.654317] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-30T19:48:31.454374] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-30T19:48:32.136870] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-30T19:48:32.201932] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-30T19:48:32.254336] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-30T19:48:33.054401] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-30T19:48:33.854377] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-30T19:48:34.302201] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-30T19:48:34.564054] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-30T19:48:34.619031] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-30T19:48:34.654391] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-09-30T19:48:35.114170] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-30T19:48:35.454406] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-30T19:48:36.254396] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-30T19:48:36.831047] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-30T19:48:37.054367] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-09-30T19:48:37.719800] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-30T19:48:37.741342] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-30T19:48:37.854366] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-30T19:48:38.370012] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-30T19:48:38.654390] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-30T19:48:39.454358] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-30T19:48:40.254368] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-30T19:48:40.903373] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-30T19:48:40.914834] [INFO ] [REMOTE ] MCD: Full fetch complete (77029 records). [2025-09-30T19:48:40.915049] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-30T19:48:41.037372] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-30T19:48:41.056758] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-30T19:48:41.154865] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-30T19:48:41.157973] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-30T19:48:41.158228] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-30T19:48:41.158354] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-30T19:48:41.158467] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-30T19:48:41.158606] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-30T19:48:41.158812] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-09-30T19:48:41.158922] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCD took 38.5s. Estimated remaining: 2h 15m 39s. Rate: 7.8 symbols/min [2025-09-30T19:48:41.362531] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:41.385124] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-30T19:48:41.444869] [DEBUG] [LOCAL ] MCO: Loaded 39341 existing records from primary storage. [2025-09-30T19:48:41.445201] [INFO ] [MAIN ] MCO: Loaded 39341 existing records. [2025-09-30T19:48:41.636970] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:48:41.637214] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-30T19:48:41.637262] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-30T19:48:41.637723] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-30T19:48:41.637784] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-30T19:48:41.859485] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-30T19:48:41.956930] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T19:48:41.970535] [INFO ] [REMOTE ] MCI: Full fetch complete (9927 records). [2025-09-30T19:48:41.980957] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-30T19:48:42.131958] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:42.456100] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-30T19:48:42.456177] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-30T19:48:42.456445] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-30T19:48:42.456508] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-30T19:48:42.457042] [DEBUG] [LOCAL ] MCI: Trimmed 9927 records to 6378 (keeping 200 days of data) [2025-09-30T19:48:42.499978] [DEBUG] [LOCAL ] MCI: Primary data saved (6378 records). [2025-09-30T19:48:42.500123] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-30T19:48:42.500224] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCI took 24.3s. Estimated remaining: 2h 15m 26s. Rate: 7.8 symbols/min [2025-09-30T19:48:42.659525] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-09-30T19:48:42.692018] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:42.704897] [DEBUG] [LOCAL ] MCR: Loaded 8763 existing records from primary storage. [2025-09-30T19:48:42.705293] [INFO ] [MAIN ] MCR: Loaded 8763 existing records. [2025-09-30T19:48:42.889750] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:48:42.890006] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-30T19:48:42.890058] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-30T19:48:42.890296] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-30T19:48:42.890359] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-30T19:48:43.281106] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:43.454372] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-09-30T19:48:43.539177] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-30T19:48:43.976790] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-30T19:48:44.254371] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-09-30T19:48:44.357555] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-30T19:48:45.054376] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-30T19:48:45.100587] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-30T19:48:45.606769] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-30T19:48:45.854356] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-30T19:48:46.654376] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-30T19:48:47.067043] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-30T19:48:47.353466] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-30T19:48:47.454390] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-30T19:48:48.254346] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-30T19:48:48.271795] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-30T19:48:48.356275] [DEBUG] [REMOTE ] MCK: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-30T19:48:48.356558] [WARN ] [REMOTE ] MCK: No data returned for month 2025-07 [2025-09-30T19:48:48.356688] [FATAL] [REMOTE ] MCK: API call failed - aborting fetch to avoid wasting further API calls [2025-09-30T19:48:48.356781] [FATAL] [MAIN ] MCK: Failed to fetch primary data. [2025-09-30T19:48:48.356825] [WARN ] [MAIN ] MCK: Deleting existing primary and derivative data due to fetch failure. [2025-09-30T19:48:48.356895] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-30T19:48:48.356960] [DEBUG] [LOCAL ] MCK: No primary data file found to delete. [2025-09-30T19:48:48.356996] [INFO ] [LOCAL ] MCK: Starting deletion of derivative data. [2025-09-30T19:48:48.357569] [DEBUG] [LOCAL ] MCK: Deleted derivative data file. [2025-09-30T19:48:48.357681] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCK took 28.6s. Estimated remaining: 2h 15m 17s. Rate: 7.8 symbols/min [2025-09-30T19:48:48.550001] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:48:48.571952] [DEBUG] [LOCAL ] MCS: Loaded 20946 existing records from primary storage. [2025-09-30T19:48:48.572259] [INFO ] [MAIN ] MCS: Loaded 20946 existing records. [2025-09-30T19:48:48.788525] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:48:48.788793] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-30T19:48:48.788844] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-30T19:48:48.789141] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-30T19:48:48.789200] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-30T19:48:49.059592] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-09-30T19:48:49.176145] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:48:49.854365] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-09-30T19:48:50.594380] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-30T19:48:50.654331] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-30T19:48:50.858876] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-30T19:48:51.454408] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-09-30T19:48:52.185501] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-30T19:48:52.254361] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-30T19:48:52.541067] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-30T19:48:52.739540] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-30T19:48:53.054372] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-30T19:48:53.854448] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-30T19:48:53.927158] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-30T19:48:54.611118] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T19:48:54.654373] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-30T19:48:55.395080] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T19:48:55.454341] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-30T19:48:56.254354] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-30T19:48:57.054357] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-30T19:48:57.132354] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-30T19:48:57.183627] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-30T19:48:57.457282] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-30T19:48:57.854359] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-30T19:48:58.654378] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-30T19:48:59.411469] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-30T19:48:59.454337] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-30T19:48:59.649786] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-30T19:49:00.254926] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-30T19:49:00.254333] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-30T19:49:01.054371] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-30T19:49:01.645290] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-30T19:49:01.854408] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-30T19:49:02.260323] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-30T19:49:02.654396] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-30T19:49:03.338405] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-30T19:49:03.389316] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-30T19:49:03.391777] [INFO ] [REMOTE ] MCR: Full fetch complete (14117 records). [2025-09-30T19:49:03.391934] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-30T19:49:03.461080] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-30T19:49:03.821287] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-30T19:49:03.821376] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-30T19:49:03.821748] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-30T19:49:03.821822] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-30T19:49:03.822368] [DEBUG] [LOCAL ] MCR: Trimmed 14117 records to 8737 (keeping 200 days of data) [2025-09-30T19:49:03.883400] [DEBUG] [LOCAL ] MCR: Primary data saved (8737 records). [2025-09-30T19:49:03.883760] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-30T19:49:03.883900] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCR took 21.4s. Estimated remaining: 2h 15m 15s. Rate: 7.8 symbols/min [2025-09-30T19:49:04.254380] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-30T19:49:05.001063] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-30T19:49:05.017374] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-30T19:49:05.054347] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-30T19:49:05.822061] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-30T19:49:05.854333] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-30T19:49:06.654436] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-30T19:49:07.359160] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-30T19:49:07.379111] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-30T19:49:07.454395] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-30T19:49:08.254383] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-30T19:49:09.054385] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-30T19:49:09.273682] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-30T19:49:09.282884] [INFO ] [REMOTE ] MCO: Full fetch complete (56815 records). [2025-09-30T19:49:09.283028] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-30T19:49:09.445939] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-30T19:49:09.741840] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-30T19:49:09.741944] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-30T19:49:09.742960] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-30T19:49:09.743027] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-30T19:49:09.744323] [DEBUG] [LOCAL ] MCO: Trimmed 56815 records to 39288 (keeping 200 days of data) [2025-09-30T19:49:09.847761] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-30T19:49:09.854503] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-30T19:49:10.022554] [DEBUG] [LOCAL ] MCO: Primary data saved (39288 records). [2025-09-30T19:49:10.022808] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-30T19:49:10.024520] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCO took 28.9s. Estimated remaining: 2h 15m 6s. Rate: 7.8 symbols/min [2025-09-30T19:49:10.563387] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-30T19:49:10.654416] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-30T19:49:11.454421] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-30T19:49:11.814914] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-30T19:49:12.254343] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-30T19:49:12.339204] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-30T19:49:12.341261] [INFO ] [REMOTE ] MCN: Full fetch complete (11638 records). [2025-09-30T19:49:12.341470] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-30T19:49:12.716996] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-30T19:49:12.717104] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-30T19:49:12.717424] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-30T19:49:12.717467] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-30T19:49:12.717982] [DEBUG] [LOCAL ] MCN: Trimmed 11638 records to 8182 (keeping 200 days of data) [2025-09-30T19:49:12.765458] [DEBUG] [LOCAL ] MCN: Primary data saved (8182 records). [2025-09-30T19:49:12.765592] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-30T19:49:12.765707] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. MCN took 47.7s. Estimated remaining: 2h 14m 55s. Rate: 7.8 symbols/min [2025-09-30T19:49:13.284257] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-30T19:49:13.289842] [INFO ] [REMOTE ] MCS: Full fetch complete (30338 records). [2025-09-30T19:49:13.289991] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-30T19:49:13.791187] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-30T19:49:13.791505] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-30T19:49:13.792317] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-30T19:49:13.792437] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-30T19:49:13.794597] [DEBUG] [LOCAL ] MCS: Trimmed 30338 records to 20933 (keeping 200 days of data) [2025-09-30T19:49:13.949885] [DEBUG] [LOCAL ] MCS: Primary data saved (20933 records). [2025-09-30T19:49:13.950013] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-30T19:49:13.950120] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCS took 25.6s. Estimated remaining: 2h 14m 42s. Rate: 7.8 symbols/min [2025-09-30T19:49:14.647455] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:14.663159] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:14.698138] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:14.759109] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:14.787164] [DEBUG] [LOCAL ] MDST: Loaded 5616 existing records from primary storage. [2025-09-30T19:49:14.787663] [INFO ] [MAIN ] MDST: Loaded 5616 existing records. [2025-09-30T19:49:14.835559] [DEBUG] [LOCAL ] MCY: Loaded 24642 existing records from primary storage. [2025-09-30T19:49:14.861821] [INFO ] [MAIN ] MCY: Loaded 24642 existing records. [2025-09-30T19:49:15.189328] [DEBUG] [LOCAL ] MD: Loaded 38420 existing records from primary storage. [2025-09-30T19:49:15.239177] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-30T19:49:15.249934] [INFO ] [MAIN ] MD: Loaded 38420 existing records. [2025-09-30T19:49:15.250535] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-09-30T19:49:15.249575] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:15.250859] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-30T19:49:15.326525] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-30T19:49:15.447377] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-30T19:49:15.556015] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-30T19:49:15.555910] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:15.586284] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-30T19:49:15.607874] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-30T19:49:15.702883] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-30T19:49:15.762460] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-30T19:49:15.833659] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:15.895563] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-30T19:49:15.931459] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-30T19:49:15.921742] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:16.000409] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-30T19:49:16.027442] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-30T19:49:16.053562] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-30T19:49:16.072087] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-30T19:49:16.196686] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-30T19:49:16.252595] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-30T19:49:16.840000] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:16.882288] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-09-30T19:49:17.057313] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:17.120729] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-09-30T19:49:17.380324] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:17.380864] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-09-30T19:49:17.477596] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:17.478639] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-09-30T19:49:17.624420] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-30T19:49:17.626605] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-09-30T19:49:18.290532] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-30T19:49:18.292637] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-30T19:49:18.425255] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-30T19:49:18.431544] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-30T19:49:18.906537] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-30T19:49:18.908971] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-30T19:49:18.976785] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-30T19:49:19.364993] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-30T19:49:19.454330] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-09-30T19:49:19.501350] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-30T19:49:19.583349] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-30T19:49:20.254396] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-09-30T19:49:21.015694] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-30T19:49:21.054329] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-30T19:49:21.458585] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-30T19:49:21.854353] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-30T19:49:22.073988] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-30T19:49:22.654370] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-30T19:49:23.197566] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-30T19:49:23.454403] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-30T19:49:23.757122] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-30T19:49:24.254369] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-30T19:49:25.054344] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-30T19:49:25.183369] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-30T19:49:25.505324] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-30T19:49:25.537756] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-30T19:49:25.854371] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-30T19:49:26.654369] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-30T19:49:27.161181] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-30T19:49:27.454350] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-30T19:49:28.254341] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-30T19:49:28.572194] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-30T19:49:28.888509] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-30T19:49:28.951398] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-30T19:49:29.054373] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-30T19:49:29.854399] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-30T19:49:30.480382] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-30T19:49:30.654353] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-30T19:49:30.815475] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-30T19:49:31.454416] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-30T19:49:32.052340] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-30T19:49:32.153493] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-30T19:49:32.254351] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-30T19:49:33.054375] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-30T19:49:33.817436] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-30T19:49:33.854305] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-30T19:49:33.888240] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-30T19:49:34.654350] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-30T19:49:35.180054] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-30T19:49:35.365882] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-30T19:49:35.454395] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-30T19:49:36.254362] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-30T19:49:36.612840] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-30T19:49:37.054400] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-30T19:49:37.854349] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-30T19:49:37.908236] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-30T19:49:37.910686] [INFO ] [REMOTE ] MDST: Full fetch complete (8583 records). [2025-09-30T19:49:37.910763] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-30T19:49:38.310836] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-30T19:49:38.310923] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-30T19:49:38.311279] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-30T19:49:38.311362] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-30T19:49:38.311980] [DEBUG] [LOCAL ] MDST: Trimmed 8583 records to 5641 (keeping 200 days of data) [2025-09-30T19:49:38.377391] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-30T19:49:38.398899] [DEBUG] [LOCAL ] MDST: Primary data saved (5641 records). [2025-09-30T19:49:38.399026] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-30T19:49:38.399129] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 24.4s. Estimated remaining: 2h 14m 47s. Rate: 7.8 symbols/min [2025-09-30T19:49:38.586754] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:38.648083] [DEBUG] [LOCAL ] MDU: Loaded 47900 existing records from primary storage. [2025-09-30T19:49:38.648433] [INFO ] [MAIN ] MDU: Loaded 47900 existing records. [2025-09-30T19:49:38.659683] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-30T19:49:38.853461] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:38.853795] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-30T19:49:38.853848] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-30T19:49:38.854382] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-30T19:49:38.854441] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-30T19:49:39.186104] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-30T19:49:39.280754] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:39.454359] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-09-30T19:49:40.206129] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-30T19:49:40.254417] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-30T19:49:41.011462] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-30T19:49:41.054346] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-30T19:49:41.475100] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-30T19:49:41.479815] [INFO ] [REMOTE ] MCY: Full fetch complete (41507 records). [2025-09-30T19:49:41.479913] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-30T19:49:41.872861] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-30T19:49:41.891072] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-30T19:49:41.891162] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-30T19:49:41.892046] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-30T19:49:41.892227] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-30T19:49:41.893447] [DEBUG] [LOCAL ] MCY: Trimmed 41507 records to 24490 (keeping 200 days of data) [2025-09-30T19:49:42.061830] [DEBUG] [LOCAL ] MCY: Primary data saved (24490 records). [2025-09-30T19:49:42.061973] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-30T19:49:42.062094] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MCY took 28.1s. Estimated remaining: 2h 14m 37s. Rate: 7.8 symbols/min [2025-09-30T19:49:42.237752] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:42.247699] [DEBUG] [LOCAL ] MDV: Loaded 8553 existing records from primary storage. [2025-09-30T19:49:42.247909] [INFO ] [MAIN ] MDV: Loaded 8553 existing records. [2025-09-30T19:49:42.433301] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:42.433551] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-30T19:49:42.433627] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-30T19:49:42.434079] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-30T19:49:42.434137] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-30T19:49:42.668775] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-09-30T19:49:42.830607] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:42.866186] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-30T19:49:43.336059] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-30T19:49:43.454363] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-30T19:49:44.254385] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-09-30T19:49:44.350542] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-30T19:49:44.724294] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-30T19:49:45.054333] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-09-30T19:49:45.088612] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-30T19:49:45.697803] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-30T19:49:45.854357] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-30T19:49:46.447430] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-30T19:49:46.654359] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-30T19:49:47.454360] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-30T19:49:47.486502] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-30T19:49:48.254362] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-30T19:49:48.905973] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-30T19:49:48.914152] [INFO ] [REMOTE ] MD: Full fetch complete (55143 records). [2025-09-30T19:49:48.914266] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-30T19:49:49.066230] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-30T19:49:49.334556] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-30T19:49:49.334677] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-30T19:49:49.335613] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-30T19:49:49.335697] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-30T19:49:49.337019] [DEBUG] [LOCAL ] MD: Trimmed 55143 records to 38339 (keeping 200 days of data) [2025-09-30T19:49:49.588444] [DEBUG] [LOCAL ] MD: Primary data saved (38339 records). [2025-09-30T19:49:49.588590] [INFO ] [MAIN ] MD: Full history saved. [2025-09-30T19:49:49.588707] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MD took 35.6s. Estimated remaining: 2h 14m 29s. Rate: 7.8 symbols/min [2025-09-30T19:49:49.777283] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:49.817578] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-30T19:49:49.836819] [DEBUG] [LOCAL ] MEC: Loaded 16296 existing records from primary storage. [2025-09-30T19:49:49.837091] [INFO ] [MAIN ] MEC: Loaded 16296 existing records. [2025-09-30T19:49:49.859748] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-30T19:49:49.975781] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-30T19:49:50.048214] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:50.048466] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-30T19:49:50.048517] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-30T19:49:50.048887] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-30T19:49:50.048949] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-30T19:49:50.434041] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:50.654368] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-30T19:49:51.432970] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-30T19:49:51.454385] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-30T19:49:51.903595] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-30T19:49:51.916262] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-09-30T19:49:51.916425] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-30T19:49:52.060423] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-30T19:49:52.259529] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-09-30T19:49:52.373350] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-30T19:49:52.373444] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-30T19:49:52.374521] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-30T19:49:52.374596] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-30T19:49:52.378777] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 53678 (keeping 200 days of data) [2025-09-30T19:49:52.733514] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-09-30T19:49:52.733686] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-30T19:49:52.733791] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDT took 38.8s. Estimated remaining: 2h 14m 17s. Rate: 7.8 symbols/min [2025-09-30T19:49:52.919880] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:49:52.944113] [DEBUG] [LOCAL ] MED: Loaded 21598 existing records from primary storage. [2025-09-30T19:49:52.944409] [INFO ] [MAIN ] MED: Loaded 21598 existing records. [2025-09-30T19:49:53.054665] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-30T19:49:53.140855] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:49:53.141238] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-30T19:49:53.141289] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-30T19:49:53.141634] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-30T19:49:53.141721] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-30T19:49:53.346953] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T19:49:53.549700] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:49:53.854442] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-09-30T19:49:54.466285] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-30T19:49:54.654374] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-30T19:49:55.052620] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-30T19:49:55.415001] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-30T19:49:55.454374] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-30T19:49:56.254352] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-30T19:49:56.316341] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-30T19:49:57.054351] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-30T19:49:57.781791] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-30T19:49:57.854330] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-30T19:49:57.970199] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-30T19:49:58.654389] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-09-30T19:49:58.833741] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-30T19:49:59.417887] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-30T19:49:59.454347] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-30T19:50:00.254354] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-30T19:50:00.453834] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-30T19:50:01.054411] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-30T19:50:01.762915] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-30T19:50:01.792235] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-30T19:50:01.854411] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-30T19:50:02.654374] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-30T19:50:03.032844] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-30T19:50:03.096473] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-30T19:50:03.454431] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-30T19:50:04.254419] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-30T19:50:04.687516] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-30T19:50:05.054394] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-30T19:50:05.854336] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-30T19:50:05.896828] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-30T19:50:06.054474] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-30T19:50:06.595457] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-30T19:50:06.597355] [INFO ] [REMOTE ] MDV: Full fetch complete (11606 records). [2025-09-30T19:50:06.597429] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-30T19:50:06.661350] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-30T19:50:06.987124] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-30T19:50:06.987200] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-30T19:50:06.987492] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-30T19:50:06.987530] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-30T19:50:06.988031] [DEBUG] [LOCAL ] MDV: Trimmed 11606 records to 8512 (keeping 200 days of data) [2025-09-30T19:50:07.041840] [DEBUG] [LOCAL ] MDV: Primary data saved (8512 records). [2025-09-30T19:50:07.041987] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-30T19:50:07.042070] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDV took 25.0s. Estimated remaining: 2h 14m 15s. Rate: 7.8 symbols/min [2025-09-30T19:50:07.227279] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:07.267865] [DEBUG] [LOCAL ] MEG: Loaded 31838 existing records from primary storage. [2025-09-30T19:50:07.268225] [INFO ] [MAIN ] MEG: Loaded 31838 existing records. [2025-09-30T19:50:07.459836] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-30T19:50:07.464923] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:07.465883] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-30T19:50:07.465938] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-30T19:50:07.466363] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-30T19:50:07.466434] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-30T19:50:07.856805] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:08.258068] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-30T19:50:08.263968] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-30T19:50:08.725300] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-30T19:50:09.001014] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-30T19:50:09.054374] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-30T19:50:09.854368] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-09-30T19:50:10.143788] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-30T19:50:10.654358] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-30T19:50:11.405900] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-30T19:50:11.454328] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-30T19:50:11.748280] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-30T19:50:12.254392] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-30T19:50:12.777088] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-30T19:50:13.054400] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-30T19:50:13.854372] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-30T19:50:14.106345] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-30T19:50:14.240497] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-30T19:50:14.654338] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-30T19:50:14.780214] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-30T19:50:15.454335] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-30T19:50:15.677438] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-30T19:50:16.254374] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-30T19:50:16.477912] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-30T19:50:17.054422] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-30T19:50:17.854373] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-30T19:50:17.974197] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-30T19:50:18.025240] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-30T19:50:18.654376] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-30T19:50:18.947039] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-30T19:50:18.951490] [INFO ] [REMOTE ] MED: Full fetch complete (32659 records). [2025-09-30T19:50:18.951613] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-30T19:50:19.366578] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-30T19:50:19.366690] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-30T19:50:19.367429] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-30T19:50:19.367485] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-30T19:50:19.368364] [DEBUG] [LOCAL ] MED: Trimmed 32659 records to 21517 (keeping 200 days of data) [2025-09-30T19:50:19.459220] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-30T19:50:19.510094] [DEBUG] [LOCAL ] MED: Primary data saved (21517 records). [2025-09-30T19:50:19.510240] [INFO ] [MAIN ] MED: Full history saved. [2025-09-30T19:50:19.510338] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MED took 26.8s. Estimated remaining: 2h 14m 11s. Rate: 7.8 symbols/min [2025-09-30T19:50:19.698945] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:19.714960] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-30T19:50:19.719926] [INFO ] [REMOTE ] MEC: Full fetch complete (22820 records). [2025-09-30T19:50:19.720060] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-30T19:50:19.864022] [DEBUG] [LOCAL ] MEGI: Loaded 20146 existing records from primary storage. [2025-09-30T19:50:19.870153] [INFO ] [MAIN ] MEGI: Loaded 20146 existing records. [2025-09-30T19:50:20.271050] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:20.293911] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-30T19:50:20.299258] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-30T19:50:20.285594] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-30T19:50:20.313477] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-30T19:50:20.334694] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-30T19:50:20.578945] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-30T19:50:20.610260] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-30T19:50:20.617781] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-30T19:50:20.635879] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-30T19:50:20.682111] [DEBUG] [LOCAL ] MEC: Trimmed 22820 records to 16312 (keeping 200 days of data) [2025-09-30T19:50:20.953789] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:20.996882] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-30T19:50:21.011817] [DEBUG] [LOCAL ] MEC: Primary data saved (16312 records). [2025-09-30T19:50:21.011950] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-30T19:50:21.012047] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MEC took 31.4s. Estimated remaining: 2h 13m 58s. Rate: 7.8 symbols/min [2025-09-30T19:50:21.059488] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-30T19:50:21.195958] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:21.232771] [DEBUG] [LOCAL ] MEI: Loaded 32162 existing records from primary storage. [2025-09-30T19:50:21.233052] [INFO ] [MAIN ] MEI: Loaded 32162 existing records. [2025-09-30T19:50:21.421604] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:21.421847] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-30T19:50:21.421958] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-30T19:50:21.422337] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-30T19:50:21.422400] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-30T19:50:21.818275] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:21.848154] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-30T19:50:21.858288] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-09-30T19:50:21.860040] [INFO ] [REMOTE ] MDU: Full fetch complete (70325 records). [2025-09-30T19:50:21.860138] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-30T19:50:22.289684] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-30T19:50:22.289871] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-30T19:50:22.290912] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-30T19:50:22.291078] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-30T19:50:22.292842] [DEBUG] [LOCAL ] MDU: Trimmed 70325 records to 47904 (keeping 200 days of data) [2025-09-30T19:50:22.541530] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-30T19:50:22.640352] [DEBUG] [LOCAL ] MDU: Primary data saved (47904 records). [2025-09-30T19:50:22.640500] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-30T19:50:22.640589] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MDU took 44.2s. Estimated remaining: 2h 13m 46s. Rate: 7.8 symbols/min [2025-09-30T19:50:22.663492] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-30T19:50:22.829286] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:22.889402] [DEBUG] [LOCAL ] MET: Loaded 53311 existing records from primary storage. [2025-09-30T19:50:22.889910] [INFO ] [MAIN ] MET: Loaded 53311 existing records. [2025-09-30T19:50:23.099351] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:23.099692] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-30T19:50:23.099753] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-30T19:50:23.100533] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-30T19:50:23.100594] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-30T19:50:23.350195] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-30T19:50:23.459470] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-09-30T19:50:23.522083] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:24.103781] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-30T19:50:24.254356] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-09-30T19:50:24.491026] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-30T19:50:25.054383] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-09-30T19:50:25.346887] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-30T19:50:25.854388] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-30T19:50:26.654373] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-30T19:50:26.804949] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-30T19:50:26.917337] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-30T19:50:27.454407] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-30T19:50:27.855722] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-30T19:50:28.104881] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-30T19:50:28.254354] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-09-30T19:50:29.054380] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-30T19:50:29.850759] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-30T19:50:29.861006] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-30T19:50:30.177413] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-30T19:50:30.654387] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-30T19:50:31.124696] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-30T19:50:31.264228] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-30T19:50:31.454405] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-30T19:50:32.254413] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-30T19:50:32.927356] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-30T19:50:32.934953] [INFO ] [REMOTE ] MEG: Full fetch complete (48003 records). [2025-09-30T19:50:32.935081] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-30T19:50:33.057978] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-30T19:50:33.301418] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-30T19:50:33.406489] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-30T19:50:33.406571] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-30T19:50:33.407432] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-30T19:50:33.407530] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-30T19:50:33.409027] [DEBUG] [LOCAL ] MEG: Trimmed 48003 records to 31793 (keeping 200 days of data) [2025-09-30T19:50:33.611112] [DEBUG] [LOCAL ] MEG: Primary data saved (31793 records). [2025-09-30T19:50:33.611293] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-30T19:50:33.611390] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEG took 26.6s. Estimated remaining: 2h 13m 41s. Rate: 7.8 symbols/min [2025-09-30T19:50:33.810634] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:33.858626] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-30T19:50:33.862699] [DEBUG] [LOCAL ] MFA: Loaded 45387 existing records from primary storage. [2025-09-30T19:50:33.863251] [INFO ] [MAIN ] MFA: Loaded 45387 existing records. [2025-09-30T19:50:34.060581] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:34.060827] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-30T19:50:34.060876] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-30T19:50:34.061275] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-30T19:50:34.061334] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-30T19:50:34.381536] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-30T19:50:34.470370] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:34.654382] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-30T19:50:34.757022] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-30T19:50:35.454371] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-30T19:50:36.184820] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-30T19:50:36.254368] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-30T19:50:36.590512] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-30T19:50:37.054357] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-30T19:50:37.854348] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-09-30T19:50:38.029373] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-30T19:50:38.490353] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-30T19:50:38.654370] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-30T19:50:39.454427] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-30T19:50:39.503132] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-30T19:50:39.786006] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-30T19:50:40.254364] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-09-30T19:50:41.054325] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-30T19:50:41.414136] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-30T19:50:41.458804] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-30T19:50:41.854426] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-30T19:50:42.185512] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-30T19:50:42.654406] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-30T19:50:43.454374] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-30T19:50:43.691633] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-30T19:50:44.254367] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-30T19:50:44.351320] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-30T19:50:44.356261] [INFO ] [REMOTE ] MEGI: Full fetch complete (30501 records). [2025-09-30T19:50:44.356490] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-30T19:50:44.809292] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-30T19:50:44.809436] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-30T19:50:44.810405] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-30T19:50:44.810525] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-30T19:50:44.812123] [DEBUG] [LOCAL ] MEGI: Trimmed 30501 records to 20119 (keeping 200 days of data) [2025-09-30T19:50:44.943766] [DEBUG] [LOCAL ] MEGI: Primary data saved (20119 records). [2025-09-30T19:50:44.943906] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-30T19:50:44.944137] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MEGI took 25.4s. Estimated remaining: 2h 13m 36s. Rate: 7.8 symbols/min [2025-09-30T19:50:45.059529] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-30T19:50:45.124440] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-22 to 2025-09-30. [2025-09-30T19:50:45.131194] [DEBUG] [LOCAL ] MFAN: Loaded 4198 existing records from primary storage. [2025-09-30T19:50:45.131389] [INFO ] [MAIN ] MFAN: Loaded 4198 existing records. [2025-09-30T19:50:45.320531] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-13, but need from 2024-12-11 for 200 day retention. Performing full refresh. [2025-09-30T19:50:45.320953] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-30T19:50:45.321107] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-30T19:50:45.321312] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-30T19:50:45.321390] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-30T19:50:45.728492] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-30T19:50:45.734360] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-11 to 2025-09-30 (requires 10 months of data pull). [2025-09-30T19:50:45.854356] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-30T19:50:46.325919] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (3.67 seconds). [2025-09-30T19:50:46.654331] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-30T19:50:46.829955] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-30T19:50:47.400761] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-30T19:50:47.454329] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-30T19:50:48.143960] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-30T19:50:48.254339] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-30T19:50:49.054373] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-30T19:50:49.202530] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-30T19:50:49.854367] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-09-30T19:50:50.046608] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-30T19:50:50.311560] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-30T19:50:50.367233] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-30T19:50:50.654355] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-09-30T19:50:51.230470] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-30T19:50:51.454352] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-30T19:50:52.254391]